Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-09-27T13:49:37Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-09-27T13:49:37Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260927 13:49:37.662758 4749 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
/tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.126:42985
--webserver_interface=127.4.163.126
--webserver_port=0
--builtin_ntp_servers=127.4.163.84:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260927 13:49:38.009990 4757 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 13:49:38.010412 4757 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 13:49:38.010546 4757 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260927 13:49:38.019172 4757 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 13:49:38.019320 4757 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260927 13:49:38.019428 4757 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 13:49:38.019513 4757 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260927 13:49:38.029754 4757 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.163.84:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.126:42985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.163.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 27 Sep 2026 13:43:25 UTC on bdcb31816ec0
build id 14025
ASAN enabled
I20260927 13:49:38.031481 4757 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 13:49:38.033258 4757 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260927 13:49:38.042559 4763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:38.042543 4762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:38.042778 4765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:38.043479 4757 server_base.cc:1061] running on GCE node
I20260927 13:49:38.044497 4757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 13:49:38.046026 4757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 13:49:38.047219 4757 hybrid_clock.cc:648] HybridClock initialized: now 1790516978047151 us; error 59 us; skew 500 ppm
I20260927 13:49:38.047623 4757 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 13:49:38.050457 4757 webserver.cc:533] Webserver started at http://127.4.163.126:34313/ using document root <none> and password file <none>
I20260927 13:49:38.051313 4757 fs_manager.cc:362] Metadata directory not provided
I20260927 13:49:38.051842 4757 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 13:49:38.052232 4757 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 13:49:38.055085 4757 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data/instance:
uuid: "13a42ae8b95b495c9bcea85d6732cd77"
format_stamp: "Formatted at 2026-09-27 13:49:38 on dist-test-slave-bkfv"
I20260927 13:49:38.055888 4757 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal/instance:
uuid: "13a42ae8b95b495c9bcea85d6732cd77"
format_stamp: "Formatted at 2026-09-27 13:49:38 on dist-test-slave-bkfv"
I20260927 13:49:38.062520 4757 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260927 13:49:38.066606 4771 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:38.068053 4757 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260927 13:49:38.068260 4757 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data,/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal
uuid: "13a42ae8b95b495c9bcea85d6732cd77"
format_stamp: "Formatted at 2026-09-27 13:49:38 on dist-test-slave-bkfv"
I20260927 13:49:38.068521 4757 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 13:49:38.092813 4757 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260927 13:49:38.093760 4757 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 13:49:38.094064 4757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 13:49:38.116611 4757 rpc_server.cc:307] RPC server started. Bound to: 127.4.163.126:42985
I20260927 13:49:38.116636 4822 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.163.126:42985 every 8 connection(s)
I20260927 13:49:38.118289 4757 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data/info.pb
I20260927 13:49:38.122670 4749 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu as pid 4757
I20260927 13:49:38.123003 4749 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal/instance
I20260927 13:49:38.123852 4823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:38.126852 4749 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
/tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.125:42239
--webserver_interface=127.4.163.125
--webserver_port=0
--builtin_ntp_servers=127.4.163.84:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260927 13:49:38.132633 4823 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } has no permanent_uuid. Determining permanent_uuid...
I20260927 13:49:38.151708 4823 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } has no permanent_uuid. Determining permanent_uuid...
W20260927 13:49:38.153115 4773 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection refused (error 111)
W20260927 13:49:38.154990 4823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.125:42239: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection refused (error 111)
I20260927 13:49:38.204360 4823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } attempt: 1
W20260927 13:49:38.206486 4823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.125:42239: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection refused (error 111)
I20260927 13:49:38.274765 4823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } attempt: 2
W20260927 13:49:38.276721 4823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.125:42239: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection refused (error 111)
I20260927 13:49:38.368026 4823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } attempt: 3
W20260927 13:49:38.370173 4823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.125:42239: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection refused (error 111)
W20260927 13:49:38.500136 4825 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 13:49:38.500483 4825 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 13:49:38.500624 4825 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260927 13:49:38.509836 4825 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 13:49:38.509938 4825 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260927 13:49:38.510023 4825 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 13:49:38.510110 4825 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260927 13:49:38.513445 4823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } attempt: 4
W20260927 13:49:38.515599 4823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.125:42239: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection refused (error 111)
I20260927 13:49:38.522061 4825 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.163.84:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.125:42239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.163.125
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 27 Sep 2026 13:43:25 UTC on bdcb31816ec0
build id 14025
ASAN enabled
I20260927 13:49:38.524236 4825 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 13:49:38.526648 4825 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260927 13:49:38.536247 4833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:38.536216 4834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:38.536741 4836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:38.537181 4825 server_base.cc:1061] running on GCE node
I20260927 13:49:38.537952 4825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 13:49:38.539546 4825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 13:49:38.540767 4825 hybrid_clock.cc:648] HybridClock initialized: now 1790516978540726 us; error 39 us; skew 500 ppm
I20260927 13:49:38.541134 4825 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 13:49:38.543350 4825 webserver.cc:533] Webserver started at http://127.4.163.125:43209/ using document root <none> and password file <none>
I20260927 13:49:38.544103 4825 fs_manager.cc:362] Metadata directory not provided
I20260927 13:49:38.544231 4825 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 13:49:38.544585 4825 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 13:49:38.547060 4825 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data/instance:
uuid: "e421351a34d1463e9773dcebdeebae3c"
format_stamp: "Formatted at 2026-09-27 13:49:38 on dist-test-slave-bkfv"
I20260927 13:49:38.547837 4825 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal/instance:
uuid: "e421351a34d1463e9773dcebdeebae3c"
format_stamp: "Formatted at 2026-09-27 13:49:38 on dist-test-slave-bkfv"
I20260927 13:49:38.553265 4825 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260927 13:49:38.557291 4842 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:38.558853 4825 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260927 13:49:38.559058 4825 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data,/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal
uuid: "e421351a34d1463e9773dcebdeebae3c"
format_stamp: "Formatted at 2026-09-27 13:49:38 on dist-test-slave-bkfv"
I20260927 13:49:38.559293 4825 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 13:49:38.583886 4825 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260927 13:49:38.584836 4825 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 13:49:38.585134 4825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 13:49:38.607447 4825 rpc_server.cc:307] RPC server started. Bound to: 127.4.163.125:42239
I20260927 13:49:38.607486 4893 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.163.125:42239 every 8 connection(s)
I20260927 13:49:38.608985 4825 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data/info.pb
I20260927 13:49:38.613837 4894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:38.616958 4749 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu as pid 4825
I20260927 13:49:38.617184 4749 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal/instance
I20260927 13:49:38.618304 4749 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
/tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.124:37095
--webserver_interface=127.4.163.124
--webserver_port=0
--builtin_ntp_servers=127.4.163.84:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260927 13:49:38.620555 4894 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } has no permanent_uuid. Determining permanent_uuid...
I20260927 13:49:38.634754 4894 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } has no permanent_uuid. Determining permanent_uuid...
I20260927 13:49:38.644620 4894 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } has no permanent_uuid. Determining permanent_uuid...
W20260927 13:49:38.645797 4846 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
W20260927 13:49:38.647420 4894 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.124:37095: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
I20260927 13:49:38.696774 4894 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } attempt: 1
W20260927 13:49:38.699270 4894 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.124:37095: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
I20260927 13:49:38.767531 4894 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } attempt: 2
W20260927 13:49:38.769631 4894 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.124:37095: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
I20260927 13:49:38.814913 4823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } attempt: 5
I20260927 13:49:38.821803 4823 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } has no permanent_uuid. Determining permanent_uuid...
W20260927 13:49:38.824618 4823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.124:37095: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
I20260927 13:49:38.861034 4894 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } attempt: 3
W20260927 13:49:38.863206 4894 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.124:37095: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
I20260927 13:49:38.875887 4823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } attempt: 1
W20260927 13:49:38.878333 4823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.124:37095: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
I20260927 13:49:38.946565 4823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } attempt: 2
W20260927 13:49:38.948550 4823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.124:37095: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
W20260927 13:49:38.971316 4896 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 13:49:38.971634 4896 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 13:49:38.971750 4896 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260927 13:49:38.980832 4896 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 13:49:38.980942 4896 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260927 13:49:38.981031 4896 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 13:49:38.981096 4896 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260927 13:49:38.991804 4896 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.163.84:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.124:37095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.163.124
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 27 Sep 2026 13:43:25 UTC on bdcb31816ec0
build id 14025
ASAN enabled
I20260927 13:49:38.993536 4896 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 13:49:38.995548 4896 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260927 13:49:39.003911 4905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:39.004042 4904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:39.005383 4907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:39.005501 4896 server_base.cc:1061] running on GCE node
I20260927 13:49:39.006739 4894 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } attempt: 4
I20260927 13:49:39.006853 4896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20260927 13:49:39.008656 4894 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.124:37095: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
I20260927 13:49:39.008786 4896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 13:49:39.010006 4896 hybrid_clock.cc:648] HybridClock initialized: now 1790516979009956 us; error 38 us; skew 500 ppm
I20260927 13:49:39.010432 4896 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 13:49:39.012595 4896 webserver.cc:533] Webserver started at http://127.4.163.124:36383/ using document root <none> and password file <none>
I20260927 13:49:39.013327 4896 fs_manager.cc:362] Metadata directory not provided
I20260927 13:49:39.013458 4896 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 13:49:39.013818 4896 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 13:49:39.016296 4896 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data/instance:
uuid: "802b83f09d3445359cfac825cd87c9de"
format_stamp: "Formatted at 2026-09-27 13:49:39 on dist-test-slave-bkfv"
I20260927 13:49:39.017117 4896 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal/instance:
uuid: "802b83f09d3445359cfac825cd87c9de"
format_stamp: "Formatted at 2026-09-27 13:49:39 on dist-test-slave-bkfv"
I20260927 13:49:39.022532 4896 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260927 13:49:39.025856 4913 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:39.027285 4896 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260927 13:49:39.027496 4896 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data,/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal
uuid: "802b83f09d3445359cfac825cd87c9de"
format_stamp: "Formatted at 2026-09-27 13:49:39 on dist-test-slave-bkfv"
I20260927 13:49:39.027709 4896 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 13:49:39.054808 4823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } attempt: 3
W20260927 13:49:39.056770 4823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.163.124:37095: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
I20260927 13:49:39.057744 4896 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260927 13:49:39.058682 4896 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 13:49:39.058961 4896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 13:49:39.081462 4896 rpc_server.cc:307] RPC server started. Bound to: 127.4.163.124:37095
I20260927 13:49:39.081508 4964 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.163.124:37095 every 8 connection(s)
I20260927 13:49:39.083033 4896 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data/info.pb
I20260927 13:49:39.087260 4749 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu as pid 4896
I20260927 13:49:39.087445 4749 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal/instance
I20260927 13:49:39.088549 4965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:39.097133 4965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } has no permanent_uuid. Determining permanent_uuid...
I20260927 13:49:39.111166 4965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } has no permanent_uuid. Determining permanent_uuid...
I20260927 13:49:39.121434 4965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } has no permanent_uuid. Determining permanent_uuid...
I20260927 13:49:39.136281 4965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Bootstrap starting.
I20260927 13:49:39.139964 4965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:39.141438 4965 log.cc:826] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Log is configured to *not* fsync() on all Append() calls
I20260927 13:49:39.144137 4965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: No bootstrap required, opened a new log
I20260927 13:49:39.149652 4965 raft_consensus.cc:359] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:39.149994 4965 raft_consensus.cc:385] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:39.150153 4965 raft_consensus.cc:740] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 802b83f09d3445359cfac825cd87c9de, State: Initialized, Role: FOLLOWER
I20260927 13:49:39.150811 4965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:39.151716 4974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:39.151960 4974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:39.152944 4965 sys_catalog.cc:565] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: configured and running, proceeding with master startup.
W20260927 13:49:39.164817 4985 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 13:49:39.164986 4985 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 13:49:39.161052 4896 master_runner.cc:187] Error getting master registration for 127.4.163.126:42985: OK, instance_id { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" instance_seqno: 1790516978110514 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 13:49:39.168294 4896 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260927 13:49:39.234004 4823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } attempt: 4
I20260927 13:49:39.246935 4823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Bootstrap starting.
I20260927 13:49:39.251150 4823 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:39.253459 4823 log.cc:826] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Log is configured to *not* fsync() on all Append() calls
I20260927 13:49:39.256695 4823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: No bootstrap required, opened a new log
I20260927 13:49:39.265839 4823 raft_consensus.cc:359] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:39.266436 4823 raft_consensus.cc:385] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:39.266604 4823 raft_consensus.cc:740] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13a42ae8b95b495c9bcea85d6732cd77, State: Initialized, Role: FOLLOWER
I20260927 13:49:39.267395 4823 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:39.268409 4988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:39.268664 4988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:39.269821 4823 sys_catalog.cc:565] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: configured and running, proceeding with master startup.
W20260927 13:49:39.280951 4999 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 13:49:39.281082 4999 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 13:49:39.280601 4757 master_runner.cc:187] Error getting master registration for 127.4.163.125:42239: OK, instance_id { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" instance_seqno: 1790516978601535 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 13:49:39.288698 4757 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260927 13:49:39.307868 4894 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } attempt: 5
W20260927 13:49:39.311148 4919 tablet.cc:2433] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 13:49:39.322489 4894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Bootstrap starting.
I20260927 13:49:39.327148 4894 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:39.329111 4894 log.cc:826] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Log is configured to *not* fsync() on all Append() calls
I20260927 13:49:39.334501 4894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: No bootstrap required, opened a new log
I20260927 13:49:39.342943 4894 raft_consensus.cc:359] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:39.343321 4894 raft_consensus.cc:385] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:39.343510 4894 raft_consensus.cc:740] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e421351a34d1463e9773dcebdeebae3c, State: Initialized, Role: FOLLOWER
I20260927 13:49:39.344367 4894 consensus_queue.cc:260] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:39.345440 5002 sys_catalog.cc:455] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:39.345813 5002 sys_catalog.cc:458] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:39.346789 4894 sys_catalog.cc:565] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: configured and running, proceeding with master startup.
W20260927 13:49:39.347445 4777 tablet.cc:2433] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 13:49:39.351981 4974 raft_consensus.cc:493] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:39.352254 4974 raft_consensus.cc:515] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:39.354089 4974 leader_election.cc:290] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239)
I20260927 13:49:39.355054 4988 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:39.355402 4988 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:39.357244 4988 leader_election.cc:290] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:49:39.357841 4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c" is_pre_election: true
I20260927 13:49:39.358383 4869 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 802b83f09d3445359cfac825cd87c9de in term 0.
I20260927 13:49:39.360018 4940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13a42ae8b95b495c9bcea85d6732cd77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "802b83f09d3445359cfac825cd87c9de" is_pre_election: true
I20260927 13:49:39.360476 4940 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13a42ae8b95b495c9bcea85d6732cd77 in term 0.
I20260927 13:49:39.362221 4798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13a42ae8b95b495c9bcea85d6732cd77" is_pre_election: true
I20260927 13:49:39.363066 4798 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 802b83f09d3445359cfac825cd87c9de in term 0.
I20260927 13:49:39.363641 4915 leader_election.cc:304] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 802b83f09d3445359cfac825cd87c9de, e421351a34d1463e9773dcebdeebae3c; no voters:
I20260927 13:49:39.364526 4775 leader_election.cc:304] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13a42ae8b95b495c9bcea85d6732cd77, 802b83f09d3445359cfac825cd87c9de; no voters:
I20260927 13:49:39.365480 4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13a42ae8b95b495c9bcea85d6732cd77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c" is_pre_election: true
I20260927 13:49:39.365671 4869 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13a42ae8b95b495c9bcea85d6732cd77 in term 0.
I20260927 13:49:39.366533 4974 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:39.366691 4974 raft_consensus.cc:493] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:39.366789 4974 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:39.370323 4988 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:39.370487 4988 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:39.370582 4988 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:39.374385 4988 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:39.374739 4974 raft_consensus.cc:515] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:39.375980 4798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13a42ae8b95b495c9bcea85d6732cd77"
I20260927 13:49:39.376750 4798 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 802b83f09d3445359cfac825cd87c9de in current term 1: Already voted for candidate 13a42ae8b95b495c9bcea85d6732cd77 in this term.
I20260927 13:49:39.378566 4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13a42ae8b95b495c9bcea85d6732cd77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c"
I20260927 13:49:39.378767 4869 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:39.386263 4869 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13a42ae8b95b495c9bcea85d6732cd77 in term 1.
I20260927 13:49:39.386790 4773 leader_election.cc:304] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13a42ae8b95b495c9bcea85d6732cd77, e421351a34d1463e9773dcebdeebae3c; no voters:
I20260927 13:49:39.390220 4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c"
I20260927 13:49:39.390663 4869 raft_consensus.cc:2393] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 802b83f09d3445359cfac825cd87c9de in current term 1: Already voted for candidate 13a42ae8b95b495c9bcea85d6732cd77 in this term.
I20260927 13:49:39.391283 4915 leader_election.cc:304] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 802b83f09d3445359cfac825cd87c9de; no voters: 13a42ae8b95b495c9bcea85d6732cd77, e421351a34d1463e9773dcebdeebae3c
I20260927 13:49:39.399196 4940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13a42ae8b95b495c9bcea85d6732cd77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "802b83f09d3445359cfac825cd87c9de"
I20260927 13:49:39.399550 4940 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 13a42ae8b95b495c9bcea85d6732cd77 in current term 1: Already voted for candidate 802b83f09d3445359cfac825cd87c9de in this term.
I20260927 13:49:39.400415 4988 leader_election.cc:290] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 1 election: Requested vote from peers e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:49:39.400715 4988 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:39.400902 4988 raft_consensus.cc:697] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 1 LEADER]: Becoming Leader. State: Replica: 13a42ae8b95b495c9bcea85d6732cd77, State: Running, Role: LEADER
I20260927 13:49:39.401479 4988 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:39.402200 4974 leader_election.cc:290] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 1 election: Requested vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239)
I20260927 13:49:39.402473 4974 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 13:49:39.423453 5009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13a42ae8b95b495c9bcea85d6732cd77. Latest consensus state: current_term: 1 leader_uuid: "13a42ae8b95b495c9bcea85d6732cd77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:39.424041 5009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: This master's current role is: LEADER
I20260927 13:49:39.428269 5012 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260927 13:49:39.430787 5012 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260927 13:49:39.451987 4940 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Refusing update from remote peer 13a42ae8b95b495c9bcea85d6732cd77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:39.452965 5009 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:39.461138 4869 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Refusing update from remote peer 13a42ae8b95b495c9bcea85d6732cd77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:39.462239 5009 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:39.481591 5002 sys_catalog.cc:455] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13a42ae8b95b495c9bcea85d6732cd77. Latest consensus state: current_term: 1 leader_uuid: "13a42ae8b95b495c9bcea85d6732cd77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:39.481856 5002 sys_catalog.cc:458] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:39.491830 5014 mvcc.cc:204] Tried to move back new op lower bound from 7333957547801989120 to 7333957547668283392. Current Snapshot: MvccSnapshot[applied={T|T < 7333957547801989120}]
I20260927 13:49:39.496642 5022 catalog_manager.cc:818] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260927 13:49:39.499466 5010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13a42ae8b95b495c9bcea85d6732cd77. Latest consensus state: current_term: 1 leader_uuid: "13a42ae8b95b495c9bcea85d6732cd77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:39.499775 5010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:39.501497 5002 sys_catalog.cc:455] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "13a42ae8b95b495c9bcea85d6732cd77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:39.501691 5002 sys_catalog.cc:458] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:39.502575 5012 catalog_manager.cc:1396] Generated new cluster ID: 020f38d03ca7495283eb7628b4a1a71b
I20260927 13:49:39.502684 5012 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260927 13:49:39.503489 5009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "13a42ae8b95b495c9bcea85d6732cd77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:39.503728 5009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: This master's current role is: LEADER
I20260927 13:49:39.503958 5009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "13a42ae8b95b495c9bcea85d6732cd77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:39.504125 5009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: This master's current role is: LEADER
I20260927 13:49:39.525136 5010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "13a42ae8b95b495c9bcea85d6732cd77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:39.525357 5010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:39.539997 5012 catalog_manager.cc:1419] Generated new certificate authority record
I20260927 13:49:39.546180 5012 catalog_manager.cc:1553] Loading token signing keys...
I20260927 13:49:39.560235 5012 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Generated new TSK 0
I20260927 13:49:39.561403 5012 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260927 13:49:39.586771 4749 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
/tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.163.65:0
--local_ip_for_outbound_sockets=127.4.163.65
--webserver_interface=127.4.163.65
--webserver_port=0
--tserver_master_addrs=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--builtin_ntp_servers=127.4.163.84:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260927 13:49:39.948202 5027 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 13:49:39.948525 5027 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 13:49:39.948664 5027 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260927 13:49:39.957552 5027 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260927 13:49:39.957779 5027 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.163.65
I20260927 13:49:39.968125 5027 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.163.84:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.163.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.163.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.163.65
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 27 Sep 2026 13:43:25 UTC on bdcb31816ec0
build id 14025
ASAN enabled
I20260927 13:49:39.969749 5027 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 13:49:39.971799 5027 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260927 13:49:39.981514 5033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:39.981539 5032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:39.982225 5035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:39.983048 5027 server_base.cc:1061] running on GCE node
I20260927 13:49:39.983601 5027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 13:49:39.984925 5027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 13:49:39.986202 5027 hybrid_clock.cc:648] HybridClock initialized: now 1790516979986162 us; error 60 us; skew 500 ppm
I20260927 13:49:39.986526 5027 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 13:49:39.988813 5027 webserver.cc:533] Webserver started at http://127.4.163.65:42451/ using document root <none> and password file <none>
I20260927 13:49:39.989565 5027 fs_manager.cc:362] Metadata directory not provided
I20260927 13:49:39.989691 5027 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 13:49:39.990046 5027 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 13:49:39.992501 5027 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/data/instance:
uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
format_stamp: "Formatted at 2026-09-27 13:49:39 on dist-test-slave-bkfv"
I20260927 13:49:39.993314 5027 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/instance:
uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
format_stamp: "Formatted at 2026-09-27 13:49:39 on dist-test-slave-bkfv"
I20260927 13:49:39.998828 5027 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260927 13:49:40.002202 5041 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:40.003784 5027 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260927 13:49:40.003957 5027 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/data,/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal
uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
format_stamp: "Formatted at 2026-09-27 13:49:39 on dist-test-slave-bkfv"
I20260927 13:49:40.004158 5027 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 13:49:40.034920 5027 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260927 13:49:40.035832 5027 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 13:49:40.036109 5027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 13:49:40.037065 5027 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260927 13:49:40.038731 5027 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 13:49:40.038854 5027 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:40.038976 5027 ts_tablet_manager.cc:616] Registered 0 tablets
I20260927 13:49:40.039059 5027 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:40.063064 5116 raft_consensus.cc:493] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13a42ae8b95b495c9bcea85d6732cd77)
I20260927 13:49:40.063462 5116 raft_consensus.cc:515] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:40.065657 4798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "13a42ae8b95b495c9bcea85d6732cd77" is_pre_election: true
I20260927 13:49:40.065657 4940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "802b83f09d3445359cfac825cd87c9de" is_pre_election: true
I20260927 13:49:40.066493 4843 leader_election.cc:304] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e421351a34d1463e9773dcebdeebae3c; no voters: 13a42ae8b95b495c9bcea85d6732cd77, 802b83f09d3445359cfac825cd87c9de
I20260927 13:49:40.066614 5116 leader_election.cc:290] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:49:40.066977 5116 raft_consensus.cc:2749] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:49:40.077020 5027 rpc_server.cc:307] RPC server started. Bound to: 127.4.163.65:41061
I20260927 13:49:40.077104 5154 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.163.65:41061 every 8 connection(s)
I20260927 13:49:40.079034 5027 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/data/info.pb
I20260927 13:49:40.085544 4749 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu as pid 5027
I20260927 13:49:40.085773 4749 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/instance
I20260927 13:49:40.092090 4749 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
/tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.163.66:0
--local_ip_for_outbound_sockets=127.4.163.66
--webserver_interface=127.4.163.66
--webserver_port=0
--tserver_master_addrs=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--builtin_ntp_servers=127.4.163.84:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260927 13:49:40.105528 5156 heartbeater.cc:344] Connected to a master server at 127.4.163.126:42985
I20260927 13:49:40.105975 5156 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:40.107131 5156 heartbeater.cc:507] Master 127.4.163.126:42985 requested a full tablet report, sending...
I20260927 13:49:40.109576 4788 ts_manager.cc:194] Registered new tserver with Master: 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:40.111371 4788 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.163.65:44095
I20260927 13:49:40.114485 5157 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:40.114631 5157 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:40.115423 5157 heartbeater.cc:507] Master 127.4.163.125:42239 requested a full tablet report, sending...
I20260927 13:49:40.117163 4859 ts_manager.cc:194] Registered new tserver with Master: 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:40.129374 5155 heartbeater.cc:344] Connected to a master server at 127.4.163.124:37095
I20260927 13:49:40.129526 5155 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:40.129814 5155 heartbeater.cc:507] Master 127.4.163.124:37095 requested a full tablet report, sending...
I20260927 13:49:40.131623 4929 ts_manager.cc:194] Registered new tserver with Master: 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:40.166870 4985 catalog_manager.cc:1308] Loaded cluster ID: 020f38d03ca7495283eb7628b4a1a71b
I20260927 13:49:40.166971 4985 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: loading cluster ID for follower catalog manager: success
I20260927 13:49:40.169414 4985 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: acquiring CA information for follower catalog manager: success
I20260927 13:49:40.171133 4985 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260927 13:49:40.458421 5165 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 13:49:40.458766 5165 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 13:49:40.458912 5165 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260927 13:49:40.467278 5165 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260927 13:49:40.467519 5165 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.163.66
I20260927 13:49:40.478050 5165 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.163.84:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.163.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.163.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.163.66
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 27 Sep 2026 13:43:25 UTC on bdcb31816ec0
build id 14025
ASAN enabled
I20260927 13:49:40.479940 5165 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 13:49:40.481793 5165 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260927 13:49:40.492653 5170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:40.492682 5171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:40.493402 5173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:40.494325 5165 server_base.cc:1061] running on GCE node
I20260927 13:49:40.494940 5165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 13:49:40.495924 5165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 13:49:40.497128 5165 hybrid_clock.cc:648] HybridClock initialized: now 1790516980497081 us; error 37 us; skew 500 ppm
I20260927 13:49:40.497555 5165 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 13:49:40.500262 5165 webserver.cc:533] Webserver started at http://127.4.163.66:45847/ using document root <none> and password file <none>
I20260927 13:49:40.501255 5165 fs_manager.cc:362] Metadata directory not provided
I20260927 13:49:40.501469 5165 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 13:49:40.501945 5165 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 13:49:40.502833 5022 catalog_manager.cc:1308] Loaded cluster ID: 020f38d03ca7495283eb7628b4a1a71b
I20260927 13:49:40.502959 5022 catalog_manager.cc:1601] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: loading cluster ID for follower catalog manager: success
I20260927 13:49:40.505694 5165 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/data/instance:
uuid: "79c1646c9659434b9a659382d2eb1d8a"
format_stamp: "Formatted at 2026-09-27 13:49:40 on dist-test-slave-bkfv"
I20260927 13:49:40.506759 5165 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/instance:
uuid: "79c1646c9659434b9a659382d2eb1d8a"
format_stamp: "Formatted at 2026-09-27 13:49:40 on dist-test-slave-bkfv"
I20260927 13:49:40.507427 5022 catalog_manager.cc:1623] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: acquiring CA information for follower catalog manager: success
I20260927 13:49:40.510190 5022 catalog_manager.cc:1651] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260927 13:49:40.513368 5165 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260927 13:49:40.517637 5180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:40.519308 5165 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260927 13:49:40.519488 5165 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/data,/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal
uuid: "79c1646c9659434b9a659382d2eb1d8a"
format_stamp: "Formatted at 2026-09-27 13:49:40 on dist-test-slave-bkfv"
I20260927 13:49:40.519713 5165 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 13:49:40.523510 5181 raft_consensus.cc:493] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13a42ae8b95b495c9bcea85d6732cd77)
I20260927 13:49:40.523722 5181 raft_consensus.cc:515] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:40.524825 5181 leader_election.cc:290] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239)
I20260927 13:49:40.525179 4798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "13a42ae8b95b495c9bcea85d6732cd77" is_pre_election: true
I20260927 13:49:40.525511 4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c" is_pre_election: true
I20260927 13:49:40.526201 4915 leader_election.cc:304] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 802b83f09d3445359cfac825cd87c9de; no voters: 13a42ae8b95b495c9bcea85d6732cd77, e421351a34d1463e9773dcebdeebae3c
I20260927 13:49:40.526652 5181 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:49:40.535694 5165 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260927 13:49:40.536572 5165 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 13:49:40.536862 5165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 13:49:40.537941 5165 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260927 13:49:40.539702 5165 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 13:49:40.539824 5165 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:40.539961 5165 ts_tablet_manager.cc:616] Registered 0 tablets
I20260927 13:49:40.540051 5165 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:40.585981 5165 rpc_server.cc:307] RPC server started. Bound to: 127.4.163.66:39007
I20260927 13:49:40.586014 5293 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.163.66:39007 every 8 connection(s)
I20260927 13:49:40.587512 5165 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/data/info.pb
I20260927 13:49:40.592458 4749 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu as pid 5165
I20260927 13:49:40.592657 4749 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/instance
I20260927 13:49:40.601143 4749 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
/tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.163.67:0
--local_ip_for_outbound_sockets=127.4.163.67
--webserver_interface=127.4.163.67
--webserver_port=0
--tserver_master_addrs=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--builtin_ntp_servers=127.4.163.84:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260927 13:49:40.614403 5156 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:40.621376 5295 heartbeater.cc:344] Connected to a master server at 127.4.163.126:42985
I20260927 13:49:40.621778 5295 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:40.623757 5295 heartbeater.cc:507] Master 127.4.163.126:42985 requested a full tablet report, sending...
I20260927 13:49:40.625519 4788 ts_manager.cc:194] Registered new tserver with Master: 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:40.626571 4788 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.163.66:59407
I20260927 13:49:40.626930 5294 heartbeater.cc:344] Connected to a master server at 127.4.163.124:37095
I20260927 13:49:40.627066 5294 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:40.627282 5302 raft_consensus.cc:493] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13a42ae8b95b495c9bcea85d6732cd77)
I20260927 13:49:40.627592 5294 heartbeater.cc:507] Master 127.4.163.124:37095 requested a full tablet report, sending...
I20260927 13:49:40.627560 5302 raft_consensus.cc:515] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:40.628590 4798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "13a42ae8b95b495c9bcea85d6732cd77" is_pre_election: true
I20260927 13:49:40.628947 4940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "802b83f09d3445359cfac825cd87c9de" is_pre_election: true
I20260927 13:49:40.629029 5302 leader_election.cc:290] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:49:40.629711 4929 ts_manager.cc:194] Registered new tserver with Master: 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:40.630332 4846 leader_election.cc:304] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e421351a34d1463e9773dcebdeebae3c; no voters: 13a42ae8b95b495c9bcea85d6732cd77, 802b83f09d3445359cfac825cd87c9de
I20260927 13:49:40.630764 5302 raft_consensus.cc:2749] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:49:40.642688 5296 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:40.642865 5296 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:40.643225 5296 heartbeater.cc:507] Master 127.4.163.125:42239 requested a full tablet report, sending...
I20260927 13:49:40.644220 4859 ts_manager.cc:194] Registered new tserver with Master: 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:41.007416 5301 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 13:49:41.007754 5301 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 13:49:41.007899 5301 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260927 13:49:41.017112 5301 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260927 13:49:41.017338 5301 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.163.67
I20260927 13:49:41.027896 5301 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.163.84:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.163.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.163.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.163.67
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 27 Sep 2026 13:43:25 UTC on bdcb31816ec0
build id 14025
ASAN enabled
I20260927 13:49:41.029544 5301 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 13:49:41.031538 5301 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260927 13:49:41.041339 5307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:41.041488 5308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 13:49:41.042166 5310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:41.042631 5301 server_base.cc:1061] running on GCE node
I20260927 13:49:41.043254 5301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 13:49:41.044212 5301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 13:49:41.045444 5301 hybrid_clock.cc:648] HybridClock initialized: now 1790516981045409 us; error 35 us; skew 500 ppm
I20260927 13:49:41.045769 5301 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 13:49:41.048460 5301 webserver.cc:533] Webserver started at http://127.4.163.67:32943/ using document root <none> and password file <none>
I20260927 13:49:41.049225 5301 fs_manager.cc:362] Metadata directory not provided
I20260927 13:49:41.049358 5301 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 13:49:41.049721 5301 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 13:49:41.052332 5301 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/data/instance:
uuid: "bb28c54312c94d7dafb1c2abf7870735"
format_stamp: "Formatted at 2026-09-27 13:49:41 on dist-test-slave-bkfv"
I20260927 13:49:41.053110 5301 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/instance:
uuid: "bb28c54312c94d7dafb1c2abf7870735"
format_stamp: "Formatted at 2026-09-27 13:49:41 on dist-test-slave-bkfv"
I20260927 13:49:41.058681 5301 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260927 13:49:41.061978 5316 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:41.063484 5301 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260927 13:49:41.063683 5301 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/data,/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal
uuid: "bb28c54312c94d7dafb1c2abf7870735"
format_stamp: "Formatted at 2026-09-27 13:49:41 on dist-test-slave-bkfv"
I20260927 13:49:41.063905 5301 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 13:49:41.078751 5301 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260927 13:49:41.079605 5301 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 13:49:41.079885 5301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 13:49:41.080894 5301 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260927 13:49:41.082906 5301 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 13:49:41.083029 5301 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:41.083134 5301 ts_tablet_manager.cc:616] Registered 0 tablets
I20260927 13:49:41.083192 5301 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 13:49:41.092196 5334 raft_consensus.cc:493] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13a42ae8b95b495c9bcea85d6732cd77)
I20260927 13:49:41.092406 5334 raft_consensus.cc:515] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:41.094213 5334 leader_election.cc:290] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239)
I20260927 13:49:41.094274 4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c" is_pre_election: true
I20260927 13:49:41.094306 4798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "13a42ae8b95b495c9bcea85d6732cd77" is_pre_election: true
I20260927 13:49:41.095100 4914 leader_election.cc:304] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 802b83f09d3445359cfac825cd87c9de; no voters: 13a42ae8b95b495c9bcea85d6732cd77, e421351a34d1463e9773dcebdeebae3c
I20260927 13:49:41.095572 5334 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:49:41.125155 5301 rpc_server.cc:307] RPC server started. Bound to: 127.4.163.67:40291
I20260927 13:49:41.125175 5429 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.163.67:40291 every 8 connection(s)
I20260927 13:49:41.127254 5301 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/data/info.pb
I20260927 13:49:41.129653 5295 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:41.132928 4749 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu as pid 5301
I20260927 13:49:41.133169 4749 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/instance
I20260927 13:49:41.155385 5430 heartbeater.cc:344] Connected to a master server at 127.4.163.124:37095
I20260927 13:49:41.155577 5431 heartbeater.cc:344] Connected to a master server at 127.4.163.126:42985
I20260927 13:49:41.155821 5431 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:41.157017 5431 heartbeater.cc:507] Master 127.4.163.126:42985 requested a full tablet report, sending...
I20260927 13:49:41.157485 5432 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:41.157626 5432 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:41.155827 5430 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:41.158206 5432 heartbeater.cc:507] Master 127.4.163.125:42239 requested a full tablet report, sending...
I20260927 13:49:41.158601 5430 heartbeater.cc:507] Master 127.4.163.124:37095 requested a full tablet report, sending...
I20260927 13:49:41.158901 4788 ts_manager.cc:194] Registered new tserver with Master: bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:41.159435 4859 ts_manager.cc:194] Registered new tserver with Master: bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:41.159607 4929 ts_manager.cc:194] Registered new tserver with Master: bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:41.159976 4788 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.163.67:46097
I20260927 13:49:41.166059 4749 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260927 13:49:41.177907 5447 raft_consensus.cc:493] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13a42ae8b95b495c9bcea85d6732cd77)
I20260927 13:49:41.178205 5447 raft_consensus.cc:515] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:41.179514 5447 leader_election.cc:290] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:49:41.179605 4940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "802b83f09d3445359cfac825cd87c9de" is_pre_election: true
I20260927 13:49:41.179921 4798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "13a42ae8b95b495c9bcea85d6732cd77" is_pre_election: true
I20260927 13:49:41.180759 4843 leader_election.cc:304] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e421351a34d1463e9773dcebdeebae3c; no voters: 13a42ae8b95b495c9bcea85d6732cd77, 802b83f09d3445359cfac825cd87c9de
I20260927 13:49:41.183416 5447 raft_consensus.cc:2749] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:49:41.199030 4788 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_f7b90c29c22a44dd9abdf0d7961f6549"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:41.199096 4787 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_b0abba1f20f34a3d9e38831688dd7c11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:41.199662 4786 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_386329d6113f47dfb4c5b8a79d68694b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:41.199151 4784 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_776a7e4b828043dc8baea5804a7867ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:41.200215 4785 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_96389b8a0abd4922812b70b64d514779"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:41.201077 4788 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7b90c29c22a44dd9abdf0d7961f6549 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:41.201311 4786 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_386329d6113f47dfb4c5b8a79d68694b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:41.201385 4787 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0abba1f20f34a3d9e38831688dd7c11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:41.201643 4784 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_776a7e4b828043dc8baea5804a7867ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:41.201084 4785 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96389b8a0abd4922812b70b64d514779 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:41.207027 4783 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_cab4c1b461444ff783f0f004357bf6e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:41.207752 4783 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cab4c1b461444ff783f0f004357bf6e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:41.209964 4782 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_d80ebc07f2ec44a78af88fea49f4d417"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:41.210088 4781 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_b89bb2c082214ce08e677bc80dcafd48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:41.210757 4782 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d80ebc07f2ec44a78af88fea49f4d417 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:41.210927 4781 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b89bb2c082214ce08e677bc80dcafd48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:41.214565 4780 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_84797db80b3f4f079f839fac204e38ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:41.215277 4780 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84797db80b3f4f079f839fac204e38ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:41.223398 4779 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_7b645f63ae9f403f904da94ea2617bbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:41.224244 4779 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b645f63ae9f403f904da94ea2617bbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:41.245386 4788 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_b0abba1f20f34a3d9e38831688dd7c11" } new_table_name: "default.Table_188f52a4236d491fa1bdc23378d78804" modify_external_catalogs: true
I20260927 13:49:41.245464 4787 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_f7b90c29c22a44dd9abdf0d7961f6549" } new_table_name: "default.Table_866fc5204c264937917896ab9963a179" modify_external_catalogs: true
I20260927 13:49:41.280871 4786 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_776a7e4b828043dc8baea5804a7867ab" } new_table_name: "default.Table_802ebd45dc9a4d4ca86a39f613fecd0b" modify_external_catalogs: true
I20260927 13:49:41.281355 4780 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_d80ebc07f2ec44a78af88fea49f4d417" } modify_external_catalogs: true
I20260927 13:49:41.281522 4780 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_d80ebc07f2ec44a78af88fea49f4d417" } modify_external_catalogs: true
I20260927 13:49:41.283026 4782 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_cab4c1b461444ff783f0f004357bf6e0" } modify_external_catalogs: true
I20260927 13:49:41.283671 4785 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_96389b8a0abd4922812b70b64d514779" } new_table_name: "default.Table_4262de9abbe547828896f518f40f2788" modify_external_catalogs: true
I20260927 13:49:41.284826 4782 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_cab4c1b461444ff783f0f004357bf6e0" } modify_external_catalogs: true
I20260927 13:49:41.285162 4784 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_386329d6113f47dfb4c5b8a79d68694b" } new_table_name: "default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5" modify_external_catalogs: true
W20260927 13:49:41.309362 4788 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66421715f2f746299c22c8f538554bdb consensus state has no leader
W20260927 13:49:41.309368 4787 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ddb3e90a312247ac831287a3daab1eeb has no consensus state
W20260927 13:49:41.325515 4786 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8ebc0095d7414152a8abd08a65328974 has no consensus state
W20260927 13:49:41.326174 4785 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fbb2e0a01a9147d597693eab481ca73b has no consensus state
I20260927 13:49:41.325516 4780 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 05181352bf4445768bcd486c45bd8a5a
I20260927 13:49:41.339493 4782 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet c86e44d70d9444788d196556d0f762a2
W20260927 13:49:41.340014 4784 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e4c554f876d74be5b9667f373d832e50 has no consensus state
I20260927 13:49:41.343926 4780 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_b89bb2c082214ce08e677bc80dcafd48" } modify_external_catalogs: true
I20260927 13:49:41.344182 4780 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_b89bb2c082214ce08e677bc80dcafd48" } modify_external_catalogs: true
I20260927 13:49:41.344820 4786 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_7b645f63ae9f403f904da94ea2617bbb" } modify_external_catalogs: true
I20260927 13:49:41.344975 4786 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_7b645f63ae9f403f904da94ea2617bbb" } modify_external_catalogs: true
I20260927 13:49:41.345717 4785 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_84797db80b3f4f079f839fac204e38ac" } modify_external_catalogs: true
I20260927 13:49:41.345899 4785 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34738:
table { table_name: "default.Table_84797db80b3f4f079f839fac204e38ac" } modify_external_catalogs: true
I20260927 13:49:41.346534 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 66421715f2f746299c22c8f538554bdb (DEFAULT_TABLE table=default.Table_b0abba1f20f34a3d9e38831688dd7c11 [id=eefd9636d7c1431d8d0ea214090cf216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.348598 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66421715f2f746299c22c8f538554bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.353792 5364 tablet_service.cc:1511] Processing CreateTablet for tablet 7931267fae3a4a43abcbeeea42bb3ba2 (DEFAULT_TABLE table=default.Table_84797db80b3f4f079f839fac204e38ac [id=ca6cd336704b4d698e513e3e8b2b22f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.354454 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7931267fae3a4a43abcbeeea42bb3ba2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:41.363237 4774 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet ddb3e90a312247ac831287a3daab1eeb (table default.Table_866fc5204c264937917896ab9963a179 [id=39b622335f1a4f8ea3b2bd63589983f3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ddb3e90a312247ac831287a3daab1eeb consensus state has no leader
I20260927 13:49:41.368945 4780 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Sending DeleteTablet for 3 replicas of tablet edb7c912138748e1a9afefec44e53773
I20260927 13:49:41.369146 5362 tablet_service.cc:1511] Processing CreateTablet for tablet e4c554f876d74be5b9667f373d832e50 (DEFAULT_TABLE table=default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5 [id=59df0a1ee3ea43e8ac991b38717c1549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.369880 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c554f876d74be5b9667f373d832e50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.369882 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 006021014dee43dcb17571b390a0a57e (DEFAULT_TABLE table=default.Table_7b645f63ae9f403f904da94ea2617bbb [id=c2aaf76e59ef492db6cea3ffe1e6187e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.370740 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet edb7c912138748e1a9afefec44e53773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:50200
I20260927 13:49:41.371480 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006021014dee43dcb17571b390a0a57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.374537 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 006021014dee43dcb17571b390a0a57e (DEFAULT_TABLE table=default.Table_7b645f63ae9f403f904da94ea2617bbb [id=c2aaf76e59ef492db6cea3ffe1e6187e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.375118 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006021014dee43dcb17571b390a0a57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.377579 4786 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Sending DeleteTablet for 3 replicas of tablet 006021014dee43dcb17571b390a0a57e
I20260927 13:49:41.378405 5360 tablet_service.cc:1511] Processing CreateTablet for tablet fbb2e0a01a9147d597693eab481ca73b (DEFAULT_TABLE table=default.Table_4262de9abbe547828896f518f40f2788 [id=f6be2f3e0bb749108e056578f8d3cd75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.378458 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 66421715f2f746299c22c8f538554bdb (DEFAULT_TABLE table=default.Table_b0abba1f20f34a3d9e38831688dd7c11 [id=eefd9636d7c1431d8d0ea214090cf216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.378912 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66421715f2f746299c22c8f538554bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.379117 4785 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Sending DeleteTablet for 3 replicas of tablet 7931267fae3a4a43abcbeeea42bb3ba2
I20260927 13:49:41.379331 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb2e0a01a9147d597693eab481ca73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.380559 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 006021014dee43dcb17571b390a0a57e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:50200
I20260927 13:49:41.380860 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 7931267fae3a4a43abcbeeea42bb3ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:50200
I20260927 13:49:41.382323 5358 tablet_service.cc:1511] Processing CreateTablet for tablet edb7c912138748e1a9afefec44e53773 (DEFAULT_TABLE table=default.Table_b89bb2c082214ce08e677bc80dcafd48 [id=80368d0a7e884f519deb250d73d6adc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.382997 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb7c912138748e1a9afefec44e53773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.383870 5086 tablet_service.cc:1511] Processing CreateTablet for tablet e4c554f876d74be5b9667f373d832e50 (DEFAULT_TABLE table=default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5 [id=59df0a1ee3ea43e8ac991b38717c1549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.384377 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c554f876d74be5b9667f373d832e50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.384479 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 7931267fae3a4a43abcbeeea42bb3ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:55664
I20260927 13:49:41.386747 5084 tablet_service.cc:1511] Processing CreateTablet for tablet fbb2e0a01a9147d597693eab481ca73b (DEFAULT_TABLE table=default.Table_4262de9abbe547828896f518f40f2788 [id=f6be2f3e0bb749108e056578f8d3cd75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.387401 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb2e0a01a9147d597693eab481ca73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.369367 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 7931267fae3a4a43abcbeeea42bb3ba2 (DEFAULT_TABLE table=default.Table_84797db80b3f4f079f839fac204e38ac [id=ca6cd336704b4d698e513e3e8b2b22f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.388649 5085 tablet_service.cc:1558] Processing DeleteTablet for tablet edb7c912138748e1a9afefec44e53773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:55664
I20260927 13:49:41.388794 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7931267fae3a4a43abcbeeea42bb3ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.389230 5083 tablet_service.cc:1511] Processing CreateTablet for tablet edb7c912138748e1a9afefec44e53773 (DEFAULT_TABLE table=default.Table_b89bb2c082214ce08e677bc80dcafd48 [id=80368d0a7e884f519deb250d73d6adc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.389853 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb7c912138748e1a9afefec44e53773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.398995 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 006021014dee43dcb17571b390a0a57e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:55664
I20260927 13:49:41.400400 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 8ebc0095d7414152a8abd08a65328974 (DEFAULT_TABLE table=default.Table_802ebd45dc9a4d4ca86a39f613fecd0b [id=e2a8faa73bff4c7f90c3d05382e09b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.400974 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ebc0095d7414152a8abd08a65328974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.403200 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 8ebc0095d7414152a8abd08a65328974 (DEFAULT_TABLE table=default.Table_802ebd45dc9a4d4ca86a39f613fecd0b [id=e2a8faa73bff4c7f90c3d05382e09b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.403178 5359 tablet_service.cc:1511] Processing CreateTablet for tablet ddb3e90a312247ac831287a3daab1eeb (DEFAULT_TABLE table=default.Table_866fc5204c264937917896ab9963a179 [id=39b622335f1a4f8ea3b2bd63589983f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.403791 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ebc0095d7414152a8abd08a65328974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.403945 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddb3e90a312247ac831287a3daab1eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.402130 5082 tablet_service.cc:1511] Processing CreateTablet for tablet ddb3e90a312247ac831287a3daab1eeb (DEFAULT_TABLE table=default.Table_866fc5204c264937917896ab9963a179 [id=39b622335f1a4f8ea3b2bd63589983f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.409935 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddb3e90a312247ac831287a3daab1eeb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:41.420593 4774 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7931267fae3a4a43abcbeeea42bb3ba2 because the tablet was not found. No further retry: Not found: Tablet not found: 7931267fae3a4a43abcbeeea42bb3ba2
W20260927 13:49:41.423091 4774 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet edb7c912138748e1a9afefec44e53773 because the tablet was not found. No further retry: Not found: Tablet not found: edb7c912138748e1a9afefec44e53773
I20260927 13:49:41.424657 4785 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_2e233e2bbfdb438c92c5b398118a445d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:41.425429 4785 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e233e2bbfdb438c92c5b398118a445d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:41.428768 4774 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 006021014dee43dcb17571b390a0a57e because the tablet was not found. No further retry: Not found: Tablet not found: 006021014dee43dcb17571b390a0a57e
I20260927 13:49:41.438481 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 006021014dee43dcb17571b390a0a57e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:39404
I20260927 13:49:41.442184 5225 tablet_service.cc:1558] Processing DeleteTablet for tablet edb7c912138748e1a9afefec44e53773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:39404
I20260927 13:49:41.442421 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 7931267fae3a4a43abcbeeea42bb3ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:39404
I20260927 13:49:41.442834 5226 tablet_service.cc:1511] Processing CreateTablet for tablet e4c554f876d74be5b9667f373d832e50 (DEFAULT_TABLE table=default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5 [id=59df0a1ee3ea43e8ac991b38717c1549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.444221 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c554f876d74be5b9667f373d832e50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.446376 5220 tablet_service.cc:1511] Processing CreateTablet for tablet ddb3e90a312247ac831287a3daab1eeb (DEFAULT_TABLE table=default.Table_866fc5204c264937917896ab9963a179 [id=39b622335f1a4f8ea3b2bd63589983f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.446841 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddb3e90a312247ac831287a3daab1eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.450419 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 006021014dee43dcb17571b390a0a57e (DEFAULT_TABLE table=default.Table_7b645f63ae9f403f904da94ea2617bbb [id=c2aaf76e59ef492db6cea3ffe1e6187e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.450907 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006021014dee43dcb17571b390a0a57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.454233 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 66421715f2f746299c22c8f538554bdb (DEFAULT_TABLE table=default.Table_b0abba1f20f34a3d9e38831688dd7c11 [id=eefd9636d7c1431d8d0ea214090cf216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.454700 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66421715f2f746299c22c8f538554bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.456198 5498 tablet_bootstrap.cc:492] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:41.458299 5219 tablet_service.cc:1511] Processing CreateTablet for tablet 8ebc0095d7414152a8abd08a65328974 (DEFAULT_TABLE table=default.Table_802ebd45dc9a4d4ca86a39f613fecd0b [id=e2a8faa73bff4c7f90c3d05382e09b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.458750 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ebc0095d7414152a8abd08a65328974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.462306 4749 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu pid 4757
I20260927 13:49:41.463804 4818 generic_service.cc:196] Checking for leaks (request via RPC)
I20260927 13:49:41.464895 5228 tablet_service.cc:1511] Processing CreateTablet for tablet 7931267fae3a4a43abcbeeea42bb3ba2 (DEFAULT_TABLE table=default.Table_84797db80b3f4f079f839fac204e38ac [id=ca6cd336704b4d698e513e3e8b2b22f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.465443 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7931267fae3a4a43abcbeeea42bb3ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.466194 5221 tablet_service.cc:1511] Processing CreateTablet for tablet edb7c912138748e1a9afefec44e53773 (DEFAULT_TABLE table=default.Table_b89bb2c082214ce08e677bc80dcafd48 [id=80368d0a7e884f519deb250d73d6adc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.466766 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb7c912138748e1a9afefec44e53773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.441824 5224 tablet_service.cc:1511] Processing CreateTablet for tablet fbb2e0a01a9147d597693eab481ca73b (DEFAULT_TABLE table=default.Table_4262de9abbe547828896f518f40f2788 [id=f6be2f3e0bb749108e056578f8d3cd75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:41.474604 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb2e0a01a9147d597693eab481ca73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:41.480363 4786 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34738:
name: "default.Table_ac3ac350d3e845c7927b01fbbd301935"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:41.481945 5498 tablet_bootstrap.cc:654] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.484117 5498 log.cc:826] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735: Log is configured to *not* fsync() on all Append() calls
W20260927 13:49:41.486539 4775 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet edb7c912138748e1a9afefec44e53773 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edb7c912138748e1a9afefec44e53773 already in progress: creating tablet
I20260927 13:49:41.494814 5508 tablet_bootstrap.cc:492] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:41.501272 5508 tablet_bootstrap.cc:654] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.507933 5508 log.cc:826] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: Log is configured to *not* fsync() on all Append() calls
I20260927 13:49:41.518913 5505 tablet_bootstrap.cc:492] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:41.519151 5508 tablet_bootstrap.cc:492] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:41.519649 5508 ts_tablet_manager.cc:1403] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.010s
I20260927 13:49:41.523536 5505 tablet_bootstrap.cc:654] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.528087 5505 log.cc:826] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409: Log is configured to *not* fsync() on all Append() calls
I20260927 13:49:41.529524 5498 tablet_bootstrap.cc:492] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:41.529863 5498 ts_tablet_manager.cc:1403] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.075s user 0.021s sys 0.028s
I20260927 13:49:41.531977 5508 raft_consensus.cc:359] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.532637 5508 raft_consensus.cc:385] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.532809 5508 raft_consensus.cc:740] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.533749 5508 consensus_queue.cc:260] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.537242 5505 tablet_bootstrap.cc:492] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:41.537564 5505 ts_tablet_manager.cc:1403] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.007s
I20260927 13:49:41.540910 5498 raft_consensus.cc:359] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.541450 5498 raft_consensus.cc:385] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.541584 5498 raft_consensus.cc:740] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.542618 5498 consensus_queue.cc:260] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.545142 5505 raft_consensus.cc:359] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.545578 5505 raft_consensus.cc:385] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.545686 5505 raft_consensus.cc:740] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.546514 5505 consensus_queue.cc:260] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.546998 5508 ts_tablet_manager.cc:1434] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.027s user 0.019s sys 0.000s
I20260927 13:49:41.550956 5498 ts_tablet_manager.cc:1434] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.021s user 0.012s sys 0.008s
I20260927 13:49:41.554608 5505 ts_tablet_manager.cc:1434] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.017s user 0.011s sys 0.007s
I20260927 13:49:41.556154 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:41.556354 5498 tablet_bootstrap.cc:492] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:41.557312 5508 tablet_bootstrap.cc:492] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:41.558436 5498 tablet_bootstrap.cc:654] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.559983 5508 tablet_bootstrap.cc:654] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.560242 5505 tablet_bootstrap.cc:492] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:41.562486 5505 tablet_bootstrap.cc:654] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.564882 5498 tablet_bootstrap.cc:492] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:41.565874 5498 ts_tablet_manager.cc:1403] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.001s
I20260927 13:49:41.567322 5498 raft_consensus.cc:359] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.567579 5498 raft_consensus.cc:385] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.567672 5498 raft_consensus.cc:740] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.568219 5505 tablet_bootstrap.cc:492] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:41.568123 5498 consensus_queue.cc:260] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.568377 5505 ts_tablet_manager.cc:1403] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.001s
I20260927 13:49:41.569288 5505 raft_consensus.cc:359] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.569463 5505 raft_consensus.cc:385] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.569545 5505 raft_consensus.cc:740] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.569831 5505 consensus_queue.cc:260] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.570403 5508 tablet_bootstrap.cc:492] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:41.570617 5508 ts_tablet_manager.cc:1403] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20260927 13:49:41.571673 5508 raft_consensus.cc:359] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.571954 5508 raft_consensus.cc:385] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.572101 5508 raft_consensus.cc:740] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.572291 5498 ts_tablet_manager.cc:1434] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260927 13:49:41.572630 5498 tablet_bootstrap.cc:492] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:41.572554 5508 consensus_queue.cc:260] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.575564 5498 tablet_bootstrap.cc:654] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.576388 5505 ts_tablet_manager.cc:1434] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 13:49:41.578640 5505 tablet_bootstrap.cc:492] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:41.579638 5508 ts_tablet_manager.cc:1434] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260927 13:49:41.580719 5505 tablet_bootstrap.cc:654] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.583983 5508 tablet_bootstrap.cc:492] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:49:41.584972 5158 tablet.cc:2433] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 13:49:41.591248 5505 tablet_bootstrap.cc:492] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:41.591429 5505 ts_tablet_manager.cc:1403] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.008s
I20260927 13:49:41.592123 5505 raft_consensus.cc:359] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.592334 5505 raft_consensus.cc:385] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.592411 5505 raft_consensus.cc:740] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.592690 5505 consensus_queue.cc:260] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.596921 5505 ts_tablet_manager.cc:1434] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:41.598027 5508 tablet_bootstrap.cc:654] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.600319 5505 tablet_bootstrap.cc:492] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:41.602377 5505 tablet_bootstrap.cc:654] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.607056 5508 tablet_bootstrap.cc:492] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:41.607235 5508 ts_tablet_manager.cc:1403] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
W20260927 13:49:41.608368 5299 tablet.cc:2433] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 13:49:41.607995 5508 raft_consensus.cc:359] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.609210 5508 raft_consensus.cc:385] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.609309 5508 raft_consensus.cc:740] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.609603 5508 consensus_queue.cc:260] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.614029 5508 ts_tablet_manager.cc:1434] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260927 13:49:41.616387 5505 tablet_bootstrap.cc:492] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:41.616542 5505 ts_tablet_manager.cc:1403] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.011s
I20260927 13:49:41.616675 5508 tablet_bootstrap.cc:492] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:41.617288 5505 raft_consensus.cc:359] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.617453 5505 raft_consensus.cc:385] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.617532 5505 raft_consensus.cc:740] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.617786 5505 consensus_queue.cc:260] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.618456 5508 tablet_bootstrap.cc:654] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.620774 5505 ts_tablet_manager.cc:1434] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:49:41.622643 5505 tablet_bootstrap.cc:492] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:41.623229 5498 tablet_bootstrap.cc:492] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:41.623507 5498 ts_tablet_manager.cc:1403] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.051s user 0.023s sys 0.008s
I20260927 13:49:41.624224 5505 tablet_bootstrap.cc:654] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.624501 5498 raft_consensus.cc:359] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.624794 5498 raft_consensus.cc:385] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.624944 5498 raft_consensus.cc:740] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.625339 5498 consensus_queue.cc:260] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.627311 5498 ts_tablet_manager.cc:1434] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:49:41.627700 5498 tablet_bootstrap.cc:492] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:41.631403 5498 tablet_bootstrap.cc:654] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.634812 5508 tablet_bootstrap.cc:492] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:41.634989 5508 ts_tablet_manager.cc:1403] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.003s
I20260927 13:49:41.635840 5508 raft_consensus.cc:359] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.636040 5508 raft_consensus.cc:385] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.636138 5508 raft_consensus.cc:740] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.636430 5508 consensus_queue.cc:260] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.640019 5508 ts_tablet_manager.cc:1434] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260927 13:49:41.640219 5505 tablet_bootstrap.cc:492] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:41.640413 5505 ts_tablet_manager.cc:1403] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.007s
I20260927 13:49:41.641113 5505 raft_consensus.cc:359] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.641327 5505 raft_consensus.cc:385] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.641404 5505 raft_consensus.cc:740] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.641683 5505 consensus_queue.cc:260] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.644754 5508 tablet_bootstrap.cc:492] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:41.645658 5505 ts_tablet_manager.cc:1434] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:41.647167 5508 tablet_bootstrap.cc:654] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.648277 5505 tablet_bootstrap.cc:492] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:49:41.649823 5437 tablet.cc:2433] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 13:49:41.649966 5505 tablet_bootstrap.cc:654] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.655493 5498 tablet_bootstrap.cc:492] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:41.655721 5498 ts_tablet_manager.cc:1403] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.006s
I20260927 13:49:41.656730 5498 raft_consensus.cc:359] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.657101 5498 raft_consensus.cc:385] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.657294 5498 raft_consensus.cc:740] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.657763 5498 consensus_queue.cc:260] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.661984 5498 ts_tablet_manager.cc:1434] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 13:49:41.663465 5508 tablet_bootstrap.cc:492] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:41.664928 5505 tablet_bootstrap.cc:492] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:41.665074 5505 ts_tablet_manager.cc:1403] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.006s
I20260927 13:49:41.665330 5498 tablet_bootstrap.cc:492] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:41.665781 5505 raft_consensus.cc:359] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.665959 5505 raft_consensus.cc:385] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.666038 5505 raft_consensus.cc:740] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.666317 5505 consensus_queue.cc:260] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.667299 5498 tablet_bootstrap.cc:654] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.668246 5508 ts_tablet_manager.cc:1403] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.000s
I20260927 13:49:41.669350 5505 ts_tablet_manager.cc:1434] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:41.669251 5508 raft_consensus.cc:359] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.669515 5508 raft_consensus.cc:385] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.669624 5508 raft_consensus.cc:740] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.669930 5508 consensus_queue.cc:260] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.670501 5508 ts_tablet_manager.cc:1434] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:41.671491 5505 tablet_bootstrap.cc:492] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:41.673167 5505 tablet_bootstrap.cc:654] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.680401 5498 tablet_bootstrap.cc:492] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:41.680593 5498 ts_tablet_manager.cc:1403] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.012s
I20260927 13:49:41.681020 5505 tablet_bootstrap.cc:492] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:41.681173 5505 ts_tablet_manager.cc:1403] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260927 13:49:41.681385 5498 raft_consensus.cc:359] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.681563 5498 raft_consensus.cc:385] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.681629 5498 raft_consensus.cc:740] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.681941 5505 raft_consensus.cc:359] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.681952 5498 consensus_queue.cc:260] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.682158 5505 raft_consensus.cc:385] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.682243 5505 raft_consensus.cc:740] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.682520 5505 consensus_queue.cc:260] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.684537 5508 tablet_bootstrap.cc:492] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:41.685850 5498 ts_tablet_manager.cc:1434] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:49:41.686831 5508 tablet_bootstrap.cc:654] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.687130 5505 ts_tablet_manager.cc:1434] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260927 13:49:41.687934 5512 raft_consensus.cc:493] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:41.688165 5512 raft_consensus.cc:515] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.689903 5505 tablet_bootstrap.cc:492] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:41.690137 5512 leader_election.cc:290] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:41.691763 5505 tablet_bootstrap.cc:654] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.700274 5498 tablet_bootstrap.cc:492] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:41.702440 5498 tablet_bootstrap.cc:654] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.707850 5513 raft_consensus.cc:493] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:41.708137 5513 raft_consensus.cc:515] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.710832 5513 leader_election.cc:290] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:41.715956 5508 tablet_bootstrap.cc:492] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:41.716184 5508 ts_tablet_manager.cc:1403] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.033s user 0.016s sys 0.015s
I20260927 13:49:41.717080 5508 raft_consensus.cc:359] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.717379 5508 raft_consensus.cc:385] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.717515 5508 raft_consensus.cc:740] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.717794 5508 consensus_queue.cc:260] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.721517 5508 ts_tablet_manager.cc:1434] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:41.723690 5508 tablet_bootstrap.cc:492] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:41.725591 5508 tablet_bootstrap.cc:654] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.733670 5508 tablet_bootstrap.cc:492] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:41.733912 5508 ts_tablet_manager.cc:1403] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.001s
I20260927 13:49:41.734833 5508 raft_consensus.cc:359] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.735168 5508 raft_consensus.cc:385] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.735286 5508 raft_consensus.cc:740] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.735612 5508 consensus_queue.cc:260] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.738610 5508 ts_tablet_manager.cc:1434] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260927 13:49:41.739593 4775 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 006021014dee43dcb17571b390a0a57e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 006021014dee43dcb17571b390a0a57e already in progress: creating tablet
I20260927 13:49:41.740278 5505 tablet_bootstrap.cc:492] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
W20260927 13:49:41.739800 4775 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 252295us
I20260927 13:49:41.741700 5508 tablet_bootstrap.cc:492] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:49:41.741698 4786 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac3ac350d3e845c7927b01fbbd301935 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:41.742000 5505 ts_tablet_manager.cc:1403] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.011s
I20260927 13:49:41.742869 5505 raft_consensus.cc:359] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.743042 5505 raft_consensus.cc:385] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.743124 5505 raft_consensus.cc:740] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.743124 4749 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu with pid 4757
I20260927 13:49:41.743744 5505 consensus_queue.cc:260] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.744884 5512 raft_consensus.cc:493] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:41.745013 5505 ts_tablet_manager.cc:1434] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:41.745081 5512 raft_consensus.cc:515] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.745494 5508 tablet_bootstrap.cc:654] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.745800 5512 leader_election.cc:290] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:41.746061 5511 raft_consensus.cc:493] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:41.746306 5511 raft_consensus.cc:515] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.746804 5498 tablet_bootstrap.cc:492] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:41.746943 5498 ts_tablet_manager.cc:1403] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.000s
I20260927 13:49:41.747795 5498 raft_consensus.cc:359] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.748005 5498 raft_consensus.cc:385] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.748092 5498 raft_consensus.cc:740] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.748311 5498 consensus_queue.cc:260] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.748554 5511 leader_election.cc:290] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:41.748795 5498 ts_tablet_manager.cc:1434] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:41.749145 5498 tablet_bootstrap.cc:492] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:41.752364 5498 tablet_bootstrap.cc:654] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:41.772976 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb2e0a01a9147d597693eab481ca73b" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:41.773962 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c554f876d74be5b9667f373d832e50" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:41.774503 5249 raft_consensus.cc:2468] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:49:41.775522 5319 leader_election.cc:343] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:41.776063 5319 leader_election.cc:304] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:41.776680 5512 raft_consensus.cc:2804] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:41.776844 5512 raft_consensus.cc:493] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:41.776981 5512 raft_consensus.cc:3060] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.781347 5512 raft_consensus.cc:515] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.782593 5512 leader_election.cc:290] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:41.783623 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c554f876d74be5b9667f373d832e50" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:41.783891 5248 raft_consensus.cc:3060] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.788728 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7c912138748e1a9afefec44e53773" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:41.788988 5249 raft_consensus.cc:2468] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:41.789390 5248 raft_consensus.cc:2468] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:41.789665 5044 leader_election.cc:304] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:41.790267 5513 raft_consensus.cc:2804] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:41.790441 5513 raft_consensus.cc:493] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:41.790550 5513 raft_consensus.cc:3060] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.790560 5319 leader_election.cc:304] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:41.790982 5512 raft_consensus.cc:2804] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:41.793356 5508 tablet_bootstrap.cc:492] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:41.793545 5508 ts_tablet_manager.cc:1403] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.052s user 0.008s sys 0.018s
I20260927 13:49:41.793545 5513 raft_consensus.cc:515] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.794732 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb2e0a01a9147d597693eab481ca73b" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:41.794693 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7c912138748e1a9afefec44e53773" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:41.794771 5508 raft_consensus.cc:359] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.795014 5508 raft_consensus.cc:385] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.795096 5385 raft_consensus.cc:2468] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:41.795090 5107 raft_consensus.cc:2468] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:41.795122 5508 raft_consensus.cc:740] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.795392 5508 consensus_queue.cc:260] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.795567 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb3e90a312247ac831287a3daab1eeb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:41.795892 5109 raft_consensus.cc:2468] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:41.796120 5319 leader_election.cc:304] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:41.796206 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c554f876d74be5b9667f373d832e50" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:41.796440 5108 raft_consensus.cc:2468] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:41.795591 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c554f876d74be5b9667f373d832e50" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:41.796856 5107 raft_consensus.cc:3060] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.798684 5512 raft_consensus.cc:697] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:41.799393 5512 consensus_queue.cc:237] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.799906 5508 ts_tablet_manager.cc:1434] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260927 13:49:41.800002 5107 raft_consensus.cc:2468] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:41.800437 5513 leader_election.cc:290] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:41.801041 5184 leader_election.cc:304] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:41.803277 5542 raft_consensus.cc:2804] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:41.803438 5542 raft_consensus.cc:493] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:41.803609 5542 raft_consensus.cc:3060] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.803959 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7c912138748e1a9afefec44e53773" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:41.804230 5385 raft_consensus.cc:3060] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.808406 5385 raft_consensus.cc:2468] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:41.808617 5511 raft_consensus.cc:2804] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:41.808797 5511 raft_consensus.cc:493] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:41.808913 5511 raft_consensus.cc:3060] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.811977 5542 raft_consensus.cc:515] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.812789 5542 leader_election.cc:290] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:41.812888 5511 raft_consensus.cc:515] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.814361 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb3e90a312247ac831287a3daab1eeb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:41.814653 5107 raft_consensus.cc:3060] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.815102 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7c912138748e1a9afefec44e53773" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:41.815268 5511 leader_election.cc:290] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:41.815301 5248 raft_consensus.cc:3060] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.815869 5045 leader_election.cc:304] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:41.816212 5513 raft_consensus.cc:2804] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:41.818352 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb2e0a01a9147d597693eab481ca73b" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:41.818572 5249 raft_consensus.cc:3060] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.818832 5248 raft_consensus.cc:2468] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:41.822685 5249 raft_consensus.cc:2468] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:41.823336 5498 tablet_bootstrap.cc:492] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:41.823546 5498 ts_tablet_manager.cc:1403] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.074s user 0.025s sys 0.026s
I20260927 13:49:41.824368 5498 raft_consensus.cc:359] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.824568 5498 raft_consensus.cc:385] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.824643 5498 raft_consensus.cc:740] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.826642 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb3e90a312247ac831287a3daab1eeb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:41.826758 5498 consensus_queue.cc:260] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.827028 5385 raft_consensus.cc:2468] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:41.827116 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb2e0a01a9147d597693eab481ca73b" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:41.827344 5108 raft_consensus.cc:3060] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.828680 5498 ts_tablet_manager.cc:1434] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:41.828994 5498 tablet_bootstrap.cc:492] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:41.830195 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb3e90a312247ac831287a3daab1eeb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:41.830477 5384 raft_consensus.cc:3060] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.830847 5498 tablet_bootstrap.cc:654] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:41.831306 5045 connection.cc:573] server connection from 127.0.0.1:55664 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:49:41.831408 5317 connection.cc:573] server connection from 127.0.0.1:50200 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:49:41.831846 5185 connection.cc:573] server connection from 127.0.0.1:39404 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:49:41.832271 5182 connection.cc:573] client connection to 127.4.163.126:42985 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 13:49:41.832553 5512 raft_consensus.cc:493] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:49:41.832799 5295 heartbeater.cc:646] Failed to heartbeat to 127.4.163.126:42985 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 13:49:41.832727 5512 raft_consensus.cc:515] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.833442 5512 leader_election.cc:290] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:41.834278 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7931267fae3a4a43abcbeeea42bb3ba2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:41.834236 5440 connection.cc:573] client connection to 127.4.163.126:42985 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 13:49:41.834336 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7931267fae3a4a43abcbeeea42bb3ba2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:41.834514 5109 raft_consensus.cc:2468] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:41.834606 5248 raft_consensus.cc:2468] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:49:41.834918 5156 heartbeater.cc:646] Failed to heartbeat to 127.4.163.126:42985 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.4.163.126:42985 (error 108)
I20260927 13:49:41.835121 5319 leader_election.cc:304] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:49:41.835206 5440 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.4.163.126:42985)
I20260927 13:49:41.835434 5512 raft_consensus.cc:2804] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260927 13:49:41.835548 5440 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.4.163.126:42985)
I20260927 13:49:41.835548 5512 raft_consensus.cc:493] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:41.835638 5512 raft_consensus.cc:3060] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:41.835834 5440 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.4.163.126:42985)
I20260927 13:49:41.836030 5513 raft_consensus.cc:697] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
W20260927 13:49:41.836203 5440 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.4.163.126:42985)
I20260927 13:49:41.836611 5513 consensus_queue.cc:237] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:41.838337 5431 heartbeater.cc:646] Failed to heartbeat to 127.4.163.126:42985 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.4.163.126:42985 (error 108)
W20260927 13:49:41.838385 5538 negotiation.cc:336] Failed RPC negotiation. Trace:
0927 13:49:41.833355 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.4.163.126:42985 (local address 127.4.163.66:53543)
0927 13:49:41.833618 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0927 13:49:41.833639 (+ 21us) client_negotiation.cc:175] Beginning negotiation
0927 13:49:41.833755 (+ 116us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0927 13:49:41.837468 (+ 3713us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":148}
I20260927 13:49:41.838742 5512 raft_consensus.cc:515] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:41.840022 5533 negotiation.cc:336] Failed RPC negotiation. Trace:
0927 13:49:41.835493 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.4.163.126:42985 (local address 127.4.163.65:40983)
0927 13:49:41.835763 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0927 13:49:41.835785 (+ 22us) client_negotiation.cc:175] Beginning negotiation
0927 13:49:41.835907 (+ 122us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0927 13:49:41.839029 (+ 3122us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":146}
I20260927 13:49:41.841557 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7931267fae3a4a43abcbeeea42bb3ba2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:41.841777 5109 raft_consensus.cc:3060] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.843266 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7931267fae3a4a43abcbeeea42bb3ba2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:41.843560 5248 raft_consensus.cc:3060] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.845319 5108 raft_consensus.cc:2468] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:41.845878 5109 raft_consensus.cc:2468] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:41.845878 5319 leader_election.cc:304] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:41.846410 5319 leader_election.cc:304] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:41.846776 5541 raft_consensus.cc:2804] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:41.846895 5248 raft_consensus.cc:2468] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:41.847251 5384 raft_consensus.cc:2468] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:41.847601 5542 raft_consensus.cc:2804] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:41.848039 5185 leader_election.cc:304] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:41.848358 5511 raft_consensus.cc:2804] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:41.848951 5107 raft_consensus.cc:2468] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:41.847297 5512 leader_election.cc:290] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:41.852980 5541 raft_consensus.cc:697] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:41.853418 5541 consensus_queue.cc:237] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.862078 5498 tablet_bootstrap.cc:492] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:41.862268 5498 ts_tablet_manager.cc:1403] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.033s user 0.008s sys 0.009s
I20260927 13:49:41.863112 5498 raft_consensus.cc:359] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.863299 5498 raft_consensus.cc:385] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:41.863418 5498 raft_consensus.cc:740] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:41.863667 5498 consensus_queue.cc:260] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.864208 5498 ts_tablet_manager.cc:1434] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:41.867806 5511 raft_consensus.cc:697] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:41.868697 5511 consensus_queue.cc:237] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.870452 5542 raft_consensus.cc:697] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:41.870728 5542 consensus_queue.cc:237] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.945814 5554 raft_consensus.cc:493] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13a42ae8b95b495c9bcea85d6732cd77)
I20260927 13:49:41.946010 5554 raft_consensus.cc:515] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:41.946161 5555 raft_consensus.cc:493] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13a42ae8b95b495c9bcea85d6732cd77)
I20260927 13:49:41.946352 5555 raft_consensus.cc:515] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:41.946971 5554 leader_election.cc:290] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239)
I20260927 13:49:41.947208 5555 leader_election.cc:290] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:49:41.947738 4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c" is_pre_election: true
I20260927 13:49:41.947980 4868 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 802b83f09d3445359cfac825cd87c9de in term 1.
I20260927 13:49:41.947994 4940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "802b83f09d3445359cfac825cd87c9de" is_pre_election: true
I20260927 13:49:41.948199 4940 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e421351a34d1463e9773dcebdeebae3c in term 1.
I20260927 13:49:41.948449 4915 leader_election.cc:304] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 802b83f09d3445359cfac825cd87c9de, e421351a34d1463e9773dcebdeebae3c; no voters:
W20260927 13:49:41.948549 4914 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: connect: Connection refused (error 111)
I20260927 13:49:41.948789 5554 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260927 13:49:41.949046 5554 raft_consensus.cc:493] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 13a42ae8b95b495c9bcea85d6732cd77)
I20260927 13:49:41.949527 5554 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 1 FOLLOWER]: Advancing to term 2
W20260927 13:49:41.949728 4843 leader_election.cc:336] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985): Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: connect: Connection refused (error 111)
I20260927 13:49:41.949929 4846 leader_election.cc:304] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 802b83f09d3445359cfac825cd87c9de, e421351a34d1463e9773dcebdeebae3c; no voters: 13a42ae8b95b495c9bcea85d6732cd77
I20260927 13:49:41.950225 5555 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260927 13:49:41.950338 5555 raft_consensus.cc:493] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 13a42ae8b95b495c9bcea85d6732cd77)
I20260927 13:49:41.950446 5555 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 1 FOLLOWER]: Advancing to term 2
W20260927 13:49:41.950764 4914 leader_election.cc:336] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985): Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: connect: Connection refused (error 111)
I20260927 13:49:41.952795 5554 raft_consensus.cc:515] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:41.953336 5555 raft_consensus.cc:515] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:41.953467 5554 leader_election.cc:290] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 2 election: Requested vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239)
I20260927 13:49:41.953989 4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c"
I20260927 13:49:41.954279 4868 raft_consensus.cc:2393] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 802b83f09d3445359cfac825cd87c9de in current term 2: Already voted for candidate e421351a34d1463e9773dcebdeebae3c in this term.
W20260927 13:49:41.955065 4914 leader_election.cc:336] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985): Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: connect: Connection refused (error 111)
I20260927 13:49:41.955219 4914 leader_election.cc:304] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 802b83f09d3445359cfac825cd87c9de; no voters: 13a42ae8b95b495c9bcea85d6732cd77, e421351a34d1463e9773dcebdeebae3c
I20260927 13:49:41.955248 5555 leader_election.cc:290] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 election: Requested vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:49:41.956133 4940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "802b83f09d3445359cfac825cd87c9de"
I20260927 13:49:41.956202 5554 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260927 13:49:41.956473 4940 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e421351a34d1463e9773dcebdeebae3c in current term 2: Already voted for candidate 802b83f09d3445359cfac825cd87c9de in this term.
W20260927 13:49:41.956816 4843 leader_election.cc:336] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985): Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: connect: Connection refused (error 111)
I20260927 13:49:41.957028 4846 leader_election.cc:304] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e421351a34d1463e9773dcebdeebae3c; no voters: 13a42ae8b95b495c9bcea85d6732cd77, 802b83f09d3445359cfac825cd87c9de
I20260927 13:49:41.957293 5555 raft_consensus.cc:2749] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260927 13:49:41.984215 5511 raft_consensus.cc:493] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:41.984417 5511 raft_consensus.cc:515] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.985088 5511 leader_election.cc:290] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:41.985569 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66421715f2f746299c22c8f538554bdb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:41.985594 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66421715f2f746299c22c8f538554bdb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:41.985787 5107 raft_consensus.cc:2468] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:41.985821 5384 raft_consensus.cc:2468] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:41.986311 5185 leader_election.cc:304] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:41.986634 5511 raft_consensus.cc:2804] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:41.986724 5511 raft_consensus.cc:493] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:41.986863 5511 raft_consensus.cc:3060] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.988796 5511 raft_consensus.cc:515] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:41.989341 5511 leader_election.cc:290] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:41.989773 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66421715f2f746299c22c8f538554bdb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:41.989835 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66421715f2f746299c22c8f538554bdb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:41.989974 5384 raft_consensus.cc:3060] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.990042 5107 raft_consensus.cc:3060] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:41.991904 5384 raft_consensus.cc:2468] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:41.992045 5107 raft_consensus.cc:2468] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:41.992372 5185 leader_election.cc:304] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:41.992624 5511 raft_consensus.cc:2804] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:41.992810 5511 raft_consensus.cc:697] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:41.993382 5511 consensus_queue.cc:237] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:42.021955 5513 raft_consensus.cc:493] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:42.022188 5513 raft_consensus.cc:515] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:42.022818 5513 leader_election.cc:290] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:42.023365 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ebc0095d7414152a8abd08a65328974" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:42.023382 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ebc0095d7414152a8abd08a65328974" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:42.023582 5384 raft_consensus.cc:2468] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:42.023605 5249 raft_consensus.cc:2468] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:42.024029 5044 leader_election.cc:304] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:42.024345 5513 raft_consensus.cc:2804] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:42.024456 5513 raft_consensus.cc:493] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:42.024561 5513 raft_consensus.cc:3060] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:42.026615 5513 raft_consensus.cc:515] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:42.027154 5513 leader_election.cc:290] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:42.027619 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ebc0095d7414152a8abd08a65328974" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:42.027801 5384 raft_consensus.cc:3060] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:42.027750 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ebc0095d7414152a8abd08a65328974" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:42.027969 5249 raft_consensus.cc:3060] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:42.029750 5384 raft_consensus.cc:2468] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:42.029917 5249 raft_consensus.cc:2468] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:42.030224 5045 leader_election.cc:304] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:42.030565 5513 raft_consensus.cc:2804] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:42.030730 5513 raft_consensus.cc:697] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:42.031049 5513 consensus_queue.cc:237] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:42.206826 5511 raft_consensus.cc:493] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:42.207052 5511 raft_consensus.cc:515] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:42.207724 5511 leader_election.cc:290] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:42.208285 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006021014dee43dcb17571b390a0a57e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:42.208325 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006021014dee43dcb17571b390a0a57e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:42.208531 5384 raft_consensus.cc:2468] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:42.208690 5107 raft_consensus.cc:2468] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:42.209096 5185 leader_election.cc:304] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:42.209368 5511 raft_consensus.cc:2804] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:42.209497 5511 raft_consensus.cc:493] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:42.209573 5511 raft_consensus.cc:3060] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:42.211467 5511 raft_consensus.cc:515] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:42.211970 5511 leader_election.cc:290] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:42.212458 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006021014dee43dcb17571b390a0a57e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:42.212460 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006021014dee43dcb17571b390a0a57e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:42.212657 5384 raft_consensus.cc:3060] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:42.212680 5107 raft_consensus.cc:3060] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:42.214592 5384 raft_consensus.cc:2468] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:42.214895 5107 raft_consensus.cc:2468] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:42.215000 5185 leader_election.cc:304] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:42.215370 5511 raft_consensus.cc:2804] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:42.215579 5511 raft_consensus.cc:697] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:42.216063 5511 consensus_queue.cc:237] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:42.517182 4749 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
/tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.126:42985
--webserver_interface=127.4.163.126
--webserver_port=34313
--builtin_ntp_servers=127.4.163.84:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260927 13:49:42.587623 5566 raft_consensus.cc:493] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:42.587812 5566 raft_consensus.cc:515] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:42.593123 5566 leader_election.cc:290] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239)
I20260927 13:49:42.593329 4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 3 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c" is_pre_election: true
I20260927 13:49:42.593552 4868 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 802b83f09d3445359cfac825cd87c9de in term 2.
I20260927 13:49:42.594053 4915 leader_election.cc:304] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 802b83f09d3445359cfac825cd87c9de, e421351a34d1463e9773dcebdeebae3c; no voters:
I20260927 13:49:42.594420 5566 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260927 13:49:42.594561 5566 raft_consensus.cc:493] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:42.594671 5566 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 2 FOLLOWER]: Advancing to term 3
I20260927 13:49:42.597741 5566 raft_consensus.cc:515] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:42.598863 4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802b83f09d3445359cfac825cd87c9de" candidate_term: 3 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c"
I20260927 13:49:42.599047 4868 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 2 FOLLOWER]: Advancing to term 3
I20260927 13:49:42.602087 4868 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 802b83f09d3445359cfac825cd87c9de in term 3.
I20260927 13:49:42.602563 4915 leader_election.cc:304] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 802b83f09d3445359cfac825cd87c9de, e421351a34d1463e9773dcebdeebae3c; no voters:
I20260927 13:49:42.605317 5566 leader_election.cc:290] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 3 election: Requested vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239)
I20260927 13:49:42.605551 5566 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 3 FOLLOWER]: Leader election won for term 3
I20260927 13:49:42.605693 5566 raft_consensus.cc:697] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [term 3 LEADER]: Becoming Leader. State: Replica: 802b83f09d3445359cfac825cd87c9de, State: Running, Role: LEADER
I20260927 13:49:42.606178 5566 consensus_queue.cc:237] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 27, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:42.621351 5569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 802b83f09d3445359cfac825cd87c9de. Latest consensus state: current_term: 3 leader_uuid: "802b83f09d3445359cfac825cd87c9de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:42.621641 5569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: This master's current role is: LEADER
W20260927 13:49:42.622972 4914 leader_election.cc:336] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985): Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: connect: Connection refused (error 111)
W20260927 13:49:42.624612 4914 leader_election.cc:336] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985): Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: connect: Connection refused (error 111)
I20260927 13:49:42.625020 5571 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260927 13:49:42.628041 5571 catalog_manager.cc:692] Loaded metadata for table default.Table_866fc5204c264937917896ab9963a179 [id=39b622335f1a4f8ea3b2bd63589983f3]
I20260927 13:49:42.628643 5571 catalog_manager.cc:692] Loaded metadata for table default.Table_2e233e2bbfdb438c92c5b398118a445d [id=456ed8114a114f0a8cb9c74fa018fb6a]
I20260927 13:49:42.629531 5571 catalog_manager.cc:692] Loaded metadata for table default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5 [id=59df0a1ee3ea43e8ac991b38717c1549]
I20260927 13:49:42.633268 5571 catalog_manager.cc:692] Loaded metadata for table default.Table_802ebd45dc9a4d4ca86a39f613fecd0b [id=e2a8faa73bff4c7f90c3d05382e09b49]
I20260927 13:49:42.633708 5571 catalog_manager.cc:692] Loaded metadata for table default.Table_188f52a4236d491fa1bdc23378d78804 [id=eefd9636d7c1431d8d0ea214090cf216]
I20260927 13:49:42.634176 5571 catalog_manager.cc:692] Loaded metadata for table default.Table_4262de9abbe547828896f518f40f2788 [id=f6be2f3e0bb749108e056578f8d3cd75]
I20260927 13:49:42.636523 5571 tablet_loader.cc:96] loaded metadata for tablet 03b87dca35654bbeb75695253d81f915 (table default.Table_2e233e2bbfdb438c92c5b398118a445d [id=456ed8114a114f0a8cb9c74fa018fb6a])
I20260927 13:49:42.637090 5571 tablet_loader.cc:96] loaded metadata for tablet 66421715f2f746299c22c8f538554bdb (table default.Table_188f52a4236d491fa1bdc23378d78804 [id=eefd9636d7c1431d8d0ea214090cf216])
I20260927 13:49:42.637673 5571 tablet_loader.cc:96] loaded metadata for tablet 8ebc0095d7414152a8abd08a65328974 (table default.Table_802ebd45dc9a4d4ca86a39f613fecd0b [id=e2a8faa73bff4c7f90c3d05382e09b49])
I20260927 13:49:42.638254 5571 tablet_loader.cc:96] loaded metadata for tablet ddb3e90a312247ac831287a3daab1eeb (table default.Table_866fc5204c264937917896ab9963a179 [id=39b622335f1a4f8ea3b2bd63589983f3])
I20260927 13:49:42.638600 5571 tablet_loader.cc:96] loaded metadata for tablet e4c554f876d74be5b9667f373d832e50 (table default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5 [id=59df0a1ee3ea43e8ac991b38717c1549])
I20260927 13:49:42.639231 5571 tablet_loader.cc:96] loaded metadata for tablet fbb2e0a01a9147d597693eab481ca73b (table default.Table_4262de9abbe547828896f518f40f2788 [id=f6be2f3e0bb749108e056578f8d3cd75])
I20260927 13:49:42.639506 5571 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260927 13:49:42.640698 5571 catalog_manager.cc:1308] Loaded cluster ID: 020f38d03ca7495283eb7628b4a1a71b
I20260927 13:49:42.640786 5571 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260927 13:49:42.642367 5571 catalog_manager.cc:1553] Loading token signing keys...
I20260927 13:49:42.643448 5571 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Loaded TSK: 0
I20260927 13:49:42.644435 5571 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260927 13:49:42.653878 5572 consensus_queue.cc:1048] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:42.661152 4930 catalog_manager.cc:5838] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } }
I20260927 13:49:42.661702 4930 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet e4c554f876d74be5b9667f373d832e50 (table default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 1 got 0
I20260927 13:49:42.677990 4868 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Refusing update from remote peer 802b83f09d3445359cfac825cd87c9de: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 3 index: 29. (index mismatch)
I20260927 13:49:42.677901 5574 consensus_queue.cc:1048] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:49:42.678934 4914 consensus_peers.cc:597] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de -> Peer 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985): Couldn't send request to peer 13a42ae8b95b495c9bcea85d6732cd77. Status: Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:42.679018 5566 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [LEADER]: Connected to new peer: Peer: permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260927 13:49:42.689498 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_802ebd45dc9a4d4ca86a39f613fecd0b" } modify_external_catalogs: true
I20260927 13:49:42.689795 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_802ebd45dc9a4d4ca86a39f613fecd0b" } modify_external_catalogs: true
I20260927 13:49:42.690331 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet 006021014dee43dcb17571b390a0a57e from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:42.690744 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_866fc5204c264937917896ab9963a179" } modify_external_catalogs: true
I20260927 13:49:42.690917 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_866fc5204c264937917896ab9963a179" } modify_external_catalogs: true
I20260927 13:49:42.696761 5511 consensus_queue.cc:1048] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:42.699012 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_36801d318ea44b4398972cc6f9427d76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:42.700500 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36801d318ea44b4398972cc6f9427d76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:42.704560 5581 sys_catalog.cc:455] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 802b83f09d3445359cfac825cd87c9de. Latest consensus state: current_term: 3 leader_uuid: "802b83f09d3445359cfac825cd87c9de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:42.704834 5581 sys_catalog.cc:458] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:42.707254 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6a8d0b26fc9a4cfe901e0dbf641145b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:42.708030 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a8d0b26fc9a4cfe901e0dbf641145b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:42.710377 5566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "802b83f09d3445359cfac825cd87c9de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:42.710602 5566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: This master's current role is: LEADER
I20260927 13:49:42.711053 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_9c6c2df59b21419f9412f3f1356029e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:42.711714 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c6c2df59b21419f9412f3f1356029e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:42.712908 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ac3ac350d3e845c7927b01fbbd301935"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:42.713230 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4262de9abbe547828896f518f40f2788" } new_table_name: "default.Table_a087fb6729dd48fc84773f5b5aedb0a5" modify_external_catalogs: true
I20260927 13:49:42.713582 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet 66421715f2f746299c22c8f538554bdb from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:42.713783 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac3ac350d3e845c7927b01fbbd301935 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:42.714715 4928 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet e4c554f876d74be5b9667f373d832e50 (table default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 1 got 0
I20260927 13:49:42.715591 4928 master_service.cc:960] ReplaceTablet: received request to replace tablet 8ebc0095d7414152a8abd08a65328974 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:42.717346 5294 heartbeater.cc:499] Master 127.4.163.124:37095 was elected leader, sending a full tablet report...
I20260927 13:49:42.720212 5577 mvcc.cc:204] Tried to move back new op lower bound from 7333957561034727424 to 7333957560766758912. Current Snapshot: MvccSnapshot[applied={T|T < 7333957561034727424 or (T in {7333957561034727424})}]
I20260927 13:49:42.723510 4926 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e4c554f876d74be5b9667f373d832e50 (table default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 1 got 0
I20260927 13:49:42.725092 5155 heartbeater.cc:499] Master 127.4.163.124:37095 was elected leader, sending a full tablet report...
I20260927 13:49:42.740496 5591 consensus_queue.cc:1048] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260927 13:49:42.743296 5430 heartbeater.cc:499] Master 127.4.163.124:37095 was elected leader, sending a full tablet report...
I20260927 13:49:42.756738 5581 sys_catalog.cc:455] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "802b83f09d3445359cfac825cd87c9de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:42.756944 5581 sys_catalog.cc:458] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:42.765530 5584 consensus_queue.cc:1048] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:42.774189 5599 tablet.cc:1751] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:42.791375 5596 tablet.cc:1751] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:42.792423 5595 tablet.cc:1751] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:42.797926 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet 66421715f2f746299c22c8f538554bdb from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:42.803365 5579 consensus_queue.cc:1048] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:42.809038 5591 consensus_queue.cc:1048] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:42.820791 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 66421715f2f746299c22c8f538554bdb
I20260927 13:49:42.823711 5364 tablet_service.cc:1558] Processing DeleteTablet for tablet 66421715f2f746299c22c8f538554bdb with delete_type TABLET_DATA_DELETED (replaced by tablet d47c71b038c34a729ca20965d133c488) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:42.822084 4930 catalog_manager.cc:6934] ReplaceTablet: tablet 66421715f2f746299c22c8f538554bdb deleted and replaced by tablet d47c71b038c34a729ca20965d133c488
I20260927 13:49:42.822960 4926 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet e4c554f876d74be5b9667f373d832e50 (table default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 1 got 0
I20260927 13:49:42.825412 4926 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet fbb2e0a01a9147d597693eab481ca73b (table default.Table_4262de9abbe547828896f518f40f2788 [id=f6be2f3e0bb749108e056578f8d3cd75]). Expected version 1 got 0
I20260927 13:49:42.827025 4928 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e4c554f876d74be5b9667f373d832e50 (table default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 1 got 0
I20260927 13:49:42.827334 4928 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet fbb2e0a01a9147d597693eab481ca73b (table default.Table_4262de9abbe547828896f518f40f2788 [id=f6be2f3e0bb749108e056578f8d3cd75]). Expected version 1 got 0
I20260927 13:49:42.827663 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet ddb3e90a312247ac831287a3daab1eeb
I20260927 13:49:42.828701 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 8ebc0095d7414152a8abd08a65328974
W20260927 13:49:42.830122 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fbb2e0a01a9147d597693eab481ca73b consensus state has no leader
I20260927 13:49:42.831636 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet ddb3e90a312247ac831287a3daab1eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:42.831916 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ebc0095d7414152a8abd08a65328974 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:42.832388 5511 consensus_queue.cc:1048] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:42.836071 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet ddb3e90a312247ac831287a3daab1eeb from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:42.836621 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2e233e2bbfdb438c92c5b398118a445d" } new_table_name: "default.Table_b0afe34756534412a378f6fc253693bb" modify_external_catalogs: true
I20260927 13:49:42.838011 4921 catalog_manager.cc:5838] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } }
I20260927 13:49:42.838518 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet fbb2e0a01a9147d597693eab481ca73b (table default.Table_a087fb6729dd48fc84773f5b5aedb0a5 [id=f6be2f3e0bb749108e056578f8d3cd75]). Expected version 2 got 0
I20260927 13:49:42.838804 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet e4c554f876d74be5b9667f373d832e50 (table default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 1 got 0
I20260927 13:49:42.839990 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_1ea0b188cadc40009b93843fdf653504"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:42.840163 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_357e5541a8744640b98a8e6c1874748d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:42.840528 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ea0b188cadc40009b93843fdf653504 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:42.843556 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_188f52a4236d491fa1bdc23378d78804" } new_table_name: "default.Table_5bc1a994e68f4119a73bfcdbe454caa3" modify_external_catalogs: true
I20260927 13:49:42.844822 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_af690be4977a4925b270a539ae9e20a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:42.847450 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af690be4977a4925b270a539ae9e20a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:42.847543 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 03b87dca35654bbeb75695253d81f915 has no consensus state
I20260927 13:49:42.845584 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ee879ddabe7e40a59abe90285b638562"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:42.848955 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee879ddabe7e40a59abe90285b638562 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:42.846293 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_b0efcc41c04d48689f399cff85ac589f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:42.851337 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0efcc41c04d48689f399cff85ac589f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:42.846637 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f215061a7b1e4f7eac790f41e01080da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:42.852826 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f215061a7b1e4f7eac790f41e01080da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:42.860122 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_250ea90d2d8c44f3b9db5d5bdf6943e5" } new_table_name: "default.Table_28011ec7c155421aaa8f36798723f8b1" modify_external_catalogs: true
I20260927 13:49:42.864501 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_9c6c2df59b21419f9412f3f1356029e2" } new_table_name: "default.Table_7e3e9dcedc5b4da784103acb480dedef" modify_external_catalogs: true
I20260927 13:49:42.868978 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6a8d0b26fc9a4cfe901e0dbf641145b6" } modify_external_catalogs: true
I20260927 13:49:42.869215 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6a8d0b26fc9a4cfe901e0dbf641145b6" } modify_external_catalogs: true
I20260927 13:49:42.871100 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_36801d318ea44b4398972cc6f9427d76" } modify_external_catalogs: true
I20260927 13:49:42.871284 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_36801d318ea44b4398972cc6f9427d76" } modify_external_catalogs: true
W20260927 13:49:42.840560 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_357e5541a8744640b98a8e6c1874748d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:42.877408 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d47c71b038c34a729ca20965d133c488 has no consensus state
I20260927 13:49:42.877993 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ac3ac350d3e845c7927b01fbbd301935" } modify_external_catalogs: true
I20260927 13:49:42.878245 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ac3ac350d3e845c7927b01fbbd301935" } modify_external_catalogs: true
I20260927 13:49:42.911448 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet edb7c912138748e1a9afefec44e53773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:42.911733 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 006021014dee43dcb17571b390a0a57e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:42.911962 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet 7931267fae3a4a43abcbeeea42bb3ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:42.917896 5606 tablet_replica.cc:333] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:42.924197 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet ddb3e90a312247ac831287a3daab1eeb from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:42.924338 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4a6a12dc2814e1d92af53bdfc759175 consensus state has no leader
I20260927 13:49:42.929322 5599 tablet.cc:1751] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:42.936647 5596 tablet.cc:1751] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:42.945010 5107 raft_consensus.cc:1275] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Refusing update from remote peer bb28c54312c94d7dafb1c2abf7870735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:42.945564 5249 raft_consensus.cc:1275] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Refusing update from remote peer bb28c54312c94d7dafb1c2abf7870735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260927 13:49:42.951102 4916 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 03b87dca35654bbeb75695253d81f915 (table default.Table_b0afe34756534412a378f6fc253693bb [id=456ed8114a114f0a8cb9c74fa018fb6a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 03b87dca35654bbeb75695253d81f915 consensus state has no leader
I20260927 13:49:42.925431 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 55df2a9b30f04bc28eda3ff7c912df87 (DEFAULT_TABLE table=default.Table_ac3ac350d3e845c7927b01fbbd301935 [id=8cbd7b92923945eaa3bf583fd5cd165b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:42.925494 5572 consensus_queue.cc:1048] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:42.928552 5595 tablet.cc:1751] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:42.931473 5358 tablet_service.cc:1511] Processing CreateTablet for tablet d47c71b038c34a729ca20965d133c488 (DEFAULT_TABLE table=default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:42.931838 5357 tablet_service.cc:1511] Processing CreateTablet for tablet c4a6a12dc2814e1d92af53bdfc759175 (DEFAULT_TABLE table=default.Table_7e3e9dcedc5b4da784103acb480dedef [id=81cc900733bf4b35bd0051eb72c0d88d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:42.932154 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 0e77f460b73b46db86a22886b1200836 (DEFAULT_TABLE table=default.Table_36801d318ea44b4398972cc6f9427d76 [id=8b642dd68f9c4068997557886fcc338e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:42.932458 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2180cc05fd4fbbab6bfc0f0d45e096 (DEFAULT_TABLE table=default.Table_6a8d0b26fc9a4cfe901e0dbf641145b6 [id=13c9a4b16a83402c8747d4edee5faeb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:42.938748 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 03b87dca35654bbeb75695253d81f915 (DEFAULT_TABLE table=default.Table_b0afe34756534412a378f6fc253693bb [id=456ed8114a114f0a8cb9c74fa018fb6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:42.945709 5611 consensus_queue.cc:1048] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:42.953074 5578 consensus_queue.cc:1048] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:42.963470 5578 consensus_queue.cc:1048] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:42.973428 5595 tablet.cc:1751] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:42.974040 5593 mvcc.cc:204] Tried to move back new op lower bound from 7333957561916903424 to 7333957557675180032. Current Snapshot: MvccSnapshot[applied={T|T < 7333957561916903424}]
I20260927 13:49:42.976174 5616 tablet.cc:1751] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:42.986831 5606 raft_consensus.cc:2243] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:42.987341 5606 raft_consensus.cc:2272] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:42.987958 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55df2a9b30f04bc28eda3ff7c912df87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:42.988989 4922 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet e4c554f876d74be5b9667f373d832e50 (table default.Table_28011ec7c155421aaa8f36798723f8b1 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 2 got 1
I20260927 13:49:42.994243 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b87dca35654bbeb75695253d81f915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:42.998314 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2180cc05fd4fbbab6bfc0f0d45e096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.000909 4928 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_28011ec7c155421aaa8f36798723f8b1 [id=59df0a1ee3ea43e8ac991b38717c1549] alter complete (version 2)
I20260927 13:49:43.001096 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 55df2a9b30f04bc28eda3ff7c912df87
I20260927 13:49:43.001377 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 0e77f460b73b46db86a22886b1200836
I20260927 13:49:43.002074 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 6b2180cc05fd4fbbab6bfc0f0d45e096
I20260927 13:49:43.003890 5360 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e77f460b73b46db86a22886b1200836 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.005121 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d47c71b038c34a729ca20965d133c488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.007515 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d13d22dff8b34d18af8b1d76c2636d22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.008033 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d13d22dff8b34d18af8b1d76c2636d22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.008929 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a6a12dc2814e1d92af53bdfc759175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.010052 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_78b63dc8b0d74924b9db859769aebe53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.010535 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78b63dc8b0d74924b9db859769aebe53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.011544 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_bd3e5e5571784e99a29106527e6c7413"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.011983 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd3e5e5571784e99a29106527e6c7413 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.014957 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e77f460b73b46db86a22886b1200836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.018818 5360 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b2180cc05fd4fbbab6bfc0f0d45e096 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.018019 5364 tablet_service.cc:1558] Processing DeleteTablet for tablet 55df2a9b30f04bc28eda3ff7c912df87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.021093 5606 ts_tablet_manager.cc:1916] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.022890 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a23fe407dd1047ca98d605e2cee52fdc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.023615 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a23fe407dd1047ca98d605e2cee52fdc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.030776 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b0efcc41c04d48689f399cff85ac589f" } modify_external_catalogs: true
I20260927 13:49:43.030995 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b0efcc41c04d48689f399cff85ac589f" } modify_external_catalogs: true
I20260927 13:49:43.031186 5511 consensus_queue.cc:1048] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:43.031937 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b0afe34756534412a378f6fc253693bb" } modify_external_catalogs: true
I20260927 13:49:43.032125 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b0afe34756534412a378f6fc253693bb" } modify_external_catalogs: true
I20260927 13:49:43.035287 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f215061a7b1e4f7eac790f41e01080da" } new_table_name: "default.Table_a4997f2056884ff7bb04abc30d72f75c" modify_external_catalogs: true
I20260927 13:49:43.051029 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ee879ddabe7e40a59abe90285b638562" } new_table_name: "default.Table_e62c62c5076f48649e29f13d0f577c64" modify_external_catalogs: true
I20260927 13:49:43.052696 5591 consensus_queue.cc:1048] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:43.059688 5619 tablet_bootstrap.cc:492] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:43.061949 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c697b442911e41d898013105071efae8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.062520 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c697b442911e41d898013105071efae8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.064425 5619 tablet_bootstrap.cc:654] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.068185 5606 ts_tablet_manager.cc:1929] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.068382 5606 log.cc:1199] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/66421715f2f746299c22c8f538554bdb
I20260927 13:49:43.069329 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 66421715f2f746299c22c8f538554bdb with delete_type TABLET_DATA_DELETED (replaced by tablet d47c71b038c34a729ca20965d133c488) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.069469 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet ddb3e90a312247ac831287a3daab1eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.069706 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ebc0095d7414152a8abd08a65328974 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.070145 5226 tablet_service.cc:1558] Processing DeleteTablet for tablet edb7c912138748e1a9afefec44e53773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.071542 5228 tablet_service.cc:1511] Processing CreateTablet for tablet 55df2a9b30f04bc28eda3ff7c912df87 (DEFAULT_TABLE table=default.Table_ac3ac350d3e845c7927b01fbbd301935 [id=8cbd7b92923945eaa3bf583fd5cd165b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.072094 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55df2a9b30f04bc28eda3ff7c912df87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.075634 5219 tablet_service.cc:1511] Processing CreateTablet for tablet 0e77f460b73b46db86a22886b1200836 (DEFAULT_TABLE table=default.Table_36801d318ea44b4398972cc6f9427d76 [id=8b642dd68f9c4068997557886fcc338e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.076094 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 006021014dee43dcb17571b390a0a57e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.077535 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 7931267fae3a4a43abcbeeea42bb3ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.077754 5226 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2180cc05fd4fbbab6bfc0f0d45e096 (DEFAULT_TABLE table=default.Table_6a8d0b26fc9a4cfe901e0dbf641145b6 [id=13c9a4b16a83402c8747d4edee5faeb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.078750 5227 tablet_service.cc:1511] Processing CreateTablet for tablet d47c71b038c34a729ca20965d133c488 (DEFAULT_TABLE table=default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.087087 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e77f460b73b46db86a22886b1200836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.088384 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2180cc05fd4fbbab6bfc0f0d45e096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.090514 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d47c71b038c34a729ca20965d133c488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.098935 5623 tablet_replica.cc:333] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:43.099546 5623 raft_consensus.cc:2243] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:43.110612 5582 mvcc.cc:204] Tried to move back new op lower bound from 7333957561916903424 to 7333957557675180032. Current Snapshot: MvccSnapshot[applied={T|T < 7333957561916903424}]
I20260927 13:49:43.111016 5599 tablet.cc:1751] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:43.113742 5623 raft_consensus.cc:2272] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.118016 5623 ts_tablet_manager.cc:1916] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.120510 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 66421715f2f746299c22c8f538554bdb with delete_type TABLET_DATA_DELETED (replaced by tablet d47c71b038c34a729ca20965d133c488) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.120908 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet ddb3e90a312247ac831287a3daab1eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.121127 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ebc0095d7414152a8abd08a65328974 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.121340 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 006021014dee43dcb17571b390a0a57e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.121783 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 0e77f460b73b46db86a22886b1200836 (DEFAULT_TABLE table=default.Table_36801d318ea44b4398972cc6f9427d76 [id=8b642dd68f9c4068997557886fcc338e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.122205 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e77f460b73b46db86a22886b1200836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.122361 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e77f460b73b46db86a22886b1200836 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.122691 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b2180cc05fd4fbbab6bfc0f0d45e096 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.122723 5085 tablet_service.cc:1511] Processing CreateTablet for tablet 03b87dca35654bbeb75695253d81f915 (DEFAULT_TABLE table=default.Table_b0afe34756534412a378f6fc253693bb [id=456ed8114a114f0a8cb9c74fa018fb6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.123405 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b87dca35654bbeb75695253d81f915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.126356 5079 tablet_service.cc:1558] Processing DeleteTablet for tablet 55df2a9b30f04bc28eda3ff7c912df87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.126503 5089 tablet_service.cc:1511] Processing CreateTablet for tablet d47c71b038c34a729ca20965d133c488 (DEFAULT_TABLE table=default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.126873 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d47c71b038c34a729ca20965d133c488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.126391 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 55df2a9b30f04bc28eda3ff7c912df87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.128947 5219 tablet_service.cc:1511] Processing CreateTablet for tablet c4a6a12dc2814e1d92af53bdfc759175 (DEFAULT_TABLE table=default.Table_7e3e9dcedc5b4da784103acb480dedef [id=81cc900733bf4b35bd0051eb72c0d88d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.129402 5226 tablet_service.cc:1511] Processing CreateTablet for tablet 03b87dca35654bbeb75695253d81f915 (DEFAULT_TABLE table=default.Table_b0afe34756534412a378f6fc253693bb [id=456ed8114a114f0a8cb9c74fa018fb6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.122387 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet edb7c912138748e1a9afefec44e53773 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.130482 5084 tablet_service.cc:1511] Processing CreateTablet for tablet c4a6a12dc2814e1d92af53bdfc759175 (DEFAULT_TABLE table=default.Table_7e3e9dcedc5b4da784103acb480dedef [id=81cc900733bf4b35bd0051eb72c0d88d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.130722 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 55df2a9b30f04bc28eda3ff7c912df87 (DEFAULT_TABLE table=default.Table_ac3ac350d3e845c7927b01fbbd301935 [id=8cbd7b92923945eaa3bf583fd5cd165b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.130883 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a6a12dc2814e1d92af53bdfc759175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.130864 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b2180cc05fd4fbbab6bfc0f0d45e096 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.131196 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55df2a9b30f04bc28eda3ff7c912df87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.131927 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e77f460b73b46db86a22886b1200836 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.132659 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2180cc05fd4fbbab6bfc0f0d45e096 (DEFAULT_TABLE table=default.Table_6a8d0b26fc9a4cfe901e0dbf641145b6 [id=13c9a4b16a83402c8747d4edee5faeb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.132972 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a6a12dc2814e1d92af53bdfc759175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.133055 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2180cc05fd4fbbab6bfc0f0d45e096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.133644 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b87dca35654bbeb75695253d81f915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.134301 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 7931267fae3a4a43abcbeeea42bb3ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:41 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.137338 5579 consensus_queue.cc:1048] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:43.147083 5623 ts_tablet_manager.cc:1929] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.159924 5584 consensus_queue.cc:1048] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:43.171648 5628 tablet_bootstrap.cc:492] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.172029 5623 log.cc:1199] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/66421715f2f746299c22c8f538554bdb
I20260927 13:49:43.172830 5623 ts_tablet_manager.cc:1950] T 66421715f2f746299c22c8f538554bdb P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:43.173223 5626 tablet_bootstrap.cc:492] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.174897 5625 tablet_replica.cc:333] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:43.174889 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 66421715f2f746299c22c8f538554bdb (table default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]) successfully deleted
I20260927 13:49:43.176625 5619 tablet_bootstrap.cc:492] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:43.176822 5619 ts_tablet_manager.cc:1403] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.117s user 0.009s sys 0.005s
I20260927 13:49:43.177311 5626 tablet_bootstrap.cc:654] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.180511 5625 raft_consensus.cc:2243] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.180909 5625 raft_consensus.cc:2272] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.180027 5628 tablet_bootstrap.cc:654] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.178293 5619 raft_consensus.cc:359] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.181627 5619 raft_consensus.cc:385] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.181730 5619 raft_consensus.cc:740] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.182037 5619 consensus_queue.cc:260] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.182665 5619 ts_tablet_manager.cc:1434] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:49:43.183012 5619 tablet_bootstrap.cc:492] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:43.184073 5625 ts_tablet_manager.cc:1916] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.174955 5623 tablet_replica.cc:333] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:43.184429 5623 raft_consensus.cc:2243] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:43.184803 5619 tablet_bootstrap.cc:654] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.185266 5623 raft_consensus.cc:2272] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.185340 5628 tablet_bootstrap.cc:492] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.186224 5628 ts_tablet_manager.cc:1403] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260927 13:49:43.187415 5628 raft_consensus.cc:359] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.188855 5628 raft_consensus.cc:385] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.189157 5628 raft_consensus.cc:740] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.189764 5628 consensus_queue.cc:260] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.191030 5628 ts_tablet_manager.cc:1434] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:43.191484 5623 ts_tablet_manager.cc:1916] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.191747 5628 tablet_bootstrap.cc:492] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.193668 5628 tablet_bootstrap.cc:654] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.196403 5606 ts_tablet_manager.cc:1950] T 66421715f2f746299c22c8f538554bdb P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:43.199883 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 66421715f2f746299c22c8f538554bdb (table default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]) successfully deleted
I20260927 13:49:43.201558 5623 ts_tablet_manager.cc:1929] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.202329 5606 tablet_replica.cc:333] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:43.203617 5606 raft_consensus.cc:2243] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.204658 5606 raft_consensus.cc:2272] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.207000 5619 tablet_bootstrap.cc:492] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:43.207167 5619 ts_tablet_manager.cc:1403] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260927 13:49:43.207832 5625 ts_tablet_manager.cc:1929] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.208007 5619 raft_consensus.cc:359] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.208262 5619 raft_consensus.cc:385] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.208014 5606 ts_tablet_manager.cc:1916] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.211333 5625 log.cc:1199] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/66421715f2f746299c22c8f538554bdb
I20260927 13:49:43.211915 5625 ts_tablet_manager.cc:1950] T 66421715f2f746299c22c8f538554bdb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:43.213382 5625 tablet_replica.cc:333] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:43.213598 5625 raft_consensus.cc:2243] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.213778 5625 raft_consensus.cc:2272] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.202526 5626 tablet_bootstrap.cc:492] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.214252 5626 ts_tablet_manager.cc:1403] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.005s
I20260927 13:49:43.214980 5626 raft_consensus.cc:359] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:43.215152 5626 raft_consensus.cc:385] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.215229 5626 raft_consensus.cc:740] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.215484 5626 consensus_queue.cc:260] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:43.216156 5626 ts_tablet_manager.cc:1434] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:43.216432 5626 tablet_bootstrap.cc:492] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.218326 5626 tablet_bootstrap.cc:654] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.218850 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 66421715f2f746299c22c8f538554bdb (table default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]) successfully deleted
I20260927 13:49:43.219302 5623 log.cc:1199] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/ddb3e90a312247ac831287a3daab1eeb
I20260927 13:49:43.220047 5623 ts_tablet_manager.cc:1950] T ddb3e90a312247ac831287a3daab1eeb P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:43.221890 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet ddb3e90a312247ac831287a3daab1eeb (table default.Table_866fc5204c264937917896ab9963a179 [id=39b622335f1a4f8ea3b2bd63589983f3]) successfully deleted
I20260927 13:49:43.223026 5626 tablet_bootstrap.cc:492] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.223630 5626 ts_tablet_manager.cc:1403] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
I20260927 13:49:43.224689 5626 raft_consensus.cc:359] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.225766 5626 raft_consensus.cc:385] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.226022 5626 raft_consensus.cc:740] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.223919 5623 tablet_replica.cc:333] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:43.226511 5623 raft_consensus.cc:2243] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.226720 5623 raft_consensus.cc:2272] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.227138 5626 consensus_queue.cc:260] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.228435 5625 ts_tablet_manager.cc:1916] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.227758 5623 ts_tablet_manager.cc:1916] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.237360 5226 tablet_service.cc:1511] Processing CreateTablet for tablet 11d303db711543e5ac23bfcd2279c993 (DEFAULT_TABLE table=default.Table_f215061a7b1e4f7eac790f41e01080da [id=8a1cfc06002240faae3fd4bb724fc5f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.237599 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 28309730c01944a7b0c5cecc478a448b (DEFAULT_TABLE table=default.Table_1ea0b188cadc40009b93843fdf653504 [id=c8c17ee713974f8099a439cb16a06056]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.237772 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d303db711543e5ac23bfcd2279c993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.237988 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28309730c01944a7b0c5cecc478a448b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.242391 5228 tablet_service.cc:1511] Processing CreateTablet for tablet ab9ac0e6083343debabc043435c54d95 (DEFAULT_TABLE table=default.Table_b0efcc41c04d48689f399cff85ac589f [id=63d6c603fa31486b9e3ec4dcc74e0e57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.242738 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9ac0e6083343debabc043435c54d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.243373 4926 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_a087fb6729dd48fc84773f5b5aedb0a5 [id=f6be2f3e0bb749108e056578f8d3cd75] alter complete (version 2)
I20260927 13:49:43.244321 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_fafb083bcf954f6b91e326a7ca8ff4ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:43.244665 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6f09b6613d87411faca990bffef9d028"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.244903 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fafb083bcf954f6b91e326a7ca8ff4ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.244932 4926 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet fbb2e0a01a9147d597693eab481ca73b (table default.Table_a087fb6729dd48fc84773f5b5aedb0a5 [id=f6be2f3e0bb749108e056578f8d3cd75]). Expected version 2 got 0
W20260927 13:49:43.245154 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f09b6613d87411faca990bffef9d028 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.246335 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_28011ec7c155421aaa8f36798723f8b1" } new_table_name: "default.Table_295d95a3d737496b983509c136c68af4" modify_external_catalogs: true
I20260927 13:49:43.246013 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_deda43765afa4023be64f30f0684aef0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.247566 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_deda43765afa4023be64f30f0684aef0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.247680 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 8ebc0095d7414152a8abd08a65328974 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:43.248137 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet e4c554f876d74be5b9667f373d832e50 from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:43.249302 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11d303db711543e5ac23bfcd2279c993 consensus state has no leader
I20260927 13:49:43.249675 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_eae0be8d08ec43279ba35789c84b573c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.250203 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eae0be8d08ec43279ba35789c84b573c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.251140 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 93d57824aab9460b83f912d9c9c8dd68 (DEFAULT_TABLE table=default.Table_357e5541a8744640b98a8e6c1874748d [id=4b6887b0689b4a08a9bf9229a19b3ae7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:43.251318 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 991d0dcb68964df99b1bf5b43c890e28 consensus state has no leader
I20260927 13:49:43.251451 4927 master_service.cc:960] ReplaceTablet: received request to replace tablet 7931267fae3a4a43abcbeeea42bb3ba2 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:43.251547 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d57824aab9460b83f912d9c9c8dd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.251562 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet 7931267fae3a4a43abcbeeea42bb3ba2 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:43.251945 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_af690be4977a4925b270a539ae9e20a5" } new_table_name: "default.Table_01fc4dcd4db544ae8590a6c43c62918e" modify_external_catalogs: true
I20260927 13:49:43.252354 5227 tablet_service.cc:1511] Processing CreateTablet for tablet c6d69f70750d4b418f850b2cec3ad721 (DEFAULT_TABLE table=default.Table_af690be4977a4925b270a539ae9e20a5 [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.252720 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d69f70750d4b418f850b2cec3ad721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.251989 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a087fb6729dd48fc84773f5b5aedb0a5" } new_table_name: "default.Table_5c508a45312941cdbcb08fdcb4a7bcce" modify_external_catalogs: true
I20260927 13:49:43.258319 5626 ts_tablet_manager.cc:1434] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20260927 13:49:43.259796 5363 tablet_service.cc:1511] Processing CreateTablet for tablet c6d69f70750d4b418f850b2cec3ad721 (DEFAULT_TABLE table=default.Table_af690be4977a4925b270a539ae9e20a5 [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.260147 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d69f70750d4b418f850b2cec3ad721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.260372 5626 tablet_bootstrap.cc:492] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.262012 5626 tablet_bootstrap.cc:654] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.243431 5219 tablet_service.cc:1511] Processing CreateTablet for tablet 991d0dcb68964df99b1bf5b43c890e28 (DEFAULT_TABLE table=default.Table_ee879ddabe7e40a59abe90285b638562 [id=a8628dbf015640b9ad49c4aa66f46cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.262943 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 991d0dcb68964df99b1bf5b43c890e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.267047 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet ab9ac0e6083343debabc043435c54d95
I20260927 13:49:43.208384 5619 raft_consensus.cc:740] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.267326 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 03b87dca35654bbeb75695253d81f915
I20260927 13:49:43.268446 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet edb7c912138748e1a9afefec44e53773 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:43.236862 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 991d0dcb68964df99b1bf5b43c890e28 (DEFAULT_TABLE table=default.Table_ee879ddabe7e40a59abe90285b638562 [id=a8628dbf015640b9ad49c4aa66f46cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.271190 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7e3e9dcedc5b4da784103acb480dedef" } modify_external_catalogs: true
I20260927 13:49:43.271397 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7e3e9dcedc5b4da784103acb480dedef" } modify_external_catalogs: true
I20260927 13:49:43.239506 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 93d57824aab9460b83f912d9c9c8dd68 (DEFAULT_TABLE table=default.Table_357e5541a8744640b98a8e6c1874748d [id=4b6887b0689b4a08a9bf9229a19b3ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.239935 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 11d303db711543e5ac23bfcd2279c993 (DEFAULT_TABLE table=default.Table_f215061a7b1e4f7eac790f41e01080da [id=8a1cfc06002240faae3fd4bb724fc5f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.255793 5357 tablet_service.cc:1511] Processing CreateTablet for tablet ab9ac0e6083343debabc043435c54d95 (DEFAULT_TABLE table=default.Table_b0efcc41c04d48689f399cff85ac589f [id=63d6c603fa31486b9e3ec4dcc74e0e57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.273562 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7859e22cabbe417687111c36606c82da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.274170 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7859e22cabbe417687111c36606c82da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.274544 4921 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1ea0b188cadc40009b93843fdf653504" } modify_external_catalogs: true
I20260927 13:49:43.274734 4921 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1ea0b188cadc40009b93843fdf653504" } modify_external_catalogs: true
I20260927 13:49:43.256134 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 28309730c01944a7b0c5cecc478a448b (DEFAULT_TABLE table=default.Table_1ea0b188cadc40009b93843fdf653504 [id=c8c17ee713974f8099a439cb16a06056]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.275857 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_357e5541a8744640b98a8e6c1874748d" } modify_external_catalogs: true
I20260927 13:49:43.276010 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_357e5541a8744640b98a8e6c1874748d" } modify_external_catalogs: true
I20260927 13:49:43.277537 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet e4c554f876d74be5b9667f373d832e50
I20260927 13:49:43.278364 4924 catalog_manager.cc:6934] ReplaceTablet: tablet e4c554f876d74be5b9667f373d832e50 deleted and replaced by tablet 79514522a9d142438fd6aecc91f0463e
W20260927 13:49:43.278529 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6d69f70750d4b418f850b2cec3ad721 consensus state has no leader
I20260927 13:49:43.278836 5226 tablet_service.cc:1558] Processing DeleteTablet for tablet ab9ac0e6083343debabc043435c54d95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.279095 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 03b87dca35654bbeb75695253d81f915 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.280076 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet e4c554f876d74be5b9667f373d832e50 with delete_type TABLET_DATA_DELETED (replaced by tablet 79514522a9d142438fd6aecc91f0463e) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.283404 5626 tablet_bootstrap.cc:492] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.284089 5626 ts_tablet_manager.cc:1403] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260927 13:49:43.285112 5626 raft_consensus.cc:359] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.286526 5626 raft_consensus.cc:385] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.286445 5619 consensus_queue.cc:260] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.286840 5626 raft_consensus.cc:740] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.287164 5619 ts_tablet_manager.cc:1434] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.080s user 0.003s sys 0.000s
I20260927 13:49:43.287529 5626 consensus_queue.cc:260] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.289088 5619 tablet_bootstrap.cc:492] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:43.291913 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 991d0dcb68964df99b1bf5b43c890e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.291976 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet ab9ac0e6083343debabc043435c54d95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.292181 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9ac0e6083343debabc043435c54d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.292418 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d57824aab9460b83f912d9c9c8dd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.294870 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28309730c01944a7b0c5cecc478a448b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.295964 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d303db711543e5ac23bfcd2279c993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.298740 5626 ts_tablet_manager.cc:1434] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260927 13:49:43.299861 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 03b87dca35654bbeb75695253d81f915 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.300575 5626 tablet_bootstrap.cc:492] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.303805 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 93d57824aab9460b83f912d9c9c8dd68
I20260927 13:49:43.305576 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 28309730c01944a7b0c5cecc478a448b
I20260927 13:49:43.305910 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet c4a6a12dc2814e1d92af53bdfc759175
I20260927 13:49:43.309540 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet 28309730c01944a7b0c5cecc478a448b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.309592 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet c4a6a12dc2814e1d92af53bdfc759175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.309816 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 93d57824aab9460b83f912d9c9c8dd68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.243125 5081 tablet_service.cc:1511] Processing CreateTablet for tablet ab9ac0e6083343debabc043435c54d95 (DEFAULT_TABLE table=default.Table_b0efcc41c04d48689f399cff85ac589f [id=63d6c603fa31486b9e3ec4dcc74e0e57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.310513 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9ac0e6083343debabc043435c54d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.311367 5626 tablet_bootstrap.cc:654] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.246412 5084 tablet_service.cc:1511] Processing CreateTablet for tablet 28309730c01944a7b0c5cecc478a448b (DEFAULT_TABLE table=default.Table_1ea0b188cadc40009b93843fdf653504 [id=c8c17ee713974f8099a439cb16a06056]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.314523 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28309730c01944a7b0c5cecc478a448b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.317142 5625 ts_tablet_manager.cc:1929] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.317348 5625 log.cc:1199] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/ddb3e90a312247ac831287a3daab1eeb
I20260927 13:49:43.317744 5625 ts_tablet_manager.cc:1950] T ddb3e90a312247ac831287a3daab1eeb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:43.251575 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 93d57824aab9460b83f912d9c9c8dd68 (DEFAULT_TABLE table=default.Table_357e5541a8744640b98a8e6c1874748d [id=4b6887b0689b4a08a9bf9229a19b3ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.318480 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d57824aab9460b83f912d9c9c8dd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.318660 5625 tablet_replica.cc:333] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:43.318840 5625 raft_consensus.cc:2243] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:43.318845 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet ddb3e90a312247ac831287a3daab1eeb (table default.Table_866fc5204c264937917896ab9963a179 [id=39b622335f1a4f8ea3b2bd63589983f3]) successfully deleted
I20260927 13:49:43.319373 5625 raft_consensus.cc:2272] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.251924 5086 tablet_service.cc:1511] Processing CreateTablet for tablet c6d69f70750d4b418f850b2cec3ad721 (DEFAULT_TABLE table=default.Table_af690be4977a4925b270a539ae9e20a5 [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.322633 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d69f70750d4b418f850b2cec3ad721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.325295 5623 ts_tablet_manager.cc:1929] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.325398 5623 log.cc:1199] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/8ebc0095d7414152a8abd08a65328974
I20260927 13:49:43.325850 5623 ts_tablet_manager.cc:1950] T 8ebc0095d7414152a8abd08a65328974 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:43.256585 5085 tablet_service.cc:1511] Processing CreateTablet for tablet 991d0dcb68964df99b1bf5b43c890e28 (DEFAULT_TABLE table=default.Table_ee879ddabe7e40a59abe90285b638562 [id=a8628dbf015640b9ad49c4aa66f46cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.326467 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 991d0dcb68964df99b1bf5b43c890e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.326867 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 8ebc0095d7414152a8abd08a65328974 (table default.Table_802ebd45dc9a4d4ca86a39f613fecd0b [id=e2a8faa73bff4c7f90c3d05382e09b49]) successfully deleted
I20260927 13:49:43.327194 5623 tablet_replica.cc:333] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:43.327380 5623 raft_consensus.cc:2243] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.327544 5623 raft_consensus.cc:2272] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.328359 5623 ts_tablet_manager.cc:1916] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.256928 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 11d303db711543e5ac23bfcd2279c993 (DEFAULT_TABLE table=default.Table_f215061a7b1e4f7eac790f41e01080da [id=8a1cfc06002240faae3fd4bb724fc5f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.330534 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d303db711543e5ac23bfcd2279c993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.330912 5625 ts_tablet_manager.cc:1916] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.269904 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet ab9ac0e6083343debabc043435c54d95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.270077 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 03b87dca35654bbeb75695253d81f915 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.279593 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet e4c554f876d74be5b9667f373d832e50 with delete_type TABLET_DATA_DELETED (replaced by tablet 79514522a9d142438fd6aecc91f0463e) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.302532 5628 tablet_bootstrap.cc:492] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.305428 5079 tablet_service.cc:1558] Processing DeleteTablet for tablet 93d57824aab9460b83f912d9c9c8dd68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.306659 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet 28309730c01944a7b0c5cecc478a448b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.307471 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet c4a6a12dc2814e1d92af53bdfc759175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.334538 5628 ts_tablet_manager.cc:1403] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.143s user 0.011s sys 0.031s
I20260927 13:49:43.335542 5628 raft_consensus.cc:359] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.335789 5628 raft_consensus.cc:385] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.335891 5628 raft_consensus.cc:740] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.336194 5628 consensus_queue.cc:260] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.336814 5628 ts_tablet_manager.cc:1434] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:49:43.337144 5628 tablet_bootstrap.cc:492] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.338238 5591 raft_consensus.cc:493] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.338405 5591 raft_consensus.cc:515] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.339107 5591 leader_election.cc:290] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:43.339741 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d47c71b038c34a729ca20965d133c488" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
W20260927 13:49:43.340420 5184 leader_election.cc:343] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.342566 5599 tablet.cc:1751] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:43.349157 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 32fa23c312544fac8ef485a35e5ab972 (DEFAULT_TABLE table=default.Table_bd3e5e5571784e99a29106527e6c7413 [id=a51ccdf3dce04c65b40dd44a1f8c16f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.349617 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32fa23c312544fac8ef485a35e5ab972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.349561 5228 tablet_service.cc:1511] Processing CreateTablet for tablet f2622078288a47b4be4dea70d594b76c (DEFAULT_TABLE table=default.Table_c697b442911e41d898013105071efae8 [id=3922762a78fe4981b87c3ecbb25a8e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.349927 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2622078288a47b4be4dea70d594b76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.350412 5219 tablet_service.cc:1511] Processing CreateTablet for tablet b4d56bd86f814c9ead4a52f133d1c818 (DEFAULT_TABLE table=default.Table_78b63dc8b0d74924b9db859769aebe53 [id=dba93d9f1c5045b29c27827599701cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.350771 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d56bd86f814c9ead4a52f133d1c818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.350958 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 60fae0c413e7439c9ab18b01628d8b28 (DEFAULT_TABLE table=default.Table_d13d22dff8b34d18af8b1d76c2636d22 [id=36caa6d3649b47efb7e95cab54ca2608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.351317 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60fae0c413e7439c9ab18b01628d8b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.352010 4926 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d47c71b038c34a729ca20965d133c488 (table default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]). Expected version 2 got 0
I20260927 13:49:43.349587 5616 tablet.cc:1751] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:43.359027 5626 tablet_bootstrap.cc:492] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.359201 5626 ts_tablet_manager.cc:1403] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.009s
I20260927 13:49:43.360024 5626 raft_consensus.cc:359] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.361023 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ebc0095d7414152a8abd08a65328974 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.360522 5226 tablet_service.cc:1511] Processing CreateTablet for tablet 169e64b6e20544e6ad1bc31c7ec29cf2 (DEFAULT_TABLE table=default.Table_a23fe407dd1047ca98d605e2cee52fdc [id=4f5c882c6f8449cf9daacd66a354bc9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.363385 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169e64b6e20544e6ad1bc31c7ec29cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.366159 5595 tablet.cc:1751] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:43.371965 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d47c71b038c34a729ca20965d133c488" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:43.372179 5384 raft_consensus.cc:2468] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:43.372572 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet e4c554f876d74be5b9667f373d832e50 with delete_type TABLET_DATA_DELETED (replaced by tablet 79514522a9d142438fd6aecc91f0463e) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.372834 5623 ts_tablet_manager.cc:1929] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.372968 5623 log.cc:1199] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/edb7c912138748e1a9afefec44e53773
I20260927 13:49:43.373291 5185 leader_election.cc:304] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:43.373374 5623 ts_tablet_manager.cc:1950] T edb7c912138748e1a9afefec44e53773 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:43.373818 5591 raft_consensus.cc:2804] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:43.373915 5591 raft_consensus.cc:493] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:43.374017 5591 raft_consensus.cc:3060] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:43.374337 5623 tablet_replica.cc:333] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:43.374518 5623 raft_consensus.cc:2243] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:43.374543 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet edb7c912138748e1a9afefec44e53773 (table default.Table_b89bb2c082214ce08e677bc80dcafd48 [id=80368d0a7e884f519deb250d73d6adc3]) successfully deleted
I20260927 13:49:43.374853 5623 raft_consensus.cc:2272] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.375355 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f (DEFAULT_TABLE table=default.Table_fafb083bcf954f6b91e326a7ca8ff4ee [id=0d47daf95d4b40e2862f1b897b210232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.375742 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.376904 5591 raft_consensus.cc:515] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.377213 5226 tablet_service.cc:1511] Processing CreateTablet for tablet 79514522a9d142438fd6aecc91f0463e (DEFAULT_TABLE table=default.Table_295d95a3d737496b983509c136c68af4 [id=59df0a1ee3ea43e8ac991b38717c1549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.377616 5591 leader_election.cc:290] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:43.379390 5228 tablet_service.cc:1511] Processing CreateTablet for tablet a1489f766164444b9aaa7b58e81a72d9 (DEFAULT_TABLE table=default.Table_7859e22cabbe417687111c36606c82da [id=2a104f24fe5e4ad8bfb52eb2dbdf9a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.379835 5219 tablet_service.cc:1511] Processing CreateTablet for tablet b0dfe23bef144e438ae762e401f02e8f (DEFAULT_TABLE table=default.Table_eae0be8d08ec43279ba35789c84b573c [id=599a7a50e2324466b865d11e66bc51bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.381129 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6721aa2fa0437eae7ca052c19f0f2e (DEFAULT_TABLE table=default.Table_6f09b6613d87411faca990bffef9d028 [id=7f846a3fd7cf4362870ca0e938dd45bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.382093 5623 ts_tablet_manager.cc:1916] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.360224 5626 raft_consensus.cc:385] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.382740 5626 raft_consensus.cc:740] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.382998 5626 consensus_queue.cc:260] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.383592 5626 ts_tablet_manager.cc:1434] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260927 13:49:43.383878 5229 tablet_service.cc:1511] Processing CreateTablet for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (DEFAULT_TABLE table=default.Table_deda43765afa4023be64f30f0684aef0 [id=c16d7a8a2339458b8c973cedf99c32bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.384789 5626 tablet_bootstrap.cc:492] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.385922 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 28309730c01944a7b0c5cecc478a448b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.386094 5364 tablet_service.cc:1558] Processing DeleteTablet for tablet 93d57824aab9460b83f912d9c9c8dd68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.387387 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d47c71b038c34a729ca20965d133c488" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:43.387742 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d47c71b038c34a729ca20965d133c488" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:43.387920 5384 raft_consensus.cc:3060] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:43.377624 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79514522a9d142438fd6aecc91f0463e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.395392 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1489f766164444b9aaa7b58e81a72d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.395615 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6bf85c1c2254063a1ffc0b7bf97eb38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.395838 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0dfe23bef144e438ae762e401f02e8f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:43.395978 5184 leader_election.cc:343] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.397110 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6721aa2fa0437eae7ca052c19f0f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.407027 5616 tablet.cc:1751] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:43.407582 5626 tablet_bootstrap.cc:654] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.406697 5079 tablet_service.cc:1511] Processing CreateTablet for tablet b4d56bd86f814c9ead4a52f133d1c818 (DEFAULT_TABLE table=default.Table_78b63dc8b0d74924b9db859769aebe53 [id=dba93d9f1c5045b29c27827599701cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.413313 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f (DEFAULT_TABLE table=default.Table_fafb083bcf954f6b91e326a7ca8ff4ee [id=0d47daf95d4b40e2862f1b897b210232]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:43.414556 5564 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 13:49:43.415083 5564 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 13:49:43.415249 5564 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260927 13:49:43.416772 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 60fae0c413e7439c9ab18b01628d8b28 (DEFAULT_TABLE table=default.Table_d13d22dff8b34d18af8b1d76c2636d22 [id=36caa6d3649b47efb7e95cab54ca2608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.418895 5364 tablet_service.cc:1511] Processing CreateTablet for tablet 32fa23c312544fac8ef485a35e5ab972 (DEFAULT_TABLE table=default.Table_bd3e5e5571784e99a29106527e6c7413 [id=a51ccdf3dce04c65b40dd44a1f8c16f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.419862 5360 tablet_service.cc:1511] Processing CreateTablet for tablet b4d56bd86f814c9ead4a52f133d1c818 (DEFAULT_TABLE table=default.Table_78b63dc8b0d74924b9db859769aebe53 [id=dba93d9f1c5045b29c27827599701cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.422014 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32fa23c312544fac8ef485a35e5ab972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.427208 5358 tablet_service.cc:1511] Processing CreateTablet for tablet f2622078288a47b4be4dea70d594b76c (DEFAULT_TABLE table=default.Table_c697b442911e41d898013105071efae8 [id=3922762a78fe4981b87c3ecbb25a8e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.429937 5623 ts_tablet_manager.cc:1929] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.430069 5623 log.cc:1199] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/006021014dee43dcb17571b390a0a57e
I20260927 13:49:43.430540 5623 ts_tablet_manager.cc:1950] T 006021014dee43dcb17571b390a0a57e P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:43.431265 4926 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_5c508a45312941cdbcb08fdcb4a7bcce [id=f6be2f3e0bb749108e056578f8d3cd75] alter complete (version 3)
I20260927 13:49:43.431638 5623 tablet_replica.cc:333] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:43.431768 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 006021014dee43dcb17571b390a0a57e (table default.Table_7b645f63ae9f403f904da94ea2617bbb [id=c2aaf76e59ef492db6cea3ffe1e6187e]) successfully deleted
I20260927 13:49:43.431851 5623 raft_consensus.cc:2243] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.432034 5623 raft_consensus.cc:2272] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:43.432756 5564 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
I20260927 13:49:43.432741 5085 tablet_service.cc:1511] Processing CreateTablet for tablet 79514522a9d142438fd6aecc91f0463e (DEFAULT_TABLE table=default.Table_295d95a3d737496b983509c136c68af4 [id=59df0a1ee3ea43e8ac991b38717c1549]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:43.432857 5564 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260927 13:49:43.433003 5564 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 13:49:43.433079 5564 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260927 13:49:43.433033 5089 tablet_service.cc:1511] Processing CreateTablet for tablet a1489f766164444b9aaa7b58e81a72d9 (DEFAULT_TABLE table=default.Table_7859e22cabbe417687111c36606c82da [id=2a104f24fe5e4ad8bfb52eb2dbdf9a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.433563 5623 ts_tablet_manager.cc:1916] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.435134 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d56bd86f814c9ead4a52f133d1c818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.435603 5626 tablet_bootstrap.cc:492] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.435730 5626 ts_tablet_manager.cc:1403] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.052s user 0.013s sys 0.005s
I20260927 13:49:43.436036 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 60fae0c413e7439c9ab18b01628d8b28 (DEFAULT_TABLE table=default.Table_d13d22dff8b34d18af8b1d76c2636d22 [id=36caa6d3649b47efb7e95cab54ca2608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.436476 5626 raft_consensus.cc:359] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.436652 5626 raft_consensus.cc:385] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.436743 5626 raft_consensus.cc:740] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.407763 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 32fa23c312544fac8ef485a35e5ab972 (DEFAULT_TABLE table=default.Table_bd3e5e5571784e99a29106527e6c7413 [id=a51ccdf3dce04c65b40dd44a1f8c16f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.437404 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet c4a6a12dc2814e1d92af53bdfc759175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.437753 5626 consensus_queue.cc:260] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.440877 5626 ts_tablet_manager.cc:1434] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:43.441977 5626 tablet_bootstrap.cc:492] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.444468 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f (DEFAULT_TABLE table=default.Table_fafb083bcf954f6b91e326a7ca8ff4ee [id=0d47daf95d4b40e2862f1b897b210232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.444877 5626 tablet_bootstrap.cc:654] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.445410 5082 tablet_service.cc:1511] Processing CreateTablet for tablet b0dfe23bef144e438ae762e401f02e8f (DEFAULT_TABLE table=default.Table_eae0be8d08ec43279ba35789c84b573c [id=599a7a50e2324466b865d11e66bc51bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.441074 5078 tablet_service.cc:1511] Processing CreateTablet for tablet f2622078288a47b4be4dea70d594b76c (DEFAULT_TABLE table=default.Table_c697b442911e41d898013105071efae8 [id=3922762a78fe4981b87c3ecbb25a8e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.446628 5599 tablet.cc:1751] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:43.447793 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2622078288a47b4be4dea70d594b76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.450539 5359 tablet_service.cc:1511] Processing CreateTablet for tablet b0dfe23bef144e438ae762e401f02e8f (DEFAULT_TABLE table=default.Table_eae0be8d08ec43279ba35789c84b573c [id=599a7a50e2324466b865d11e66bc51bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.450718 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d56bd86f814c9ead4a52f133d1c818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.450928 5619 tablet_bootstrap.cc:654] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.451337 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79514522a9d142438fd6aecc91f0463e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.451884 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1489f766164444b9aaa7b58e81a72d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.453579 5623 ts_tablet_manager.cc:1929] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.453702 5623 log.cc:1199] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/7931267fae3a4a43abcbeeea42bb3ba2
I20260927 13:49:43.454092 5623 ts_tablet_manager.cc:1950] T 7931267fae3a4a43abcbeeea42bb3ba2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:43.455066 5623 tablet_replica.cc:333] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:43.455248 5623 raft_consensus.cc:2243] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.455422 5623 raft_consensus.cc:2272] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.455726 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 7931267fae3a4a43abcbeeea42bb3ba2 (table default.Table_84797db80b3f4f079f839fac204e38ac [id=ca6cd336704b4d698e513e3e8b2b22f1]) successfully deleted
I20260927 13:49:43.456135 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_dfa3b09930634e67ba11591b71147d46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:43.456370 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_62531a04ef9143aa9089eb9779aee6f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.456929 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62531a04ef9143aa9089eb9779aee6f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:43.456992 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfa3b09930634e67ba11591b71147d46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.456166 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_281b42f84e80436bb5c29448bde434a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.458668 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_281b42f84e80436bb5c29448bde434a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.461486 5564 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.163.84:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.126:42985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.163.126
--webserver_port=34313
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 27 Sep 2026 13:43:25 UTC on bdcb31816ec0
build id 14025
ASAN enabled
I20260927 13:49:43.462783 5591 raft_consensus.cc:493] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.463002 5591 raft_consensus.cc:515] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.463760 5591 leader_election.cc:290] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:43.463841 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7859e22cabbe417687111c36606c82da" } new_table_name: "default.Table_055f1a3f79864929982c584ed6dec1e9" modify_external_catalogs: true
I20260927 13:49:43.465499 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_deda43765afa4023be64f30f0684aef0" } new_table_name: "default.Table_13c484685fd1403fa4e825778a3ed2ca" modify_external_catalogs: true
I20260927 13:49:43.468220 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60fae0c413e7439c9ab18b01628d8b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.469518 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fafb083bcf954f6b91e326a7ca8ff4ee" } modify_external_catalogs: true
I20260927 13:49:43.469691 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fafb083bcf954f6b91e326a7ca8ff4ee" } modify_external_catalogs: true
I20260927 13:49:43.469926 5564 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 13:49:43.470341 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_dbc0fcbf67f64509b180433394be51f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.470816 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbc0fcbf67f64509b180433394be51f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.471251 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_78b63dc8b0d74924b9db859769aebe53" } modify_external_catalogs: true
I20260927 13:49:43.471428 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_78b63dc8b0d74924b9db859769aebe53" } modify_external_catalogs: true
I20260927 13:49:43.471589 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d13d22dff8b34d18af8b1d76c2636d22" } new_table_name: "default.Table_88c5377676df4e3fb778d2781ed7a546" modify_external_catalogs: true
I20260927 13:49:43.472422 5564 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260927 13:49:43.477902 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e77f460b73b46db86a22886b1200836" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:43.478602 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0dfe23bef144e438ae762e401f02e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.479064 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 79514522a9d142438fd6aecc91f0463e (DEFAULT_TABLE table=default.Table_295d95a3d737496b983509c136c68af4 [id=59df0a1ee3ea43e8ac991b38717c1549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.480085 5385 raft_consensus.cc:2468] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:43.480764 5185 leader_election.cc:304] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:43.480966 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60fae0c413e7439c9ab18b01628d8b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.481149 5591 raft_consensus.cc:2804] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:43.481263 5591 raft_consensus.cc:493] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:43.481374 5591 raft_consensus.cc:3060] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:43.482349 5626 tablet_bootstrap.cc:492] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.483089 5626 ts_tablet_manager.cc:1403] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.041s user 0.011s sys 0.005s
I20260927 13:49:43.484139 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0dfe23bef144e438ae762e401f02e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.485477 5628 tablet_bootstrap.cc:654] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.485344 5591 raft_consensus.cc:515] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.485450 5626 raft_consensus.cc:359] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.486387 5626 raft_consensus.cc:385] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.479856 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6721aa2fa0437eae7ca052c19f0f2e (DEFAULT_TABLE table=default.Table_6f09b6613d87411faca990bffef9d028 [id=7f846a3fd7cf4362870ca0e938dd45bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.487003 5626 raft_consensus.cc:740] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.487555 5626 consensus_queue.cc:260] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.479719 5076 tablet_service.cc:1511] Processing CreateTablet for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (DEFAULT_TABLE table=default.Table_deda43765afa4023be64f30f0684aef0 [id=c16d7a8a2339458b8c973cedf99c32bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.489777 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6721aa2fa0437eae7ca052c19f0f2e (DEFAULT_TABLE table=default.Table_6f09b6613d87411faca990bffef9d028 [id=7f846a3fd7cf4362870ca0e938dd45bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.475942 5355 tablet_service.cc:1511] Processing CreateTablet for tablet 169e64b6e20544e6ad1bc31c7ec29cf2 (DEFAULT_TABLE table=default.Table_a23fe407dd1047ca98d605e2cee52fdc [id=4f5c882c6f8449cf9daacd66a354bc9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.490525 5625 ts_tablet_manager.cc:1929] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.491627 5626 ts_tablet_manager.cc:1434] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 13:49:43.493191 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2622078288a47b4be4dea70d594b76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.493988 5626 tablet_bootstrap.cc:492] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.494196 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e77f460b73b46db86a22886b1200836" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:43.494758 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e77f460b73b46db86a22886b1200836" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
W20260927 13:49:43.494818 5184 leader_election.cc:343] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:43.495229 5184 leader_election.cc:343] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.495910 5625 log.cc:1199] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/8ebc0095d7414152a8abd08a65328974
I20260927 13:49:43.496714 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.496781 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32fa23c312544fac8ef485a35e5ab972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.497866 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6721aa2fa0437eae7ca052c19f0f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.498883 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79514522a9d142438fd6aecc91f0463e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.499035 5626 tablet_bootstrap.cc:654] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.500523 5606 ts_tablet_manager.cc:1929] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.500700 5384 raft_consensus.cc:2468] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:43.501322 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6bf85c1c2254063a1ffc0b7bf97eb38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.501302 5185 leader_election.cc:304] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:43.501773 5511 raft_consensus.cc:2804] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:43.501924 5606 log.cc:1199] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/ddb3e90a312247ac831287a3daab1eeb
I20260927 13:49:43.504243 5626 tablet_bootstrap.cc:492] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.504772 5626 ts_tablet_manager.cc:1403] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260927 13:49:43.505762 5626 raft_consensus.cc:359] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.507896 5626 raft_consensus.cc:385] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.508724 5350 tablet_service.cc:1511] Processing CreateTablet for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (DEFAULT_TABLE table=default.Table_deda43765afa4023be64f30f0684aef0 [id=c16d7a8a2339458b8c973cedf99c32bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.509845 5606 ts_tablet_manager.cc:1950] T ddb3e90a312247ac831287a3daab1eeb P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:43.509670 5626 raft_consensus.cc:740] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.510468 5626 consensus_queue.cc:260] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.511294 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 169e64b6e20544e6ad1bc31c7ec29cf2 (DEFAULT_TABLE table=default.Table_a23fe407dd1047ca98d605e2cee52fdc [id=4f5c882c6f8449cf9daacd66a354bc9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.513114 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet ddb3e90a312247ac831287a3daab1eeb (table default.Table_866fc5204c264937917896ab9963a179 [id=39b622335f1a4f8ea3b2bd63589983f3]) successfully deleted
I20260927 13:49:43.515805 5606 tablet_replica.cc:333] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:43.516073 5606 raft_consensus.cc:2243] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.516328 5606 raft_consensus.cc:2272] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.517516 5352 tablet_service.cc:1511] Processing CreateTablet for tablet a1489f766164444b9aaa7b58e81a72d9 (DEFAULT_TABLE table=default.Table_7859e22cabbe417687111c36606c82da [id=2a104f24fe5e4ad8bfb52eb2dbdf9a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.520229 5650 raft_consensus.cc:493] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.520478 5650 raft_consensus.cc:515] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.522394 5626 ts_tablet_manager.cc:1434] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.017s user 0.004s sys 0.000s
I20260927 13:49:43.522751 4923 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d47c71b038c34a729ca20965d133c488 (table default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]). Expected version 2 got 0
I20260927 13:49:43.523073 5626 tablet_bootstrap.cc:492] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.524765 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5807eda64fd945a3b66fce9a479d46b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.525579 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5807eda64fd945a3b66fce9a479d46b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.526490 5650 leader_election.cc:290] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:43.527420 5626 tablet_bootstrap.cc:654] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.528882 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6bf85c1c2254063a1ffc0b7bf97eb38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.532320 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1489f766164444b9aaa7b58e81a72d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.534068 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_335933f2be3646adb6c59ec7a41b61d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.534809 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_335933f2be3646adb6c59ec7a41b61d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.536890 5641 tablet.cc:1751] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:43.537295 5511 raft_consensus.cc:697] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:43.537633 5511 consensus_queue.cc:237] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.539063 5626 tablet_bootstrap.cc:492] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.539391 5626 ts_tablet_manager.cc:1403] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.003s
W20260927 13:49:43.539924 5649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:43.540709 5626 raft_consensus.cc:359] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.541129 5626 raft_consensus.cc:385] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.541273 5626 raft_consensus.cc:740] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.541779 5626 consensus_queue.cc:260] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.539655 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6a12dc2814e1d92af53bdfc759175" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:43.544204 5626 ts_tablet_manager.cc:1434] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
W20260927 13:49:43.544494 5185 leader_election.cc:343] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.544703 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169e64b6e20544e6ad1bc31c7ec29cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.545778 5626 tablet_bootstrap.cc:492] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.546233 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6a12dc2814e1d92af53bdfc759175" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:43.548806 5109 raft_consensus.cc:2468] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:43.549350 5184 leader_election.cc:304] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:43.549978 5626 tablet_bootstrap.cc:654] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.550599 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.552665 5606 ts_tablet_manager.cc:1916] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.553529 5648 raft_consensus.cc:2804] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:43.553653 5648 raft_consensus.cc:493] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:43.553787 5648 raft_consensus.cc:3060] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:43.554555 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e77f460b73b46db86a22886b1200836" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:43.554733 5384 raft_consensus.cc:3060] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:43.555243 5591 leader_election.cc:290] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:43.559463 5648 raft_consensus.cc:515] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.561139 5648 leader_election.cc:290] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:43.561328 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6a12dc2814e1d92af53bdfc759175" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:43.561630 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6a12dc2814e1d92af53bdfc759175" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:43.561798 5109 raft_consensus.cc:3060] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:43.562276 5185 leader_election.cc:343] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:43.564052 5653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:43.564476 5625 ts_tablet_manager.cc:1950] T 8ebc0095d7414152a8abd08a65328974 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:43.565064 5625 tablet_replica.cc:333] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:43.565316 5625 raft_consensus.cc:2243] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.565528 5625 raft_consensus.cc:2272] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.566099 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 8ebc0095d7414152a8abd08a65328974 (table default.Table_802ebd45dc9a4d4ca86a39f613fecd0b [id=e2a8faa73bff4c7f90c3d05382e09b49]) successfully deleted
I20260927 13:49:43.567173 5625 ts_tablet_manager.cc:1916] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.569392 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6721aa2fa0437eae7ca052c19f0f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.580847 5626 tablet_bootstrap.cc:492] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.581146 5626 ts_tablet_manager.cc:1403] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.009s
I20260927 13:49:43.582574 5626 raft_consensus.cc:359] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.582955 5626 raft_consensus.cc:385] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.583112 5626 raft_consensus.cc:740] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.583520 5626 consensus_queue.cc:260] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.584524 5626 ts_tablet_manager.cc:1434] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:43.585331 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169e64b6e20544e6ad1bc31c7ec29cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.587198 5626 tablet_bootstrap.cc:492] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.590358 5626 tablet_bootstrap.cc:654] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.609723 5109 raft_consensus.cc:2468] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:43.610469 5184 leader_election.cc:304] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:43.610801 5648 raft_consensus.cc:2804] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:43.610991 5648 raft_consensus.cc:697] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:43.611296 5648 consensus_queue.cc:237] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:43.613832 4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.125:42239, user_credentials={real_user=slave}} blocked reactor thread for 46611.7us
I20260927 13:49:43.641605 5384 raft_consensus.cc:2468] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:43.642485 5185 leader_election.cc:304] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:43.642872 5648 raft_consensus.cc:2804] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:43.644609 5648 raft_consensus.cc:697] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:43.644944 5648 consensus_queue.cc:237] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.647344 5626 tablet_bootstrap.cc:492] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.647523 5626 ts_tablet_manager.cc:1403] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.060s user 0.014s sys 0.011s
I20260927 13:49:43.648306 5626 raft_consensus.cc:359] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.648526 5626 raft_consensus.cc:385] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.648615 5626 raft_consensus.cc:740] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.648845 5626 consensus_queue.cc:260] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.649348 5626 ts_tablet_manager.cc:1434] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:43.652992 5626 tablet_bootstrap.cc:492] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.656584 5626 tablet_bootstrap.cc:654] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.662568 5619 tablet_bootstrap.cc:492] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:43.662865 5619 ts_tablet_manager.cc:1403] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.375s user 0.007s sys 0.001s
I20260927 13:49:43.665045 5628 tablet_bootstrap.cc:492] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.665223 5628 ts_tablet_manager.cc:1403] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.328s user 0.014s sys 0.005s
I20260927 13:49:43.666381 5628 raft_consensus.cc:359] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.666603 5628 raft_consensus.cc:385] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.666703 5628 raft_consensus.cc:740] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.666989 5628 consensus_queue.cc:260] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.667270 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_295d95a3d737496b983509c136c68af4" } new_table_name: "default.Table_d1cf0c8faaa24af2b046a519baa60406" modify_external_catalogs: true
I20260927 13:49:43.671239 5628 ts_tablet_manager.cc:1434] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 13:49:43.672904 5628 tablet_bootstrap.cc:492] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.673158 5648 raft_consensus.cc:493] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.673395 5648 raft_consensus.cc:515] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.674561 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28309730c01944a7b0c5cecc478a448b" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:43.674772 5628 tablet_bootstrap.cc:654] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:43.675253 5185 leader_election.cc:343] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.676192 5648 leader_election.cc:290] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:43.676287 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28309730c01944a7b0c5cecc478a448b" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
W20260927 13:49:43.676841 5184 leader_election.cc:343] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.676978 5184 leader_election.cc:304] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:43.677405 5648 raft_consensus.cc:2749] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:43.678642 4923 catalog_manager.cc:5838] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:43.678949 5625 ts_tablet_manager.cc:1929] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.679175 5625 log.cc:1199] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/006021014dee43dcb17571b390a0a57e
I20260927 13:49:43.679489 4923 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d47c71b038c34a729ca20965d133c488 (table default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]). Expected version 2 got 0
I20260927 13:49:43.679708 5625 ts_tablet_manager.cc:1950] T 006021014dee43dcb17571b390a0a57e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:43.680778 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 006021014dee43dcb17571b390a0a57e (table default.Table_7b645f63ae9f403f904da94ea2617bbb [id=c2aaf76e59ef492db6cea3ffe1e6187e]) successfully deleted
W20260927 13:49:43.685616 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 0e77f460b73b46db86a22886b1200836 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e77f460b73b46db86a22886b1200836 already in progress: creating tablet
I20260927 13:49:43.686787 5628 tablet_bootstrap.cc:492] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.687043 5628 ts_tablet_manager.cc:1403] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.003s
I20260927 13:49:43.687770 5628 raft_consensus.cc:359] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.688028 5628 raft_consensus.cc:385] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.688129 5628 raft_consensus.cc:740] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.688431 5628 consensus_queue.cc:260] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.690860 5628 ts_tablet_manager.cc:1434] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260927 13:49:43.692152 5628 tablet_bootstrap.cc:492] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.694691 5628 tablet_bootstrap.cc:654] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.692440 5625 tablet_replica.cc:333] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:43.697235 5625 raft_consensus.cc:2243] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.697527 5625 raft_consensus.cc:2272] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.699292 5625 ts_tablet_manager.cc:1916] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.705899 5626 tablet_bootstrap.cc:492] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.706055 5626 ts_tablet_manager.cc:1403] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.011s
I20260927 13:49:43.706804 5626 raft_consensus.cc:359] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.706997 5626 raft_consensus.cc:385] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.707090 5626 raft_consensus.cc:740] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.707360 5626 consensus_queue.cc:260] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.663902 5619 raft_consensus.cc:359] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.709015 5626 ts_tablet_manager.cc:1434] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 13:49:43.709154 5619 raft_consensus.cc:385] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.709297 5626 tablet_bootstrap.cc:492] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.710484 5619 raft_consensus.cc:740] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.710776 5619 consensus_queue.cc:260] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.713299 5626 tablet_bootstrap.cc:654] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.714778 5619 ts_tablet_manager.cc:1434] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.052s user 0.002s sys 0.000s
I20260927 13:49:43.717610 5619 tablet_bootstrap.cc:492] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:43.718400 5628 tablet_bootstrap.cc:492] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.718613 5628 ts_tablet_manager.cc:1403] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.005s
I20260927 13:49:43.719405 5628 raft_consensus.cc:359] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.719637 5628 raft_consensus.cc:385] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.719748 5628 raft_consensus.cc:740] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.720063 5628 consensus_queue.cc:260] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.720341 5619 tablet_bootstrap.cc:654] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.722760 5628 ts_tablet_manager.cc:1434] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 13:49:43.725106 5628 tablet_bootstrap.cc:492] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.726405 5625 ts_tablet_manager.cc:1929] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:43.727523 5625 log.cc:1199] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/6b2180cc05fd4fbbab6bfc0f0d45e096
I20260927 13:49:43.727939 5625 ts_tablet_manager.cc:1950] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:43.728941 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 6b2180cc05fd4fbbab6bfc0f0d45e096 (table default.Table_6a8d0b26fc9a4cfe901e0dbf641145b6 [id=13c9a4b16a83402c8747d4edee5faeb9]) successfully deleted
I20260927 13:49:43.733529 5628 tablet_bootstrap.cc:654] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:43.734884 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 55df2a9b30f04bc28eda3ff7c912df87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55df2a9b30f04bc28eda3ff7c912df87 already in progress: creating tablet
I20260927 13:49:43.735249 5625 tablet_replica.cc:333] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:43.735519 5625 raft_consensus.cc:2243] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:43.735864 5625 raft_consensus.cc:2272] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.736969 5625 ts_tablet_manager.cc:1916] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.737821 5623 ts_tablet_manager.cc:1916] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.743000 5626 tablet_bootstrap.cc:492] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.743166 5626 ts_tablet_manager.cc:1403] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.002s
I20260927 13:49:43.743865 5626 raft_consensus.cc:359] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.744056 5626 raft_consensus.cc:385] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.744127 5626 raft_consensus.cc:740] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.744375 5626 consensus_queue.cc:260] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.744993 5626 ts_tablet_manager.cc:1434] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:43.745287 5626 tablet_bootstrap.cc:492] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:49:43.745373 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a1489f766164444b9aaa7b58e81a72d9 consensus state has no leader
W20260927 13:49:43.746186 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6bf85c1c2254063a1ffc0b7bf97eb38 consensus state has no leader
I20260927 13:49:43.747924 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f
I20260927 13:49:43.749228 5626 tablet_bootstrap.cc:654] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.749277 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.749368 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.750283 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b4d56bd86f814c9ead4a52f133d1c818
I20260927 13:49:43.751719 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet b4d56bd86f814c9ead4a52f133d1c818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:43.751873 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet b4d56bd86f814c9ead4a52f133d1c818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:43.751981 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60fae0c413e7439c9ab18b01628d8b28 consensus state has no leader
I20260927 13:49:43.752396 5628 tablet_bootstrap.cc:492] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.752645 5628 ts_tablet_manager.cc:1403] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.001s
I20260927 13:49:43.753393 5628 raft_consensus.cc:359] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:43.753633 5628 raft_consensus.cc:385] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.753736 5628 raft_consensus.cc:740] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.754124 5628 consensus_queue.cc:260] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:43.754942 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_19cca2a50519472a82c4cd1940234797"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.755584 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19cca2a50519472a82c4cd1940234797 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.756037 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c697b442911e41d898013105071efae8" } modify_external_catalogs: true
I20260927 13:49:43.756552 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3ab0995080774a95967ee1d1ce7c9fdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:43.758100 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5bc1a994e68f4119a73bfcdbe454caa3" } modify_external_catalogs: true
I20260927 13:49:43.758342 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5bc1a994e68f4119a73bfcdbe454caa3" } modify_external_catalogs: true
I20260927 13:49:43.758526 5628 ts_tablet_manager.cc:1434] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260927 13:49:43.759289 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_885a1d72ea0640d48861b8228923ea8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:43.759754 5628 tablet_bootstrap.cc:492] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:49:43.760520 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_885a1d72ea0640d48861b8228923ea8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.762071 5628 tablet_bootstrap.cc:654] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.761976 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_02bba441fd064165b917fff4a7cf4215"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:43.757648 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c697b442911e41d898013105071efae8" } modify_external_catalogs: true
W20260927 13:49:43.763487 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02bba441fd064165b917fff4a7cf4215 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.764546 5625 ts_tablet_manager.cc:1929] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.764710 5625 log.cc:1199] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/edb7c912138748e1a9afefec44e53773
W20260927 13:49:43.765064 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ab0995080774a95967ee1d1ce7c9fdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.765429 5625 ts_tablet_manager.cc:1950] T edb7c912138748e1a9afefec44e53773 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:43.766018 5579 raft_consensus.cc:493] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.766211 5579 raft_consensus.cc:515] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.767060 5579 leader_election.cc:290] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:43.767199 5625 tablet_replica.cc:333] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:43.767445 5625 raft_consensus.cc:2243] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.767480 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d47c71b038c34a729ca20965d133c488" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:43.767661 5625 raft_consensus.cc:2272] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.768092 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet edb7c912138748e1a9afefec44e53773 (table default.Table_b89bb2c082214ce08e677bc80dcafd48 [id=80368d0a7e884f519deb250d73d6adc3]) successfully deleted
I20260927 13:49:43.769137 5626 tablet_bootstrap.cc:492] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.769289 5626 ts_tablet_manager.cc:1403] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.006s
I20260927 13:49:43.769550 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet b4d56bd86f814c9ead4a52f133d1c818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.769752 5625 ts_tablet_manager.cc:1916] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.770175 5626 raft_consensus.cc:359] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.770381 5626 raft_consensus.cc:385] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.770622 5626 raft_consensus.cc:740] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.770888 5626 consensus_queue.cc:260] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.772557 5626 ts_tablet_manager.cc:1434] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:43.772631 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.772991 5626 tablet_bootstrap.cc:492] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.776032 5628 tablet_bootstrap.cc:492] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.776175 5628 ts_tablet_manager.cc:1403] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.001s
I20260927 13:49:43.776440 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d47c71b038c34a729ca20965d133c488" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:43.776564 5626 tablet_bootstrap.cc:654] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.776700 5384 raft_consensus.cc:2393] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34fc5fe0a32d42ab83f4aa6d07341409 in current term 1: Already voted for candidate 79c1646c9659434b9a659382d2eb1d8a in this term.
I20260927 13:49:43.776976 5628 raft_consensus.cc:359] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.777187 5628 raft_consensus.cc:385] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.777313 5628 raft_consensus.cc:740] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.777186 5045 leader_election.cc:304] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:43.777777 5628 consensus_queue.cc:260] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.777952 5579 raft_consensus.cc:3060] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:43.780725 5579 raft_consensus.cc:2749] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:43.785631 5625 ts_tablet_manager.cc:1929] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.785751 5625 log.cc:1199] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/7931267fae3a4a43abcbeeea42bb3ba2
I20260927 13:49:43.786195 5625 ts_tablet_manager.cc:1950] T 7931267fae3a4a43abcbeeea42bb3ba2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:43.787526 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 7931267fae3a4a43abcbeeea42bb3ba2 (table default.Table_84797db80b3f4f079f839fac204e38ac [id=ca6cd336704b4d698e513e3e8b2b22f1]) successfully deleted
I20260927 13:49:43.788697 5626 tablet_bootstrap.cc:492] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.788892 5626 ts_tablet_manager.cc:1403] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.001s
I20260927 13:49:43.789860 5626 raft_consensus.cc:359] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.790127 5626 raft_consensus.cc:385] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.790220 5626 raft_consensus.cc:740] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.790550 5626 consensus_queue.cc:260] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:43.792622 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet ab9ac0e6083343debabc043435c54d95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab9ac0e6083343debabc043435c54d95 already in progress: creating tablet
I20260927 13:49:43.793229 5625 tablet_replica.cc:333] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:43.793675 5625 raft_consensus.cc:2243] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.794191 5625 raft_consensus.cc:2272] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.794518 5626 ts_tablet_manager.cc:1434] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260927 13:49:43.795356 5625 ts_tablet_manager.cc:1916] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.796057 5648 raft_consensus.cc:493] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.796233 5648 raft_consensus.cc:515] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.796878 5648 leader_election.cc:290] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:43.797566 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2622078288a47b4be4dea70d594b76c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
W20260927 13:49:43.798520 5184 leader_election.cc:343] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.799315 5626 tablet_bootstrap.cc:492] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.790036 5606 ts_tablet_manager.cc:1929] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.798367 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2622078288a47b4be4dea70d594b76c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:43.799736 5628 ts_tablet_manager.cc:1434] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.023s user 0.002s sys 0.009s
I20260927 13:49:43.799743 5606 log.cc:1199] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/8ebc0095d7414152a8abd08a65328974
W20260927 13:49:43.800161 5185 leader_election.cc:343] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.800276 5606 ts_tablet_manager.cc:1950] T 8ebc0095d7414152a8abd08a65328974 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:43.800316 5185 leader_election.cc:304] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:43.800900 5648 raft_consensus.cc:2749] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:43.801445 5628 tablet_bootstrap.cc:492] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.801549 5626 tablet_bootstrap.cc:654] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.803303 5628 tablet_bootstrap.cc:654] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.806785 5619 tablet_bootstrap.cc:492] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:43.806955 5619 ts_tablet_manager.cc:1403] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.089s user 0.003s sys 0.000s
I20260927 13:49:43.809159 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 8ebc0095d7414152a8abd08a65328974 (table default.Table_802ebd45dc9a4d4ca86a39f613fecd0b [id=e2a8faa73bff4c7f90c3d05382e09b49]) successfully deleted
W20260927 13:49:43.810408 5658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:43.811435 5625 ts_tablet_manager.cc:1929] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:43.811579 5625 log.cc:1199] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/03b87dca35654bbeb75695253d81f915
I20260927 13:49:43.811935 5625 ts_tablet_manager.cc:1950] T 03b87dca35654bbeb75695253d81f915 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:43.812160 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_62531a04ef9143aa9089eb9779aee6f5" } modify_external_catalogs: true
I20260927 13:49:43.812346 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_62531a04ef9143aa9089eb9779aee6f5" } modify_external_catalogs: true
W20260927 13:49:43.812682 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79514522a9d142438fd6aecc91f0463e consensus state has no leader
I20260927 13:49:43.813076 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_01fc4dcd4db544ae8590a6c43c62918e" } new_table_name: "default.Table_2bf2762db5414d409995b758091f66e7" modify_external_catalogs: true
I20260927 13:49:43.814807 5564 server_base.cc:1061] running on GCE node
I20260927 13:49:43.815387 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet 6b2180cc05fd4fbbab6bfc0f0d45e096 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:43.815903 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet edb7c912138748e1a9afefec44e53773 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:43.816111 5564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 13:49:43.816341 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet 8ebc0095d7414152a8abd08a65328974 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:43.816745 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet c4a6a12dc2814e1d92af53bdfc759175 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:43.816831 5648 raft_consensus.cc:493] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.817093 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet 03b87dca35654bbeb75695253d81f915 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:43.817015 5648 raft_consensus.cc:515] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.817549 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_69465bd5ea564d8f8e6621fb817f844b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:43.817658 5648 leader_election.cc:290] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:43.818048 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69465bd5ea564d8f8e6621fb817f844b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.809240 5606 tablet_replica.cc:333] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:43.818795 5606 raft_consensus.cc:2243] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:43.818756 5184 leader_election.cc:343] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 6b2180cc05fd4fbbab6bfc0f0d45e096
I20260927 13:49:43.818972 5606 raft_consensus.cc:2272] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.809785 5619 raft_consensus.cc:359] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:43.819387 5619 raft_consensus.cc:385] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.818501 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b2180cc05fd4fbbab6bfc0f0d45e096" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:43.819478 5619 raft_consensus.cc:740] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:49:43.819974 5185 leader_election.cc:343] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.820030 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 03b87dca35654bbeb75695253d81f915 (table default.Table_b0afe34756534412a378f6fc253693bb [id=456ed8114a114f0a8cb9c74fa018fb6a]) successfully deleted
I20260927 13:49:43.819952 5619 consensus_queue.cc:260] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:43.820092 5185 leader_election.cc:304] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:43.820380 5625 tablet_replica.cc:333] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:43.820560 5625 raft_consensus.cc:2243] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.820600 5648 raft_consensus.cc:2749] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:43.821115 5628 tablet_bootstrap.cc:492] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.821219 5672 raft_consensus.cc:493] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.821435 5628 ts_tablet_manager.cc:1403] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.000s
I20260927 13:49:43.821378 5672 raft_consensus.cc:515] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.822221 5672 leader_election.cc:290] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:43.822690 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e77f460b73b46db86a22886b1200836" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:43.822239 5628 raft_consensus.cc:359] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.822839 5628 raft_consensus.cc:385] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.822896 5384 raft_consensus.cc:2393] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34fc5fe0a32d42ab83f4aa6d07341409 in current term 1: Already voted for candidate 79c1646c9659434b9a659382d2eb1d8a in this term.
I20260927 13:49:43.822916 5626 tablet_bootstrap.cc:492] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.822929 5628 raft_consensus.cc:740] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.823043 5626 ts_tablet_manager.cc:1403] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.002s
I20260927 13:49:43.823156 5628 consensus_queue.cc:260] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.823707 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e77f460b73b46db86a22886b1200836" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:43.823817 5626 raft_consensus.cc:359] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.824007 5626 raft_consensus.cc:385] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.824095 5626 raft_consensus.cc:740] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.824321 5626 consensus_queue.cc:260] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.825347 5628 ts_tablet_manager.cc:1434] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:43.825397 5626 ts_tablet_manager.cc:1434] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260927 13:49:43.825909 5619 ts_tablet_manager.cc:1434] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260927 13:49:43.826129 5628 tablet_bootstrap.cc:492] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.827024 5619 tablet_bootstrap.cc:492] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:43.827055 5626 tablet_bootstrap.cc:492] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.827070 5625 raft_consensus.cc:2272] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:43.828094 5319 consensus_peers.cc:597] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7931267fae3a4a43abcbeeea42bb3ba2. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:43.828346 5628 tablet_bootstrap.cc:654] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.828648 5619 tablet_bootstrap.cc:654] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.828644 5044 leader_election.cc:304] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:43.829417 5672 raft_consensus.cc:3060] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:43.830610 5626 tablet_bootstrap.cc:654] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.832723 5672 raft_consensus.cc:2749] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:43.833575 5625 ts_tablet_manager.cc:1916] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.835683 5606 ts_tablet_manager.cc:1916] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.838131 5623 ts_tablet_manager.cc:1929] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:43.844089 5619 tablet_bootstrap.cc:492] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:43.844353 5619 ts_tablet_manager.cc:1403] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.001s
I20260927 13:49:43.845383 5619 raft_consensus.cc:359] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.845832 5564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 13:49:43.845343 5626 tablet_bootstrap.cc:492] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.847002 5626 ts_tablet_manager.cc:1403] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.004s
I20260927 13:49:43.848117 5626 raft_consensus.cc:359] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.848449 5626 raft_consensus.cc:385] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.848604 5626 raft_consensus.cc:740] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.848755 5628 tablet_bootstrap.cc:492] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.848905 5628 ts_tablet_manager.cc:1403] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.004s
I20260927 13:49:43.849049 5626 consensus_queue.cc:260] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.849489 5625 ts_tablet_manager.cc:1929] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 13:49:43.849614 5625 log.cc:1199] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/e4c554f876d74be5b9667f373d832e50
I20260927 13:49:43.849704 5628 raft_consensus.cc:359] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.849895 5628 raft_consensus.cc:385] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.849987 5628 raft_consensus.cc:740] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.849843 5626 ts_tablet_manager.cc:1434] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:49:43.850401 5625 ts_tablet_manager.cc:1950] T e4c554f876d74be5b9667f373d832e50 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:43.850611 5626 tablet_bootstrap.cc:492] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.850255 5628 consensus_queue.cc:260] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.851579 5628 ts_tablet_manager.cc:1434] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:43.852128 5628 tablet_bootstrap.cc:492] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.853224 5626 tablet_bootstrap.cc:654] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.853448 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet e4c554f876d74be5b9667f373d832e50 (table default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549]) successfully deleted
I20260927 13:49:43.853834 5625 tablet_replica.cc:333] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:43.854059 5628 tablet_bootstrap.cc:654] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.854197 5625 raft_consensus.cc:2243] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.854425 5625 raft_consensus.cc:2272] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.855194 5625 ts_tablet_manager.cc:1916] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.856769 5623 log.cc:1199] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/55df2a9b30f04bc28eda3ff7c912df87
I20260927 13:49:43.857151 5623 ts_tablet_manager.cc:1950] T 55df2a9b30f04bc28eda3ff7c912df87 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:43.858042 5623 tablet_replica.cc:333] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:43.858282 5623 raft_consensus.cc:2243] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.858325 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 55df2a9b30f04bc28eda3ff7c912df87 (table default.Table_ac3ac350d3e845c7927b01fbbd301935 [id=8cbd7b92923945eaa3bf583fd5cd165b]) successfully deleted
I20260927 13:49:43.858780 5619 raft_consensus.cc:385] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.858909 5619 raft_consensus.cc:740] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.860291 5619 consensus_queue.cc:260] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.860708 5574 raft_consensus.cc:493] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.860903 5619 ts_tablet_manager.cc:1434] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20260927 13:49:43.860968 5574 raft_consensus.cc:515] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.861248 5619 tablet_bootstrap.cc:492] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:43.862681 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6a12dc2814e1d92af53bdfc759175" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:43.862990 5109 raft_consensus.cc:2393] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 79c1646c9659434b9a659382d2eb1d8a in this term.
I20260927 13:49:43.863106 5619 tablet_bootstrap.cc:654] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.863854 5564 hybrid_clock.cc:648] HybridClock initialized: now 1790516983863218 us; error 625 us; skew 500 ppm
I20260927 13:49:43.864542 5564 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 13:49:43.864609 5625 ts_tablet_manager.cc:1929] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:43.864746 5625 log.cc:1199] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/93d57824aab9460b83f912d9c9c8dd68
I20260927 13:49:43.865152 5625 ts_tablet_manager.cc:1950] T 93d57824aab9460b83f912d9c9c8dd68 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:43.858496 5623 raft_consensus.cc:2272] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.867215 5623 ts_tablet_manager.cc:1916] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.867591 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 93d57824aab9460b83f912d9c9c8dd68 (table default.Table_357e5541a8744640b98a8e6c1874748d [id=4b6887b0689b4a08a9bf9229a19b3ae7]) successfully deleted
I20260927 13:49:43.867688 5625 tablet_replica.cc:333] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:43.867934 5625 raft_consensus.cc:2243] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:43.868005 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 28309730c01944a7b0c5cecc478a448b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28309730c01944a7b0c5cecc478a448b already in progress: creating tablet
I20260927 13:49:43.868091 5625 raft_consensus.cc:2272] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.868573 5625 ts_tablet_manager.cc:1916] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.869586 5628 tablet_bootstrap.cc:492] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.869725 5628 ts_tablet_manager.cc:1403] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260927 13:49:43.870481 5628 raft_consensus.cc:359] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.870652 5628 raft_consensus.cc:385] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.870711 5628 raft_consensus.cc:740] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.864970 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6a12dc2814e1d92af53bdfc759175" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:43.870935 5628 consensus_queue.cc:260] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.874962 5626 tablet_bootstrap.cc:492] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.875108 5626 ts_tablet_manager.cc:1403] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.001s
I20260927 13:49:43.875887 5626 raft_consensus.cc:359] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.876083 5626 raft_consensus.cc:385] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.876168 5626 raft_consensus.cc:740] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.876396 5626 consensus_queue.cc:260] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.876736 5319 leader_election.cc:304] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:43.876915 5626 ts_tablet_manager.cc:1434] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:43.877242 5626 tablet_bootstrap.cc:492] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.878443 5578 raft_consensus.cc:3060] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:43.863871 5574 leader_election.cc:290] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:43.879112 5626 tablet_bootstrap.cc:654] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.879612 5628 ts_tablet_manager.cc:1434] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 13:49:43.880580 5628 tablet_bootstrap.cc:492] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.881096 5648 raft_consensus.cc:493] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.881301 5648 raft_consensus.cc:515] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.882539 5648 leader_election.cc:290] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:43.882695 5628 tablet_bootstrap.cc:654] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.882684 5578 raft_consensus.cc:2749] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:43.883728 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d303db711543e5ac23bfcd2279c993" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:43.885445 5625 ts_tablet_manager.cc:1929] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:43.885560 5625 log.cc:1199] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/c4a6a12dc2814e1d92af53bdfc759175
I20260927 13:49:43.885891 5625 ts_tablet_manager.cc:1950] T c4a6a12dc2814e1d92af53bdfc759175 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:43.885805 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5e60c258bac24c7cabc2b7e1e6052193"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:43.886765 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4333e4f147f24db68f8d26c70e28f4a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.887384 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4333e4f147f24db68f8d26c70e28f4a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:43.890338 5185 leader_election.cc:343] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.889339 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d303db711543e5ac23bfcd2279c993" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
W20260927 13:49:43.891552 5184 leader_election.cc:343] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.891726 5184 leader_election.cc:304] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:43.892554 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet c4a6a12dc2814e1d92af53bdfc759175 (table default.Table_7e3e9dcedc5b4da784103acb480dedef [id=81cc900733bf4b35bd0051eb72c0d88d]) successfully deleted
W20260927 13:49:43.892860 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f already in progress: creating tablet
W20260927 13:49:43.893131 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b4d56bd86f814c9ead4a52f133d1c818 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4d56bd86f814c9ead4a52f133d1c818 already in progress: creating tablet
I20260927 13:49:43.893622 5648 raft_consensus.cc:2749] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:43.895721 5619 tablet_bootstrap.cc:492] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:43.895931 5619 ts_tablet_manager.cc:1403] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
I20260927 13:49:43.897114 5619 raft_consensus.cc:359] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.897480 5619 raft_consensus.cc:385] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.897574 5619 raft_consensus.cc:740] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.898307 5564 webserver.cc:533] Webserver started at http://127.4.163.126:34313/ using document root <none> and password file <none>
W20260927 13:49:43.899629 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e60c258bac24c7cabc2b7e1e6052193 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.899968 5564 fs_manager.cc:362] Metadata directory not provided
I20260927 13:49:43.900144 5564 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 13:49:43.905267 5578 raft_consensus.cc:493] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.905472 5578 raft_consensus.cc:515] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:43.906265 5578 leader_election.cc:290] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:43.907548 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df2a9b30f04bc28eda3ff7c912df87" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:43.907846 5109 raft_consensus.cc:2468] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:43.908463 5319 leader_election.cc:304] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:43.908782 5578 raft_consensus.cc:2804] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:43.909382 5578 raft_consensus.cc:493] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260927 13:49:43.909437 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6d69f70750d4b418f850b2cec3ad721 consensus state has no leader
I20260927 13:49:43.909507 5578 raft_consensus.cc:3060] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:43.909922 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet f2622078288a47b4be4dea70d594b76c
I20260927 13:49:43.913216 5578 raft_consensus.cc:515] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:43.915364 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df2a9b30f04bc28eda3ff7c912df87" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:43.915676 5109 raft_consensus.cc:3060] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:43.918579 5319 leader_election.cc:343] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 55df2a9b30f04bc28eda3ff7c912df87
W20260927 13:49:43.919046 5319 leader_election.cc:343] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 55df2a9b30f04bc28eda3ff7c912df87
I20260927 13:49:43.919965 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet f2622078288a47b4be4dea70d594b76c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:43.920533 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet f2622078288a47b4be4dea70d594b76c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:43.921113 5109 raft_consensus.cc:2468] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:43.921196 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet f2622078288a47b4be4dea70d594b76c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:43.921319 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet f2622078288a47b4be4dea70d594b76c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2622078288a47b4be4dea70d594b76c already in progress: creating tablet
I20260927 13:49:43.921684 5319 leader_election.cc:304] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:43.922086 5574 raft_consensus.cc:2804] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:43.925951 5578 leader_election.cc:290] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:43.931756 5619 consensus_queue.cc:260] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.931865 5648 raft_consensus.cc:493] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.932005 5628 tablet_bootstrap.cc:492] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.932042 5648 raft_consensus.cc:515] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.932195 5628 ts_tablet_manager.cc:1403] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.052s user 0.015s sys 0.027s
I20260927 13:49:43.932775 5619 ts_tablet_manager.cc:1434] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.037s user 0.003s sys 0.000s
I20260927 13:49:43.932924 5648 leader_election.cc:290] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:43.933495 5628 raft_consensus.cc:359] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.933759 5628 raft_consensus.cc:385] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.933864 5628 raft_consensus.cc:740] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.934068 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9ac0e6083343debabc043435c54d95" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:43.934165 5628 consensus_queue.cc:260] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:43.934942 5185 leader_election.cc:343] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.934967 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9ac0e6083343debabc043435c54d95" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
W20260927 13:49:43.935483 5184 leader_election.cc:343] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:43.935972 5184 leader_election.cc:304] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:43.936851 5648 raft_consensus.cc:2749] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:43.937079 5619 tablet_bootstrap.cc:492] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:43.937696 5628 ts_tablet_manager.cc:1434] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260927 13:49:43.938648 5628 tablet_bootstrap.cc:492] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.940889 5628 tablet_bootstrap.cc:654] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.940888 5619 tablet_bootstrap.cc:654] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.942638 5623 ts_tablet_manager.cc:1929] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:43.946357 5623 log.cc:1199] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/6b2180cc05fd4fbbab6bfc0f0d45e096
I20260927 13:49:43.946924 5623 ts_tablet_manager.cc:1950] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:43.948377 5626 tablet_bootstrap.cc:492] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:43.948534 5626 ts_tablet_manager.cc:1403] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.071s user 0.012s sys 0.018s
I20260927 13:49:43.949025 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 6b2180cc05fd4fbbab6bfc0f0d45e096 (table default.Table_6a8d0b26fc9a4cfe901e0dbf641145b6 [id=13c9a4b16a83402c8747d4edee5faeb9]) successfully deleted
I20260927 13:49:43.949205 5626 raft_consensus.cc:359] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.949396 5626 raft_consensus.cc:385] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.949458 5626 raft_consensus.cc:740] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.949704 5626 consensus_queue.cc:260] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.950351 5628 tablet_bootstrap.cc:492] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.950510 5628 ts_tablet_manager.cc:1403] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260927 13:49:43.951265 5628 raft_consensus.cc:359] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.951472 5628 raft_consensus.cc:385] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.941473 5606 ts_tablet_manager.cc:1929] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:43.951577 5628 raft_consensus.cc:740] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:43.951673 5606 log.cc:1199] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/edb7c912138748e1a9afefec44e53773
I20260927 13:49:43.951874 5628 consensus_queue.cc:260] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.952112 5606 ts_tablet_manager.cc:1950] T edb7c912138748e1a9afefec44e53773 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:43.952893 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 7) took 1041 ms. Trace:
I20260927 13:49:43.953461 5628 ts_tablet_manager.cc:1434] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 13:49:43.953011 5606 rpcz_store.cc:276] 0927 13:49:42.911062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:42.911340 (+ 278us) service_pool.cc:224] Handling call
0927 13:49:43.809169 (+897829us) ts_tablet_manager.cc:1151] Deleting tablet edb7c912138748e1a9afefec44e53773
0927 13:49:43.809181 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:43.857913 (+ 48732us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:43.941391 (+ 83478us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:43.952834 (+ 11443us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":897553}
I20260927 13:49:43.953979 5626 ts_tablet_manager.cc:1434] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:43.954234 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet edb7c912138748e1a9afefec44e53773 (table default.Table_b89bb2c082214ce08e677bc80dcafd48 [id=80368d0a7e884f519deb250d73d6adc3]) successfully deleted
I20260927 13:49:43.954632 5606 tablet_replica.cc:333] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:43.954807 5626 tablet_bootstrap.cc:492] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:43.954830 5606 raft_consensus.cc:2243] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:43.955000 5606 raft_consensus.cc:2272] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:43.955363 5628 tablet_bootstrap.cc:492] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:43.955844 5606 ts_tablet_manager.cc:1916] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.957454 5628 tablet_bootstrap.cc:654] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.941627 5578 raft_consensus.cc:493] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:43.957964 5578 raft_consensus.cc:515] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:43.959170 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_bd3e5e5571784e99a29106527e6c7413" } new_table_name: "default.Table_ae1f534af970471bac44446c873faddb" modify_external_catalogs: true
W20260927 13:49:43.960456 4914 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet a1489f766164444b9aaa7b58e81a72d9 (table default.Table_055f1a3f79864929982c584ed6dec1e9 [id=2a104f24fe5e4ad8bfb52eb2dbdf9a8a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a1489f766164444b9aaa7b58e81a72d9 consensus state has no leader
I20260927 13:49:43.961985 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a4997f2056884ff7bb04abc30d72f75c" } new_table_name: "default.Table_6972bb0d54e5418c9b4bad3e385052ce" modify_external_catalogs: true
I20260927 13:49:43.964074 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a23fe407dd1047ca98d605e2cee52fdc" } modify_external_catalogs: true
I20260927 13:49:43.964211 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a23fe407dd1047ca98d605e2cee52fdc" } modify_external_catalogs: true
I20260927 13:49:43.967206 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 70d1197bee2d477ab77d15cbd4907595 (DEFAULT_TABLE table=default.Table_dfa3b09930634e67ba11591b71147d46 [id=bed97aef149a417bb3807414f58ba52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.967675 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d1197bee2d477ab77d15cbd4907595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.969394 4921 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d47c71b038c34a729ca20965d133c488 (table default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]). Expected version 2 got 0
I20260927 13:49:43.970242 5623 tablet_replica.cc:333] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:43.970463 5623 raft_consensus.cc:2243] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:43.971912 5080 tablet_service.cc:1511] Processing CreateTablet for tablet a61eedf06dab4096a397da8ce98a07da (DEFAULT_TABLE table=default.Table_62531a04ef9143aa9089eb9779aee6f5 [id=823e5f62db3849ce913eba29b20a4e0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.971925 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ba82da1367c447beadfb286a237a81de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:43.972285 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61eedf06dab4096a397da8ce98a07da. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:43.972429 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba82da1367c447beadfb286a237a81de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:43.973452 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4333e4f147f24db68f8d26c70e28f4a4" } modify_external_catalogs: true
I20260927 13:49:43.973600 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4333e4f147f24db68f8d26c70e28f4a4" } modify_external_catalogs: true
W20260927 13:49:43.973670 5319 leader_election.cc:343] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 6b2180cc05fd4fbbab6bfc0f0d45e096
I20260927 13:49:43.973816 5623 pending_rounds.cc:70] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:43.973997 5623 pending_rounds.cc:77] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957565012799488 op_type: NO_OP noop_request { }
I20260927 13:49:43.974134 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_281b42f84e80436bb5c29448bde434a7" } new_table_name: "default.Table_3511ad1c722940ca87a5e0807110230c" modify_external_catalogs: true
I20260927 13:49:43.974278 5578 leader_election.cc:290] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:43.946121 5574 raft_consensus.cc:697] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:43.975319 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 70d1197bee2d477ab77d15cbd4907595 (DEFAULT_TABLE table=default.Table_dfa3b09930634e67ba11591b71147d46 [id=bed97aef149a417bb3807414f58ba52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.975347 5574 consensus_queue.cc:237] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:43.975703 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d1197bee2d477ab77d15cbd4907595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.978394 5355 tablet_service.cc:1511] Processing CreateTablet for tablet a61eedf06dab4096a397da8ce98a07da (DEFAULT_TABLE table=default.Table_62531a04ef9143aa9089eb9779aee6f5 [id=823e5f62db3849ce913eba29b20a4e0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.978735 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61eedf06dab4096a397da8ce98a07da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.980885 5219 tablet_service.cc:1511] Processing CreateTablet for tablet a61eedf06dab4096a397da8ce98a07da (DEFAULT_TABLE table=default.Table_62531a04ef9143aa9089eb9779aee6f5 [id=823e5f62db3849ce913eba29b20a4e0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.981513 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61eedf06dab4096a397da8ce98a07da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.981593 5626 tablet_bootstrap.cc:654] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:43.986145 5623 raft_consensus.cc:2889] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:43.986352 5623 raft_consensus.cc:2272] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:43.986330 5319 leader_election.cc:343] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 6b2180cc05fd4fbbab6bfc0f0d45e096
I20260927 13:49:43.986461 5319 leader_election.cc:304] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:43.986589 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 70d1197bee2d477ab77d15cbd4907595 (DEFAULT_TABLE table=default.Table_dfa3b09930634e67ba11591b71147d46 [id=bed97aef149a417bb3807414f58ba52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:43.986888 5578 raft_consensus.cc:2749] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:43.987011 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d1197bee2d477ab77d15cbd4907595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:43.990260 5628 tablet_bootstrap.cc:492] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:43.990435 5628 ts_tablet_manager.cc:1403] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.007s
I20260927 13:49:43.991043 5623 ts_tablet_manager.cc:1916] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:43.991514 5628 raft_consensus.cc:359] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:43.991788 5628 raft_consensus.cc:385] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:43.991904 5628 raft_consensus.cc:740] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:49:43.996951 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32fa23c312544fac8ef485a35e5ab972 consensus state has no leader
I20260927 13:49:43.997416 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_87280d4336274cfe980ae3cd3148a0f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:43.998064 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87280d4336274cfe980ae3cd3148a0f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:43.999411 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11d303db711543e5ac23bfcd2279c993 consensus state has no leader
I20260927 13:49:43.999805 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f7b0ebc78f334f75b9104777be4c6c68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:43.999960 5672 raft_consensus.cc:493] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.000240 5672 raft_consensus.cc:515] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.001109 5672 leader_election.cc:290] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:44.001866 5648 raft_consensus.cc:493] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.001921 5628 consensus_queue.cc:260] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.002213 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d69f70750d4b418f850b2cec3ad721" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:44.003319 5045 leader_election.cc:343] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.004748 5628 ts_tablet_manager.cc:1434] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260927 13:49:44.007166 5628 tablet_bootstrap.cc:492] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.010195 5628 tablet_bootstrap.cc:654] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:44.012717 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7b0ebc78f334f75b9104777be4c6c68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.015805 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet d47c71b038c34a729ca20965d133c488
W20260927 13:49:44.018352 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4fe6a7394da94edf87166a184a9a04ba has no consensus state
I20260927 13:49:44.018873 5628 tablet_bootstrap.cc:492] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.018918 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet d47c71b038c34a729ca20965d133c488 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.019062 5628 ts_tablet_manager.cc:1403] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.002s
I20260927 13:49:44.014894 5619 tablet_bootstrap.cc:492] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:44.019305 5619 ts_tablet_manager.cc:1403] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.082s user 0.005s sys 0.001s
I20260927 13:49:44.019968 5628 raft_consensus.cc:359] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.020188 5628 raft_consensus.cc:385] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.020097 5619 raft_consensus.cc:359] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.020275 5628 raft_consensus.cc:740] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.020386 5619 raft_consensus.cc:385] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.020498 5619 raft_consensus.cc:740] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.020531 5628 consensus_queue.cc:260] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.021091 5619 consensus_queue.cc:260] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.022387 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet d47c71b038c34a729ca20965d133c488 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.022903 5625 tablet_replica.cc:333] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:44.022869 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5b8d20a834144e15bc76cbfce0c082b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.023415 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b8d20a834144e15bc76cbfce0c082b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.023102 5625 raft_consensus.cc:2243] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.023680 5625 raft_consensus.cc:2272] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.024734 5625 ts_tablet_manager.cc:1916] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.027993 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_69465bd5ea564d8f8e6621fb817f844b" } new_table_name: "default.Table_c06fd2ea93254d09a8daffb63dd4a4e5" modify_external_catalogs: true
I20260927 13:49:44.028544 5606 ts_tablet_manager.cc:1929] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:44.028676 5606 log.cc:1199] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/006021014dee43dcb17571b390a0a57e
I20260927 13:49:44.030646 5564 fs_manager.cc:714] Time spent opening directory manager: real 0.126s user 0.004s sys 0.006s
I20260927 13:49:44.035694 5619 ts_tablet_manager.cc:1434] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
W20260927 13:49:44.035768 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b8b80eb00244f7cbcc260af06c16a52 has no consensus state
I20260927 13:49:44.035722 5606 ts_tablet_manager.cc:1950] T 006021014dee43dcb17571b390a0a57e P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:44.036763 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 8) took 1125 ms. Trace:
I20260927 13:49:44.036957 5606 rpcz_store.cc:276] 0927 13:49:42.911172 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:42.911655 (+ 483us) service_pool.cc:224] Handling call
0927 13:49:43.954546 (+1042891us) ts_tablet_manager.cc:1151] Deleting tablet 006021014dee43dcb17571b390a0a57e
0927 13:49:43.954556 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:43.959741 (+ 5185us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.020874 (+ 61133us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.036717 (+ 15843us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1042699}
I20260927 13:49:44.037166 5619 tablet_bootstrap.cc:492] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:44.037660 5606 tablet_replica.cc:333] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:44.037868 5606 raft_consensus.cc:2243] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:44.038388 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 006021014dee43dcb17571b390a0a57e (table default.Table_7b645f63ae9f403f904da94ea2617bbb [id=c2aaf76e59ef492db6cea3ffe1e6187e]) successfully deleted
I20260927 13:49:44.038744 5606 raft_consensus.cc:2272] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.041616 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet f2622078288a47b4be4dea70d594b76c from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:44.042083 5619 tablet_bootstrap.cc:654] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.042364 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 11d303db711543e5ac23bfcd2279c993 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:44.044150 5606 ts_tablet_manager.cc:1916] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.050145 5625 ts_tablet_manager.cc:1929] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:44.050292 5625 log.cc:1199] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/d47c71b038c34a729ca20965d133c488
I20260927 13:49:44.051116 5628 ts_tablet_manager.cc:1434] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260927 13:49:44.052116 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c6d69f70750d4b418f850b2cec3ad721 (table default.Table_2bf2762db5414d409995b758091f66e7 [id=c2bdd45c34a24472b95b237d46efe194]). Expected version 2 got 0
I20260927 13:49:44.052371 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 11d303db711543e5ac23bfcd2279c993 (table default.Table_6972bb0d54e5418c9b4bad3e385052ce [id=8a1cfc06002240faae3fd4bb724fc5f4]). Expected version 2 got 0
I20260927 13:49:44.052528 4929 master_service.cc:960] ReplaceTablet: received request to replace tablet b0dfe23bef144e438ae762e401f02e8f from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:44.052634 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 991d0dcb68964df99b1bf5b43c890e28 (table default.Table_e62c62c5076f48649e29f13d0f577c64 [id=a8628dbf015640b9ad49c4aa66f46cac]). Expected version 1 got 0
I20260927 13:49:44.052850 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 79514522a9d142438fd6aecc91f0463e (table default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 4 got 0
I20260927 13:49:44.053063 5628 tablet_bootstrap.cc:492] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.053853 5591 raft_consensus.cc:493] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.054692 5591 raft_consensus.cc:515] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.054880 5628 tablet_bootstrap.cc:654] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.055850 5591 leader_election.cc:290] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.055927 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d69f70750d4b418f850b2cec3ad721" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:44.056305 5625 ts_tablet_manager.cc:1950] T d47c71b038c34a729ca20965d133c488 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:44.056239 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169e64b6e20544e6ad1bc31c7ec29cf2" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:44.057034 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169e64b6e20544e6ad1bc31c7ec29cf2" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.057184 5648 raft_consensus.cc:515] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.057334 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 14d3a3282d684415858dc971cb02eec1
I20260927 13:49:44.058009 5672 raft_consensus.cc:493] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.058164 5672 raft_consensus.cc:515] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.058223 5248 raft_consensus.cc:2468] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:44.058698 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet d47c71b038c34a729ca20965d133c488 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.058765 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet d47c71b038c34a729ca20965d133c488 (table default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]) successfully deleted
I20260927 13:49:44.058782 5672 leader_election.cc:290] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:44.059198 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d3a3282d684415858dc971cb02eec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.059969 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28309730c01944a7b0c5cecc478a448b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.060199 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d3a3282d684415858dc971cb02eec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.060433 5648 leader_election.cc:290] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:44.060551 5045 leader_election.cc:343] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:44.060612 5185 leader_election.cc:343] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.060964 5044 leader_election.cc:304] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.061026 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 7e6721aa2fa0437eae7ca052c19f0f2e from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:44.061240 5184 leader_election.cc:343] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.061415 5672 raft_consensus.cc:2804] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.061527 5672 raft_consensus.cc:493] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.061614 5672 raft_consensus.cc:3060] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.061658 5184 leader_election.cc:304] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.062309 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28309730c01944a7b0c5cecc478a448b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:44.062481 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4d56bd86f814c9ead4a52f133d1c818" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:44.062779 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4d56bd86f814c9ead4a52f133d1c818" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.063004 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet 991d0dcb68964df99b1bf5b43c890e28 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:44.063642 5248 raft_consensus.cc:2468] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:44.064078 5648 raft_consensus.cc:2749] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:44.064242 5184 leader_election.cc:343] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:44.064461 5185 leader_election.cc:343] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.064507 5672 raft_consensus.cc:515] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.064684 5185 leader_election.cc:304] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.065147 5044 leader_election.cc:304] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.065201 5648 raft_consensus.cc:2749] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:44.065539 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d69f70750d4b418f850b2cec3ad721" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:44.065577 5579 raft_consensus.cc:2804] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.065671 5626 tablet_bootstrap.cc:492] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:44.065685 5579 raft_consensus.cc:493] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.065761 5579 raft_consensus.cc:3060] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.065810 5626 ts_tablet_manager.cc:1403] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.111s user 0.001s sys 0.012s
I20260927 13:49:44.066666 5626 raft_consensus.cc:359] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.066834 5626 raft_consensus.cc:385] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.066919 5626 raft_consensus.cc:740] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.067178 5626 consensus_queue.cc:260] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.067469 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet ab9ac0e6083343debabc043435c54d95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.067729 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 28309730c01944a7b0c5cecc478a448b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.067945 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e77f460b73b46db86a22886b1200836 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.068118 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 55df2a9b30f04bc28eda3ff7c912df87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:42 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.069125 5579 raft_consensus.cc:515] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.070058 5672 leader_election.cc:290] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:44.070437 5579 leader_election.cc:290] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:44.070537 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a61eedf06dab4096a397da8ce98a07da
I20260927 13:49:44.070613 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28309730c01944a7b0c5cecc478a448b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:44.070938 5248 raft_consensus.cc:3060] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:44.071448 5045 leader_election.cc:343] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.071430 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d69f70750d4b418f850b2cec3ad721" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:44.071619 5247 raft_consensus.cc:3060] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.071748 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet a61eedf06dab4096a397da8ce98a07da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.073791 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28309730c01944a7b0c5cecc478a448b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:44.075038 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet a61eedf06dab4096a397da8ce98a07da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.075100 5696 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260927 13:49:44.075443 5045 leader_election.cc:343] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.075546 5626 ts_tablet_manager.cc:1434] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260927 13:49:44.076685 4922 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (table default.Table_13c484685fd1403fa4e825778a3ed2ca [id=c16d7a8a2339458b8c973cedf99c32bf]). Expected version 1 got 0
I20260927 13:49:44.077297 5626 tablet_bootstrap.cc:492] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:44.078912 5247 raft_consensus.cc:2468] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
W20260927 13:49:44.079013 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 14d3a3282d684415858dc971cb02eec1 because the tablet was not found. No further retry: Not found: Tablet not found: 14d3a3282d684415858dc971cb02eec1
I20260927 13:49:44.079375 5625 tablet_replica.cc:333] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:44.079586 5625 raft_consensus.cc:2243] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.079809 5625 raft_consensus.cc:2272] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.079924 5564 fs_manager.cc:730] Time spent opening block manager: real 0.040s user 0.001s sys 0.001s
I20260927 13:49:44.080080 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d3a3282d684415858dc971cb02eec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.080250 5574 raft_consensus.cc:493] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.080382 5044 leader_election.cc:304] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.080435 5574 raft_consensus.cc:515] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.080116 5564 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data,/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal
uuid: "13a42ae8b95b495c9bcea85d6732cd77"
format_stamp: "Formatted at 2026-09-27 13:49:38 on dist-test-slave-bkfv"
I20260927 13:49:44.081043 5579 raft_consensus.cc:2804] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.081194 5579 raft_consensus.cc:697] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:44.081489 4985 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 14d3a3282d684415858dc971cb02eec1
I20260927 13:49:44.081504 5579 consensus_queue.cc:237] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:44.081881 5319 leader_election.cc:343] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 03b87dca35654bbeb75695253d81f915
I20260927 13:49:44.082247 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d3a3282d684415858dc971cb02eec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.081081 5564 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 13:49:44.086902 5088 tablet_service.cc:1511] Processing CreateTablet for tablet e56df07d0a524e5184bdc7fc8d95857c (DEFAULT_TABLE table=default.Table_5e60c258bac24c7cabc2b7e1e6052193 [id=a160103a454d421c8be6a88afa7c1419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.086970 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet a61eedf06dab4096a397da8ce98a07da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.087327 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56df07d0a524e5184bdc7fc8d95857c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.087884 5248 raft_consensus.cc:2468] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:44.088388 5044 leader_election.cc:304] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.088449 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b87dca35654bbeb75695253d81f915" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:44.088668 5574 leader_election.cc:290] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:44.088867 5672 raft_consensus.cc:2804] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.093634 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d3a3282d684415858dc971cb02eec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.095346 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d3a3282d684415858dc971cb02eec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.096881 5247 raft_consensus.cc:2468] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:44.097900 5319 leader_election.cc:304] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:44.098453 5574 raft_consensus.cc:2804] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.098760 5648 raft_consensus.cc:493] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.098894 5648 raft_consensus.cc:515] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.098664 5574 raft_consensus.cc:493] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.099619 5574 raft_consensus.cc:3060] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.100310 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b0dfe23bef144e438ae762e401f02e8f
I20260927 13:49:44.100775 4929 catalog_manager.cc:6934] ReplaceTablet: tablet b0dfe23bef144e438ae762e401f02e8f deleted and replaced by tablet f9b019bbec5d40609dbf1c556cc26a63
I20260927 13:49:44.101428 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet b0dfe23bef144e438ae762e401f02e8f with delete_type TABLET_DATA_DELETED (replaced by tablet f9b019bbec5d40609dbf1c556cc26a63) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.101642 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6437470f54684ecab34ab24defbe6a83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.102308 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6437470f54684ecab34ab24defbe6a83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.102308 5625 ts_tablet_manager.cc:1916] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.103482 5574 raft_consensus.cc:515] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.103814 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 7e6721aa2fa0437eae7ca052c19f0f2e
I20260927 13:49:44.104286 4924 catalog_manager.cc:6934] ReplaceTablet: tablet 7e6721aa2fa0437eae7ca052c19f0f2e deleted and replaced by tablet 7dc612cbcd5d4755a188408f2a036f34
W20260927 13:49:44.105227 5319 leader_election.cc:343] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 03b87dca35654bbeb75695253d81f915
I20260927 13:49:44.105481 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e6721aa2fa0437eae7ca052c19f0f2e with delete_type TABLET_DATA_DELETED (replaced by tablet 7dc612cbcd5d4755a188408f2a036f34) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.106313 5619 tablet_bootstrap.cc:492] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:44.106341 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e6721aa2fa0437eae7ca052c19f0f2e with delete_type TABLET_DATA_DELETED (replaced by tablet 7dc612cbcd5d4755a188408f2a036f34) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.106580 5619 ts_tablet_manager.cc:1403] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.069s user 0.005s sys 0.000s
I20260927 13:49:44.106817 5623 ts_tablet_manager.cc:1929] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:44.106974 5574 leader_election.cc:290] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:44.106725 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a9cae6841bf84f09bdea303110cd78ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.107450 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9cae6841bf84f09bdea303110cd78ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.107801 5619 raft_consensus.cc:359] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.108047 5619 raft_consensus.cc:385] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.108143 5619 raft_consensus.cc:740] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.108474 5619 consensus_queue.cc:260] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.108798 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet b0dfe23bef144e438ae762e401f02e8f with delete_type TABLET_DATA_DELETED (replaced by tablet f9b019bbec5d40609dbf1c556cc26a63) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.110152 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b87dca35654bbeb75695253d81f915" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:44.111953 5355 tablet_service.cc:1511] Processing CreateTablet for tablet e56df07d0a524e5184bdc7fc8d95857c (DEFAULT_TABLE table=default.Table_5e60c258bac24c7cabc2b7e1e6052193 [id=a160103a454d421c8be6a88afa7c1419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.112411 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56df07d0a524e5184bdc7fc8d95857c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.112507 5619 ts_tablet_manager.cc:1434] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:49:44.114787 5606 ts_tablet_manager.cc:1929] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:44.114948 5606 log.cc:1199] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/7931267fae3a4a43abcbeeea42bb3ba2
I20260927 13:49:44.115482 5606 ts_tablet_manager.cc:1950] T 7931267fae3a4a43abcbeeea42bb3ba2 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:44.117717 5619 tablet_bootstrap.cc:492] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:44.117761 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8b80eb00244f7cbcc260af06c16a52 (DEFAULT_TABLE table=default.Table_c06fd2ea93254d09a8daffb63dd4a4e5 [id=5562b818949449e8ab5c21843d710d6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.118180 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8b80eb00244f7cbcc260af06c16a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.120508 5619 tablet_bootstrap.cc:654] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.121850 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 9) took 1210 ms. Trace:
I20260927 13:49:44.121950 5606 rpcz_store.cc:276] 0927 13:49:42.911288 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:42.911877 (+ 589us) service_pool.cc:224] Handling call
0927 13:49:44.037590 (+1125713us) ts_tablet_manager.cc:1151] Deleting tablet 7931267fae3a4a43abcbeeea42bb3ba2
0927 13:49:44.037601 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:44.048775 (+ 11174us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.114708 (+ 65933us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.121788 (+ 7080us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1125534}
I20260927 13:49:44.122380 5606 tablet_replica.cc:333] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:44.122447 5357 tablet_service.cc:1511] Processing CreateTablet for tablet c79b1f2962f44a23916bbfe4cf55a4bc (DEFAULT_TABLE table=default.Table_02bba441fd064165b917fff4a7cf4215 [id=d140ef61df2143d8bd6f44d8f92153c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.122627 5606 raft_consensus.cc:2243] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.122852 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79b1f2962f44a23916bbfe4cf55a4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.123893 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 7931267fae3a4a43abcbeeea42bb3ba2 (table default.Table_84797db80b3f4f079f839fac204e38ac [id=ca6cd336704b4d698e513e3e8b2b22f1]) successfully deleted
I20260927 13:49:44.124490 5350 tablet_service.cc:1511] Processing CreateTablet for tablet f443c863d087483493baa4c80bb64670 (DEFAULT_TABLE table=default.Table_885a1d72ea0640d48861b8228923ea8a [id=3653a6192dca4f8b9df5f4862eb512a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.124830 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f443c863d087483493baa4c80bb64670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.127199 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c06fd2ea93254d09a8daffb63dd4a4e5" } modify_external_catalogs: true
I20260927 13:49:44.127364 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c06fd2ea93254d09a8daffb63dd4a4e5" } modify_external_catalogs: true
I20260927 13:49:44.128739 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_335933f2be3646adb6c59ec7a41b61d1" } new_table_name: "default.Table_d8a6c02dc5f54a3cb24bb9cdb9d87eff" modify_external_catalogs: true
I20260927 13:49:44.129024 5625 ts_tablet_manager.cc:1929] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:44.129518 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_37c04afe28bb4bb29fca813d357662a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.130034 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37c04afe28bb4bb29fca813d357662a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.130389 5365 tablet_service.cc:1511] Processing CreateTablet for tablet b4bdd64d67d94276b20ab862dec0d2ee (DEFAULT_TABLE table=default.Table_335933f2be3646adb6c59ec7a41b61d1 [id=3a103249799f4a5383c5091fda81153e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.130757 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bdd64d67d94276b20ab862dec0d2ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.132370 5606 raft_consensus.cc:2272] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.133087 5606 ts_tablet_manager.cc:1916] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.134135 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 4295710c33714360b3691f48f47f4293 (DEFAULT_TABLE table=default.Table_dbc0fcbf67f64509b180433394be51f4 [id=2fe2768ea9264c38973e4ed5206c77f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.134511 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4295710c33714360b3691f48f47f4293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.130241 5628 tablet_bootstrap.cc:492] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.140556 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 14d3a3282d684415858dc971cb02eec1 (DEFAULT_TABLE table=default.Table_4333e4f147f24db68f8d26c70e28f4a4 [id=ff8466657bb24dd18b44b8d901412d8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.140683 5628 ts_tablet_manager.cc:1403] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.088s user 0.005s sys 0.008s
I20260927 13:49:44.140959 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d3a3282d684415858dc971cb02eec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.141474 5628 raft_consensus.cc:359] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.141649 5628 raft_consensus.cc:385] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.141729 5628 raft_consensus.cc:740] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.141978 5628 consensus_queue.cc:260] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.134061 5672 raft_consensus.cc:697] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:44.138909 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8b80eb00244f7cbcc260af06c16a52 (DEFAULT_TABLE table=default.Table_c06fd2ea93254d09a8daffb63dd4a4e5 [id=5562b818949449e8ab5c21843d710d6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.139305 5078 tablet_service.cc:1511] Processing CreateTablet for tablet c79b1f2962f44a23916bbfe4cf55a4bc (DEFAULT_TABLE table=default.Table_02bba441fd064165b917fff4a7cf4215 [id=d140ef61df2143d8bd6f44d8f92153c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.139607 5077 tablet_service.cc:1511] Processing CreateTablet for tablet f443c863d087483493baa4c80bb64670 (DEFAULT_TABLE table=default.Table_885a1d72ea0640d48861b8228923ea8a [id=3653a6192dca4f8b9df5f4862eb512a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.139916 5080 tablet_service.cc:1511] Processing CreateTablet for tablet b4bdd64d67d94276b20ab862dec0d2ee (DEFAULT_TABLE table=default.Table_335933f2be3646adb6c59ec7a41b61d1 [id=3a103249799f4a5383c5091fda81153e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.140234 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 4295710c33714360b3691f48f47f4293 (DEFAULT_TABLE table=default.Table_dbc0fcbf67f64509b180433394be51f4 [id=2fe2768ea9264c38973e4ed5206c77f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.144045 5628 ts_tablet_manager.cc:1434] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:44.145049 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 11d303db711543e5ac23bfcd2279c993
I20260927 13:49:44.145534 4921 catalog_manager.cc:6934] ReplaceTablet: tablet 11d303db711543e5ac23bfcd2279c993 deleted and replaced by tablet 7cb2864ea38b4a538884a2c728f08313
I20260927 13:49:44.145991 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2d2e604b60684aaf8e96c35bdebf8b2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.146586 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d2e604b60684aaf8e96c35bdebf8b2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.146517 4926 catalog_manager.cc:5838] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65). New cstate: current_term: 1 leader_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:44.147080 4926 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c6d69f70750d4b418f850b2cec3ad721 (table default.Table_2bf2762db5414d409995b758091f66e7 [id=c2bdd45c34a24472b95b237d46efe194]). Expected version 2 got 0
I20260927 13:49:44.148699 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 991d0dcb68964df99b1bf5b43c890e28
I20260927 13:49:44.148964 5672 consensus_queue.cc:237] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.149209 4923 catalog_manager.cc:6934] ReplaceTablet: tablet 991d0dcb68964df99b1bf5b43c890e28 deleted and replaced by tablet df271399b2c84653ac4a5b74efdc0197
I20260927 13:49:44.149727 5086 tablet_service.cc:1511] Processing CreateTablet for tablet e9b73420c2074d10ab2e78c6f15df93c (DEFAULT_TABLE table=default.Table_19cca2a50519472a82c4cd1940234797 [id=09f379b76b2f43c8853cd36c6b52e296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.150419 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79b1f2962f44a23916bbfe4cf55a4bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:44.151968 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b4bdd64d67d94276b20ab862dec0d2ee consensus state has no leader
I20260927 13:49:44.154304 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ee17c48a3ba7447594c552e6d7f13b1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:44.154336 5625 log.cc:1199] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/ab9ac0e6083343debabc043435c54d95
W20260927 13:49:44.154871 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee17c48a3ba7447594c552e6d7f13b1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.155669 5247 raft_consensus.cc:3060] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.156502 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 8b8b80eb00244f7cbcc260af06c16a52
I20260927 13:49:44.157300 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e6721aa2fa0437eae7ca052c19f0f2e with delete_type TABLET_DATA_DELETED (replaced by tablet 7dc612cbcd5d4755a188408f2a036f34) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.159117 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_1716b29ed09743aabc7f196195efefdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.159655 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1716b29ed09743aabc7f196195efefdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.161473 5227 tablet_service.cc:1511] Processing CreateTablet for tablet c79b1f2962f44a23916bbfe4cf55a4bc (DEFAULT_TABLE table=default.Table_02bba441fd064165b917fff4a7cf4215 [id=d140ef61df2143d8bd6f44d8f92153c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.161906 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79b1f2962f44a23916bbfe4cf55a4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.163702 5359 tablet_service.cc:1511] Processing CreateTablet for tablet e9b73420c2074d10ab2e78c6f15df93c (DEFAULT_TABLE table=default.Table_19cca2a50519472a82c4cd1940234797 [id=09f379b76b2f43c8853cd36c6b52e296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.164433 5623 log.cc:1199] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/0e77f460b73b46db86a22886b1200836
I20260927 13:49:44.166388 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2 (DEFAULT_TABLE table=default.Table_3ab0995080774a95967ee1d1ce7c9fdf [id=4dfd5d250a6f4ccd87ae40d6b0061394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.166667 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fae0c413e7439c9ab18b01628d8b28" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:44.166764 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 14d3a3282d684415858dc971cb02eec1 (DEFAULT_TABLE table=default.Table_4333e4f147f24db68f8d26c70e28f4a4 [id=ff8466657bb24dd18b44b8d901412d8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.166389 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8b80eb00244f7cbcc260af06c16a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.167404 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bdd64d67d94276b20ab862dec0d2ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.167654 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.167848 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f443c863d087483493baa4c80bb64670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.168059 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b73420c2074d10ab2e78c6f15df93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.168498 5220 tablet_service.cc:1511] Processing CreateTablet for tablet 4295710c33714360b3691f48f47f4293 (DEFAULT_TABLE table=default.Table_dbc0fcbf67f64509b180433394be51f4 [id=2fe2768ea9264c38973e4ed5206c77f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.168738 5224 tablet_service.cc:1511] Processing CreateTablet for tablet b4bdd64d67d94276b20ab862dec0d2ee (DEFAULT_TABLE table=default.Table_335933f2be3646adb6c59ec7a41b61d1 [id=3a103249799f4a5383c5091fda81153e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.175168 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4295710c33714360b3691f48f47f4293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.176360 4896 master_runner.cc:187] Error getting master registration for 127.4.163.126:42985: Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: connect: Connection refused (error 111),
I20260927 13:49:44.176566 4896 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260927 13:49:44.176774 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2 (DEFAULT_TABLE table=default.Table_3ab0995080774a95967ee1d1ce7c9fdf [id=4dfd5d250a6f4ccd87ae40d6b0061394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.177210 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fae0c413e7439c9ab18b01628d8b28" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.177371 5626 tablet_bootstrap.cc:654] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.178027 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe6a7394da94edf87166a184a9a04ba (DEFAULT_TABLE table=default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.164705 5226 tablet_service.cc:1511] Processing CreateTablet for tablet e56df07d0a524e5184bdc7fc8d95857c (DEFAULT_TABLE table=default.Table_5e60c258bac24c7cabc2b7e1e6052193 [id=a160103a454d421c8be6a88afa7c1419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.183415 5648 leader_election.cc:290] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.183470 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8b80eb00244f7cbcc260af06c16a52 (DEFAULT_TABLE table=default.Table_c06fd2ea93254d09a8daffb63dd4a4e5 [id=5562b818949449e8ab5c21843d710d6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.183563 5219 tablet_service.cc:1511] Processing CreateTablet for tablet f443c863d087483493baa4c80bb64670 (DEFAULT_TABLE table=default.Table_885a1d72ea0640d48861b8228923ea8a [id=3653a6192dca4f8b9df5f4862eb512a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.184959 4927 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet c6d69f70750d4b418f850b2cec3ad721 (table default.Table_2bf2762db5414d409995b758091f66e7 [id=c2bdd45c34a24472b95b237d46efe194]). Expected version 2 got 0
I20260927 13:49:44.185204 4927 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 32fa23c312544fac8ef485a35e5ab972 (table default.Table_ae1f534af970471bac44446c873faddb [id=a51ccdf3dce04c65b40dd44a1f8c16f1]). Expected version 1 got 0
I20260927 13:49:44.185513 4927 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 60fae0c413e7439c9ab18b01628d8b28 (table default.Table_88c5377676df4e3fb778d2781ed7a546 [id=36caa6d3649b47efb7e95cab54ca2608]). Expected version 1 got 0
I20260927 13:49:44.185684 4927 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (table default.Table_13c484685fd1403fa4e825778a3ed2ca [id=c16d7a8a2339458b8c973cedf99c32bf]). Expected version 1 got 0
I20260927 13:49:44.185927 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 169e64b6e20544e6ad1bc31c7ec29cf2
I20260927 13:49:44.189246 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bdd64d67d94276b20ab862dec0d2ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.191425 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b73420c2074d10ab2e78c6f15df93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.194132 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe6a7394da94edf87166a184a9a04ba (DEFAULT_TABLE table=default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.195453 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 14d3a3282d684415858dc971cb02eec1 (DEFAULT_TABLE table=default.Table_4333e4f147f24db68f8d26c70e28f4a4 [id=ff8466657bb24dd18b44b8d901412d8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.195782 5623 ts_tablet_manager.cc:1950] T 0e77f460b73b46db86a22886b1200836 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:44.196525 5628 tablet_bootstrap.cc:492] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.198860 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2 (DEFAULT_TABLE table=default.Table_3ab0995080774a95967ee1d1ce7c9fdf [id=4dfd5d250a6f4ccd87ae40d6b0061394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.199314 5619 tablet_bootstrap.cc:492] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:44.199385 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56df07d0a524e5184bdc7fc8d95857c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.199510 5619 ts_tablet_manager.cc:1403] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.082s user 0.004s sys 0.000s
I20260927 13:49:44.201171 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe6a7394da94edf87166a184a9a04ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.203193 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe6a7394da94edf87166a184a9a04ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.204090 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e62c62c5076f48649e29f13d0f577c64" } new_table_name: "default.Table_736d8b6f24974eeeb1ad1227ffda6ee6" modify_external_catalogs: true
I20260927 13:49:44.205780 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2bf2762db5414d409995b758091f66e7" } new_table_name: "default.Table_4da20456693f419d8b8a97398839d1b2" modify_external_catalogs: true
I20260927 13:49:44.207707 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 991d0dcb68964df99b1bf5b43c890e28 with delete_type TABLET_DATA_DELETED (replaced by tablet df271399b2c84653ac4a5b74efdc0197) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.207892 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 7681d137476040788e40dd787ce74ccd (DEFAULT_TABLE table=default.Table_5807eda64fd945a3b66fce9a479d46b3 [id=a22a9a93ae2543e583d24dd648813233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.209740 5247 raft_consensus.cc:2468] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:44.211544 5222 tablet_service.cc:1511] Processing CreateTablet for tablet e9b73420c2074d10ab2e78c6f15df93c (DEFAULT_TABLE table=default.Table_19cca2a50519472a82c4cd1940234797 [id=09f379b76b2f43c8853cd36c6b52e296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.214923 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f443c863d087483493baa4c80bb64670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.214886 5218 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe6a7394da94edf87166a184a9a04ba (DEFAULT_TABLE table=default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.215215 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4295710c33714360b3691f48f47f4293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.215441 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe6a7394da94edf87166a184a9a04ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.219172 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.219547 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 13) took 1084 ms. Trace:
I20260927 13:49:44.219682 5623 rpcz_store.cc:276] 0927 13:49:43.126159 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.131823 (+ 5664us) service_pool.cc:224] Handling call
0927 13:49:43.956783 (+824960us) ts_tablet_manager.cc:1151] Deleting tablet 0e77f460b73b46db86a22886b1200836
0927 13:49:43.970091 (+ 13308us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:44.048434 (+ 78343us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.097521 (+ 49087us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.210177 (+112656us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":824728}
I20260927 13:49:44.220193 5623 tablet_replica.cc:333] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:44.220404 5623 raft_consensus.cc:2243] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.220599 5623 raft_consensus.cc:2272] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.221235 5623 ts_tablet_manager.cc:1916] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.221468 5216 tablet_service.cc:1558] Processing DeleteTablet for tablet 11d303db711543e5ac23bfcd2279c993 with delete_type TABLET_DATA_DELETED (replaced by tablet 7cb2864ea38b4a538884a2c728f08313) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.221725 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b8b80eb00244f7cbcc260af06c16a52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.221948 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 169e64b6e20544e6ad1bc31c7ec29cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.213269 5319 leader_election.cc:304] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:44.214251 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 169e64b6e20544e6ad1bc31c7ec29cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.215081 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.222530 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 7681d137476040788e40dd787ce74ccd (DEFAULT_TABLE table=default.Table_5807eda64fd945a3b66fce9a479d46b3 [id=a22a9a93ae2543e583d24dd648813233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.209892 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b8b80eb00244f7cbcc260af06c16a52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.223973 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ba82da1367c447beadfb286a237a81de" } modify_external_catalogs: true
I20260927 13:49:44.224161 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ba82da1367c447beadfb286a237a81de" } modify_external_catalogs: true
I20260927 13:49:44.224336 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 0e77f460b73b46db86a22886b1200836 (table default.Table_36801d318ea44b4398972cc6f9427d76 [id=8b642dd68f9c4068997557886fcc338e]) successfully deleted
I20260927 13:49:44.224588 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 11d303db711543e5ac23bfcd2279c993 with delete_type TABLET_DATA_DELETED (replaced by tablet 7cb2864ea38b4a538884a2c728f08313) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.224799 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6213adb1d84a4dce99f1cc6d8a2828ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:44.224797 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet b0dfe23bef144e438ae762e401f02e8f with delete_type TABLET_DATA_DELETED (replaced by tablet f9b019bbec5d40609dbf1c556cc26a63) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:44.225133 5184 leader_election.cc:343] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:44.225374 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6213adb1d84a4dce99f1cc6d8a2828ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.225529 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 991d0dcb68964df99b1bf5b43c890e28 with delete_type TABLET_DATA_DELETED (replaced by tablet df271399b2c84653ac4a5b74efdc0197) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.221863 5619 raft_consensus.cc:359] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.226629 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b8b80eb00244f7cbcc260af06c16a52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.226799 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 169e64b6e20544e6ad1bc31c7ec29cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.226866 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5c508a45312941cdbcb08fdcb4a7bcce" } new_table_name: "default.Table_62b8129916de4fdeaddae3de476de360" modify_external_catalogs: true
I20260927 13:49:44.230149 5574 raft_consensus.cc:2804] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.231853 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7681d137476040788e40dd787ce74ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.232076 5619 raft_consensus.cc:385] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.237488 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_20d4690ba5644595ab69e0049b196531"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.238153 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20d4690ba5644595ab69e0049b196531 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.242841 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2e099697fd734011923ca7137a13608e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:44.243456 4930 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet c6d69f70750d4b418f850b2cec3ad721 (table default.Table_2bf2762db5414d409995b758091f66e7 [id=c2bdd45c34a24472b95b237d46efe194]). Expected version 2 got 0
W20260927 13:49:44.243510 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e099697fd734011923ca7137a13608e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.244647 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_37c04afe28bb4bb29fca813d357662a4" } new_table_name: "default.Table_abad46e19bc54aac8cf5415b2752c808" modify_external_catalogs: true
I20260927 13:49:44.246382 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_10932d72525a4a12a6543c89e1a3b19d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.246914 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10932d72525a4a12a6543c89e1a3b19d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.250972 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb5fdbfebd5401e92186997f9a30d36 (DEFAULT_TABLE table=default.Table_5b8d20a834144e15bc76cbfce0c082b8 [id=119de2adb4d24563b76c6099dec2d9a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.251668 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb5fdbfebd5401e92186997f9a30d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.252118 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb5fdbfebd5401e92186997f9a30d36 (DEFAULT_TABLE table=default.Table_5b8d20a834144e15bc76cbfce0c082b8 [id=119de2adb4d24563b76c6099dec2d9a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.254537 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 587471d2b7e647388e7bb1e7f8e06b40 (DEFAULT_TABLE table=default.Table_f7b0ebc78f334f75b9104777be4c6c68 [id=f44e5332ddd545c3b7e52da7a624181a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.255199 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 66524dd4f62f4da4be845d5efefe8db1 (DEFAULT_TABLE table=default.Table_87280d4336274cfe980ae3cd3148a0f6 [id=5b0f9f411500412ca8745dfe54c6cfe5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.256031 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587471d2b7e647388e7bb1e7f8e06b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.258440 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 399d6411d8ad4354b3c0f8f4d78779a9 (DEFAULT_TABLE table=default.Table_ba82da1367c447beadfb286a237a81de [id=3557e871819045648d0e38a96c9d6b52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.262666 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399d6411d8ad4354b3c0f8f4d78779a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.263427 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc612cbcd5d4755a188408f2a036f34 (DEFAULT_TABLE table=default.Table_6f09b6613d87411faca990bffef9d028 [id=7f846a3fd7cf4362870ca0e938dd45bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.264475 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc612cbcd5d4755a188408f2a036f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.265225 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 991d0dcb68964df99b1bf5b43c890e28 with delete_type TABLET_DATA_DELETED (replaced by tablet df271399b2c84653ac4a5b74efdc0197) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:44.265667 5185 leader_election.cc:343] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.265913 5185 leader_election.cc:304] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:44.266268 5185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 88379.3us
I20260927 13:49:44.266362 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 66524dd4f62f4da4be845d5efefe8db1 (DEFAULT_TABLE table=default.Table_87280d4336274cfe980ae3cd3148a0f6 [id=5b0f9f411500412ca8745dfe54c6cfe5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.266919 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d3a3282d684415858dc971cb02eec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.267802 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 7681d137476040788e40dd787ce74ccd (DEFAULT_TABLE table=default.Table_5807eda64fd945a3b66fce9a479d46b3 [id=a22a9a93ae2543e583d24dd648813233]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:44.269804 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df271399b2c84653ac4a5b74efdc0197 has no consensus state
I20260927 13:49:44.269932 5591 raft_consensus.cc:2749] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:44.270283 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8b80eb00244f7cbcc260af06c16a52. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:44.270361 5184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 58015.2us
I20260927 13:49:44.270366 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6f09b6613d87411faca990bffef9d028" } modify_external_catalogs: true
I20260927 13:49:44.270555 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6f09b6613d87411faca990bffef9d028" } modify_external_catalogs: true
I20260927 13:49:44.272002 5384 raft_consensus.cc:1275] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Refusing update from remote peer 79c1646c9659434b9a659382d2eb1d8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:44.272899 5219 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb5fdbfebd5401e92186997f9a30d36 (DEFAULT_TABLE table=default.Table_5b8d20a834144e15bc76cbfce0c082b8 [id=119de2adb4d24563b76c6099dec2d9a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.273425 5648 raft_consensus.cc:493] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.273845 5625 ts_tablet_manager.cc:1950] T ab9ac0e6083343debabc043435c54d95 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:44.274549 5648 raft_consensus.cc:515] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.275429 5648 leader_election.cc:290] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.275599 5574 raft_consensus.cc:697] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:44.275625 5648 consensus_queue.cc:1048] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:44.275875 5574 consensus_queue.cc:237] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.276763 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b73420c2074d10ab2e78c6f15df93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.276906 5591 raft_consensus.cc:493] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.277035 5619 raft_consensus.cc:740] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.277288 5619 consensus_queue.cc:260] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.277359 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet ab9ac0e6083343debabc043435c54d95 (table default.Table_b0efcc41c04d48689f399cff85ac589f [id=63d6c603fa31486b9e3ec4dcc74e0e57]) successfully deleted
I20260927 13:49:44.278352 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66524dd4f62f4da4be845d5efefe8db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.278885 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 66524dd4f62f4da4be845d5efefe8db1 (DEFAULT_TABLE table=default.Table_87280d4336274cfe980ae3cd3148a0f6 [id=5b0f9f411500412ca8745dfe54c6cfe5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.280906 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d3a3282d684415858dc971cb02eec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.282200 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7681d137476040788e40dd787ce74ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.282673 5591 raft_consensus.cc:515] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.285388 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 399d6411d8ad4354b3c0f8f4d78779a9 (DEFAULT_TABLE table=default.Table_ba82da1367c447beadfb286a237a81de [id=3557e871819045648d0e38a96c9d6b52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.285526 5625 tablet_replica.cc:333] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:44.285526 5591 leader_election.cc:290] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:44.286191 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 399d6411d8ad4354b3c0f8f4d78779a9 (DEFAULT_TABLE table=default.Table_ba82da1367c447beadfb286a237a81de [id=3557e871819045648d0e38a96c9d6b52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.287698 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991d0dcb68964df99b1bf5b43c890e28" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.289165 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399d6411d8ad4354b3c0f8f4d78779a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.292281 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7681d137476040788e40dd787ce74ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.294689 5628 tablet_bootstrap.cc:654] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.295205 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6721aa2fa0437eae7ca052c19f0f2e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:44.297762 5228 tablet_service.cc:1511] Processing CreateTablet for tablet 587471d2b7e647388e7bb1e7f8e06b40 (DEFAULT_TABLE table=default.Table_f7b0ebc78f334f75b9104777be4c6c68 [id=f44e5332ddd545c3b7e52da7a624181a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.301858 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet 11d303db711543e5ac23bfcd2279c993 with delete_type TABLET_DATA_DELETED (replaced by tablet 7cb2864ea38b4a538884a2c728f08313) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.302788 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6721aa2fa0437eae7ca052c19f0f2e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.303968 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb5fdbfebd5401e92186997f9a30d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.305327 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66524dd4f62f4da4be845d5efefe8db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.305325 5619 ts_tablet_manager.cc:1434] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.079s user 0.003s sys 0.000s
I20260927 13:49:44.306059 5625 raft_consensus.cc:2243] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:44.306789 5625 pending_rounds.cc:70] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: Trying to abort 1 pending ops.
I20260927 13:49:44.306905 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc612cbcd5d4755a188408f2a036f34 (DEFAULT_TABLE table=default.Table_6f09b6613d87411faca990bffef9d028 [id=7f846a3fd7cf4362870ca0e938dd45bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.306993 5625 pending_rounds.cc:77] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957567085043712 op_type: NO_OP noop_request { }
I20260927 13:49:44.307143 5625 raft_consensus.cc:2889] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:44.307291 5625 raft_consensus.cc:2272] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:44.308830 5184 leader_election.cc:343] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.308959 5619 tablet_bootstrap.cc:492] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:44.309365 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 587471d2b7e647388e7bb1e7f8e06b40 (DEFAULT_TABLE table=default.Table_f7b0ebc78f334f75b9104777be4c6c68 [id=f44e5332ddd545c3b7e52da7a624181a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:44.309201 5184 consensus_peers.cc:597] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d47c71b038c34a729ca20965d133c488. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:49:44.310551 5185 leader_election.cc:343] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.312013 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66524dd4f62f4da4be845d5efefe8db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.315796 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991d0dcb68964df99b1bf5b43c890e28" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:44.317711 5619 tablet_bootstrap.cc:654] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.318089 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587471d2b7e647388e7bb1e7f8e06b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.318265 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399d6411d8ad4354b3c0f8f4d78779a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.320282 5220 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc612cbcd5d4755a188408f2a036f34 (DEFAULT_TABLE table=default.Table_6f09b6613d87411faca990bffef9d028 [id=7f846a3fd7cf4362870ca0e938dd45bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.320830 5108 raft_consensus.cc:2468] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:44.321558 5184 leader_election.cc:304] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.322063 5591 raft_consensus.cc:2804] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.322228 5591 raft_consensus.cc:493] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.322372 5591 raft_consensus.cc:3060] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.326601 5626 tablet_bootstrap.cc:492] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:44.327319 5626 ts_tablet_manager.cc:1403] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.250s user 0.000s sys 0.013s
I20260927 13:49:44.328588 5626 raft_consensus.cc:359] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.328786 5626 raft_consensus.cc:385] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.328852 5626 raft_consensus.cc:740] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.329077 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc612cbcd5d4755a188408f2a036f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.329075 5626 consensus_queue.cc:260] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.329195 5087 tablet_service.cc:1511] Processing CreateTablet for tablet f9b019bbec5d40609dbf1c556cc26a63 (DEFAULT_TABLE table=default.Table_eae0be8d08ec43279ba35789c84b573c [id=599a7a50e2324466b865d11e66bc51bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.329648 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b019bbec5d40609dbf1c556cc26a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.329681 5626 ts_tablet_manager.cc:1434] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:44.329989 5626 tablet_bootstrap.cc:492] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:44.330453 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587471d2b7e647388e7bb1e7f8e06b40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:44.331825 5185 leader_election.cc:343] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.334520 5213 tablet_service.cc:1511] Processing CreateTablet for tablet f9b019bbec5d40609dbf1c556cc26a63 (DEFAULT_TABLE table=default.Table_eae0be8d08ec43279ba35789c84b573c [id=599a7a50e2324466b865d11e66bc51bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.335510 5185 leader_election.cc:304] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.336915 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc612cbcd5d4755a188408f2a036f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.337060 5591 raft_consensus.cc:515] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.339373 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991d0dcb68964df99b1bf5b43c890e28" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:44.340281 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb5fdbfebd5401e92186997f9a30d36. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:44.341113 5185 leader_election.cc:343] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.342314 5648 raft_consensus.cc:2749] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:44.343257 5707 consensus_queue.cc:1175] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260927 13:49:44.343914 5384 raft_consensus.cc:3060] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.344749 5625 ts_tablet_manager.cc:1916] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.349257 5247 raft_consensus.cc:1275] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Refusing update from remote peer 34fc5fe0a32d42ab83f4aa6d07341409: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:44.350678 5384 raft_consensus.cc:1275] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Refusing update from remote peer 34fc5fe0a32d42ab83f4aa6d07341409: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:44.352154 5648 raft_consensus.cc:493] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.352309 5648 raft_consensus.cc:515] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.354367 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79514522a9d142438fd6aecc91f0463e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.356838 5619 tablet_bootstrap.cc:492] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:44.356986 5619 ts_tablet_manager.cc:1403] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.002s
I20260927 13:49:44.357664 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b019bbec5d40609dbf1c556cc26a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.357759 5619 raft_consensus.cc:359] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.357945 5619 raft_consensus.cc:385] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.358007 5619 raft_consensus.cc:740] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.358300 5619 consensus_queue.cc:260] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:44.358393 5185 leader_election.cc:343] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.358798 5355 tablet_service.cc:1511] Processing CreateTablet for tablet f9b019bbec5d40609dbf1c556cc26a63 (DEFAULT_TABLE table=default.Table_eae0be8d08ec43279ba35789c84b573c [id=599a7a50e2324466b865d11e66bc51bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.359222 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b019bbec5d40609dbf1c556cc26a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.360241 5626 tablet_bootstrap.cc:654] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.361280 5591 leader_election.cc:290] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:44.359331 5648 leader_election.cc:290] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.367676 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991d0dcb68964df99b1bf5b43c890e28" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:44.369485 5579 consensus_queue.cc:1048] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260927 13:49:44.370842 5108 raft_consensus.cc:3060] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.367599 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79514522a9d142438fd6aecc91f0463e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:44.375355 5109 raft_consensus.cc:2468] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:44.375859 5184 leader_election.cc:304] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.376885 5606 ts_tablet_manager.cc:1929] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:44.377130 5672 consensus_queue.cc:1048] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260927 13:49:44.381760 5648 raft_consensus.cc:2804] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.381909 5648 raft_consensus.cc:493] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.382014 5648 raft_consensus.cc:3060] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.393078 4930 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a1489f766164444b9aaa7b58e81a72d9 (table default.Table_055f1a3f79864929982c584ed6dec1e9 [id=2a104f24fe5e4ad8bfb52eb2dbdf9a8a]). Expected version 1 got 0
I20260927 13:49:44.396754 4927 master_service.cc:960] ReplaceTablet: received request to replace tablet fbb2e0a01a9147d597693eab481ca73b from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:44.394048 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_055f1a3f79864929982c584ed6dec1e9" } modify_external_catalogs: true
I20260927 13:49:44.398051 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_055f1a3f79864929982c584ed6dec1e9" } modify_external_catalogs: true
I20260927 13:49:44.400341 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f2d64a3ffe674d5ebbab910acdf51b20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.400859 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2d64a3ffe674d5ebbab910acdf51b20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.407384 5108 raft_consensus.cc:2468] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:44.413144 5184 leader_election.cc:304] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.414240 5606 log.cc:1199] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/0e77f460b73b46db86a22886b1200836
I20260927 13:49:44.414722 5606 ts_tablet_manager.cc:1950] T 0e77f460b73b46db86a22886b1200836 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:44.415673 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 18) took 1413 ms. Trace:
I20260927 13:49:44.415906 5606 rpcz_store.cc:276] 0927 13:49:43.002282 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.003757 (+ 1475us) service_pool.cc:224] Handling call
0927 13:49:44.122282 (+1118525us) ts_tablet_manager.cc:1151] Deleting tablet 0e77f460b73b46db86a22886b1200836
0927 13:49:44.122295 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:44.322779 (+200484us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.376394 (+ 53615us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.415632 (+ 39238us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1118235}
I20260927 13:49:44.416518 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 0e77f460b73b46db86a22886b1200836 (table default.Table_36801d318ea44b4398972cc6f9427d76 [id=8b642dd68f9c4068997557886fcc338e]) successfully deleted
I20260927 13:49:44.416586 5606 tablet_replica.cc:333] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:44.416775 5606 raft_consensus.cc:2243] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.416955 5606 raft_consensus.cc:2272] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.417603 5606 ts_tablet_manager.cc:1916] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.421551 5648 raft_consensus.cc:515] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.422076 5702 mvcc.cc:204] Tried to move back new op lower bound from 7333957567564988416 to 7333957564575928320. Current Snapshot: MvccSnapshot[applied={T|T < 7333957567564988416}]
I20260927 13:49:44.402431 5619 ts_tablet_manager.cc:1434] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.045s user 0.000s sys 0.002s
I20260927 13:49:44.425038 5619 tablet_bootstrap.cc:492] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:44.426977 5625 ts_tablet_manager.cc:1929] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:44.427670 5619 tablet_bootstrap.cc:654] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.427735 5625 log.cc:1199] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/28309730c01944a7b0c5cecc478a448b
I20260927 13:49:44.430371 5625 ts_tablet_manager.cc:1950] T 28309730c01944a7b0c5cecc478a448b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:44.434442 5709 raft_consensus.cc:2804] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.434605 5709 raft_consensus.cc:697] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:44.434919 5709 consensus_queue.cc:237] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.435650 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 28309730c01944a7b0c5cecc478a448b (table default.Table_1ea0b188cadc40009b93843fdf653504 [id=c8c17ee713974f8099a439cb16a06056]) successfully deleted
I20260927 13:49:44.436744 5625 tablet_replica.cc:333] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:44.437309 5720 tablet.cc:1751] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:44.438457 5625 raft_consensus.cc:2243] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.439952 5625 raft_consensus.cc:2272] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.445185 5625 ts_tablet_manager.cc:1916] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.453617 5648 leader_election.cc:290] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.456326 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79514522a9d142438fd6aecc91f0463e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
W20260927 13:49:44.457042 5185 leader_election.cc:343] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.457834 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d895a1f615604afdb91fa57dc9ef7d10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.458487 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d895a1f615604afdb91fa57dc9ef7d10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.458784 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 399d6411d8ad4354b3c0f8f4d78779a9
I20260927 13:49:44.459735 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_dbc0fcbf67f64509b180433394be51f4" } new_table_name: "default.Table_97bdee39a93e4f98ae6382e7ab44eda7" modify_external_catalogs: true
W20260927 13:49:44.460237 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6c46d0e50a44232a82d00c88d9f63b5 has no consensus state
I20260927 13:49:44.460565 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a9cae6841bf84f09bdea303110cd78ad" } modify_external_catalogs: true
I20260927 13:49:44.460731 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a9cae6841bf84f09bdea303110cd78ad" } modify_external_catalogs: true
I20260927 13:49:44.461476 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_db24dbfc253c4e76ab35b8bb7770eb8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.461974 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db24dbfc253c4e76ab35b8bb7770eb8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.467823 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 399d6411d8ad4354b3c0f8f4d78779a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.468108 5225 tablet_service.cc:1558] Processing DeleteTablet for tablet 399d6411d8ad4354b3c0f8f4d78779a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.472899 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 399d6411d8ad4354b3c0f8f4d78779a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.475103 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet fbb2e0a01a9147d597693eab481ca73b
I20260927 13:49:44.475622 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 7dc612cbcd5d4755a188408f2a036f34
I20260927 13:49:44.475772 4927 catalog_manager.cc:6934] ReplaceTablet: tablet fbb2e0a01a9147d597693eab481ca73b deleted and replaced by tablet dce1bbbe9dbb443c9f0c001107ffebdf
I20260927 13:49:44.476001 4927 master_service.cc:960] ReplaceTablet: received request to replace tablet c6d69f70750d4b418f850b2cec3ad721 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:44.476141 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 60fae0c413e7439c9ab18b01628d8b28 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:44.476351 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4d67b784836e4d3b93bfc13e260f4761"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.476886 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d67b784836e4d3b93bfc13e260f4761 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.477592 5719 tablet.cc:1751] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 13:49:44.478699 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a1489f766164444b9aaa7b58e81a72d9
I20260927 13:49:44.475605 5731 tablet.cc:1751] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:44.479615 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_268838ff93954800813c2850f8dbef43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.480158 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_268838ff93954800813c2850f8dbef43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.480115 5628 tablet_bootstrap.cc:492] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.482450 5628 ts_tablet_manager.cc:1403] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.317s user 0.009s sys 0.008s
I20260927 13:49:44.483438 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc612cbcd5d4755a188408f2a036f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.483580 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet a1489f766164444b9aaa7b58e81a72d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.483043 5225 tablet_service.cc:1558] Processing DeleteTablet for tablet fbb2e0a01a9147d597693eab481ca73b with delete_type TABLET_DATA_DELETED (replaced by tablet dce1bbbe9dbb443c9f0c001107ffebdf) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.484467 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet a1489f766164444b9aaa7b58e81a72d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.484836 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc612cbcd5d4755a188408f2a036f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.486146 5730 tablet.cc:1751] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 13:49:44.488117 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet fbb2e0a01a9147d597693eab481ca73b with delete_type TABLET_DATA_DELETED (replaced by tablet dce1bbbe9dbb443c9f0c001107ffebdf) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.491129 5628 raft_consensus.cc:359] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.493832 5628 raft_consensus.cc:385] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.493978 5628 raft_consensus.cc:740] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.494345 5628 consensus_queue.cc:260] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.494933 5628 ts_tablet_manager.cc:1434] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260927 13:49:44.495504 5628 tablet_bootstrap.cc:492] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.497257 5733 tablet.cc:1751] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:44.491366 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc612cbcd5d4755a188408f2a036f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.495333 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet a1489f766164444b9aaa7b58e81a72d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.502192 5628 tablet_bootstrap.cc:654] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.490996 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet fbb2e0a01a9147d597693eab481ca73b with delete_type TABLET_DATA_DELETED (replaced by tablet dce1bbbe9dbb443c9f0c001107ffebdf) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.502034 5564 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260927 13:49:44.503974 5619 tablet_bootstrap.cc:492] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:44.504165 5619 ts_tablet_manager.cc:1403] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.079s user 0.000s sys 0.004s
I20260927 13:49:44.505013 5619 raft_consensus.cc:359] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.505266 5619 raft_consensus.cc:385] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.505399 5619 raft_consensus.cc:740] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.505687 5619 consensus_queue.cc:260] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.506301 5619 ts_tablet_manager.cc:1434] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:49:44.508545 5619 tablet_bootstrap.cc:492] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:44.511457 5628 tablet_bootstrap.cc:492] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.511574 5564 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 13:49:44.511689 5628 ts_tablet_manager.cc:1403] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.004s
I20260927 13:49:44.512784 5628 raft_consensus.cc:359] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.512744 5564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 13:49:44.513038 5628 raft_consensus.cc:385] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.513216 5628 raft_consensus.cc:740] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.513564 5628 consensus_queue.cc:260] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.514443 5628 ts_tablet_manager.cc:1434] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:44.514784 5628 tablet_bootstrap.cc:492] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.517306 5628 tablet_bootstrap.cc:654] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.520375 5619 tablet_bootstrap.cc:654] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.523710 5628 tablet_bootstrap.cc:492] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.523949 5628 ts_tablet_manager.cc:1403] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260927 13:49:44.524798 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_aca59e0ffb234d4c96a55c95d3e0967e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:44.524938 5628 raft_consensus.cc:359] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.525162 5628 raft_consensus.cc:385] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.525239 5628 raft_consensus.cc:740] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:49:44.525413 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aca59e0ffb234d4c96a55c95d3e0967e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.525521 5628 consensus_queue.cc:260] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:44.525607 5184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 96311.5us
I20260927 13:49:44.527732 5628 ts_tablet_manager.cc:1434] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 13:49:44.528215 5628 tablet_bootstrap.cc:492] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.530445 5628 tablet_bootstrap.cc:654] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.532840 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79514522a9d142438fd6aecc91f0463e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:44.533092 5108 raft_consensus.cc:3060] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.533262 5722 raft_consensus.cc:493] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:49:44.533654 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4295710c33714360b3691f48f47f4293 consensus state has no leader
I20260927 13:49:44.533921 4929 master_service.cc:960] ReplaceTablet: received request to replace tablet a1489f766164444b9aaa7b58e81a72d9 from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:44.523638 5319 consensus_peers.cc:597] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4c554f876d74be5b9667f373d832e50. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:44.547902 5709 raft_consensus.cc:493] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.552078 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f7b0ebc78f334f75b9104777be4c6c68" } modify_external_catalogs: true
I20260927 13:49:44.552299 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f7b0ebc78f334f75b9104777be4c6c68" } modify_external_catalogs: true
I20260927 13:49:44.564499 5619 tablet_bootstrap.cc:492] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:44.564790 5619 ts_tablet_manager.cc:1403] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.000s
I20260927 13:49:44.565459 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet c6d69f70750d4b418f850b2cec3ad721 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:44.565790 5108 raft_consensus.cc:2468] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:44.576736 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet c6d69f70750d4b418f850b2cec3ad721
I20260927 13:49:44.576828 5619 raft_consensus.cc:359] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.577033 5619 raft_consensus.cc:385] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.577111 5619 raft_consensus.cc:740] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.577325 4927 catalog_manager.cc:6934] ReplaceTablet: tablet c6d69f70750d4b418f850b2cec3ad721 deleted and replaced by tablet 0018704e08254c2e8d30c7067df4420c
I20260927 13:49:44.577401 5619 consensus_queue.cc:260] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.577665 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5807eda64fd945a3b66fce9a479d46b3" } new_table_name: "default.Table_2ffc2d6e22ae4c8a995011874dc6cde0" modify_external_catalogs: true
I20260927 13:49:44.580070 5619 ts_tablet_manager.cc:1434] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260927 13:49:44.580482 5619 tablet_bootstrap.cc:492] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:44.580734 4928 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 32fa23c312544fac8ef485a35e5ab972 (table default.Table_ae1f534af970471bac44446c873faddb [id=a51ccdf3dce04c65b40dd44a1f8c16f1]). Expected version 1 got 0
I20260927 13:49:44.582369 5619 tablet_bootstrap.cc:654] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.583374 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d69f70750d4b418f850b2cec3ad721 with delete_type TABLET_DATA_DELETED (replaced by tablet 0018704e08254c2e8d30c7067df4420c) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.586285 5709 raft_consensus.cc:515] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.587558 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d69f70750d4b418f850b2cec3ad721 with delete_type TABLET_DATA_DELETED (replaced by tablet 0018704e08254c2e8d30c7067df4420c) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.587980 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 2801473216a3475384d1494892b8df7b (DEFAULT_TABLE table=default.Table_2d2e604b60684aaf8e96c35bdebf8b2e [id=aa9bfeb5b20c499d9897f950fa6db2a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.587044 5709 leader_election.cc:290] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:44.588403 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2801473216a3475384d1494892b8df7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.588725 5626 tablet_bootstrap.cc:492] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:44.552582 5722 raft_consensus.cc:515] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.590221 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fa23c312544fac8ef485a35e5ab972" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.590412 5384 raft_consensus.cc:2468] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:44.587584 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d57824aab9460b83f912d9c9c8dd68" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.590436 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 85805d532ffa4c79974ce25041a72205 (DEFAULT_TABLE table=default.Table_ee17c48a3ba7447594c552e6d7f13b1a [id=eb074c2c15c542e59ca9fb68049ac69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.591032 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85805d532ffa4c79974ce25041a72205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.592069 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 85805d532ffa4c79974ce25041a72205 (DEFAULT_TABLE table=default.Table_ee17c48a3ba7447594c552e6d7f13b1a [id=eb074c2c15c542e59ca9fb68049ac69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.592885 5628 tablet_bootstrap.cc:492] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.592983 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 3663033220094a4ea6df8e2982eb2188 (DEFAULT_TABLE table=default.Table_a9cae6841bf84f09bdea303110cd78ad [id=17e5201d16ce4ce59807538c4e68b495]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.593063 5628 ts_tablet_manager.cc:1403] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.065s user 0.017s sys 0.021s
I20260927 13:49:44.593480 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 2801473216a3475384d1494892b8df7b (DEFAULT_TABLE table=default.Table_2d2e604b60684aaf8e96c35bdebf8b2e [id=aa9bfeb5b20c499d9897f950fa6db2a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.590596 5385 raft_consensus.cc:2468] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:44.594179 5185 leader_election.cc:304] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:44.594153 5628 raft_consensus.cc:359] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.594388 5628 raft_consensus.cc:385] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.594486 5628 raft_consensus.cc:740] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.594749 5628 consensus_queue.cc:260] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.595925 5628 ts_tablet_manager.cc:1434] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260927 13:49:44.596292 5628 tablet_bootstrap.cc:492] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.598937 4926 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 79514522a9d142438fd6aecc91f0463e (table default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 4 got 0
I20260927 13:49:44.599642 5628 tablet_bootstrap.cc:654] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.605065 5623 ts_tablet_manager.cc:1929] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:44.605230 5623 log.cc:1199] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/ab9ac0e6083343debabc043435c54d95
I20260927 13:49:44.588507 5721 tablet.cc:1751] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:44.608664 5184 leader_election.cc:304] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.610211 5732 tablet.cc:1751] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:44.610664 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d69f70750d4b418f850b2cec3ad721 with delete_type TABLET_DATA_DELETED (replaced by tablet 0018704e08254c2e8d30c7067df4420c) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.610827 5591 raft_consensus.cc:2804] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.612418 5591 raft_consensus.cc:697] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:44.608278 5740 tablet.cc:1751] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 13:49:44.614660 5357 tablet_service.cc:1511] Processing CreateTablet for tablet d6c46d0e50a44232a82d00c88d9f63b5 (DEFAULT_TABLE table=default.Table_abad46e19bc54aac8cf5415b2752c808 [id=e65860898b9041118d5fbb8b5aef2df4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.615208 5355 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2ba67436a544e98788e9c1b00a1c33 (DEFAULT_TABLE table=default.Table_1716b29ed09743aabc7f196195efefdf [id=ec11e094cff046098922a5d559575bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.616333 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2ba67436a544e98788e9c1b00a1c33 (DEFAULT_TABLE table=default.Table_1716b29ed09743aabc7f196195efefdf [id=ec11e094cff046098922a5d559575bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.616495 5219 tablet_service.cc:1511] Processing CreateTablet for tablet 2801473216a3475384d1494892b8df7b (DEFAULT_TABLE table=default.Table_2d2e604b60684aaf8e96c35bdebf8b2e [id=aa9bfeb5b20c499d9897f950fa6db2a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.616335 5080 tablet_service.cc:1511] Processing CreateTablet for tablet d6c46d0e50a44232a82d00c88d9f63b5 (DEFAULT_TABLE table=default.Table_abad46e19bc54aac8cf5415b2752c808 [id=e65860898b9041118d5fbb8b5aef2df4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.617568 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 3663033220094a4ea6df8e2982eb2188 (DEFAULT_TABLE table=default.Table_a9cae6841bf84f09bdea303110cd78ad [id=17e5201d16ce4ce59807538c4e68b495]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:44.619292 5184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 45273us
I20260927 13:49:44.620484 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fa23c312544fac8ef485a35e5ab972" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:44.620708 5619 tablet_bootstrap.cc:492] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:44.620873 5619 ts_tablet_manager.cc:1403] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260927 13:49:44.622880 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_50e65c3a129d4d739bd94828014ddfc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:44.623343 5626 ts_tablet_manager.cc:1403] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.259s user 0.003s sys 0.014s
W20260927 13:49:44.623477 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50e65c3a129d4d739bd94828014ddfc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.623517 5709 raft_consensus.cc:2804] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.623627 5709 raft_consensus.cc:493] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.624711 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_02bba441fd064165b917fff4a7cf4215" } new_table_name: "default.Table_847c101270804f9f856b7e564cc9fbbe" modify_external_catalogs: true
I20260927 13:49:44.624713 5619 raft_consensus.cc:359] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.624927 5619 raft_consensus.cc:385] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.625099 5619 raft_consensus.cc:740] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.625357 5619 consensus_queue.cc:260] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.626637 5628 tablet_bootstrap.cc:492] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.626823 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2801473216a3475384d1494892b8df7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.627013 5628 ts_tablet_manager.cc:1403] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.002s
I20260927 13:49:44.628079 5628 raft_consensus.cc:359] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.628330 5628 raft_consensus.cc:385] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.628412 5628 raft_consensus.cc:740] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.628687 5628 consensus_queue.cc:260] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.630154 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 587471d2b7e647388e7bb1e7f8e06b40
I20260927 13:49:44.630973 5628 ts_tablet_manager.cc:1434] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:44.631351 5628 tablet_bootstrap.cc:492] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.631603 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 587471d2b7e647388e7bb1e7f8e06b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.631994 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 3663033220094a4ea6df8e2982eb2188
I20260927 13:49:44.632898 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 3663033220094a4ea6df8e2982eb2188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.633270 5591 consensus_queue.cc:237] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.633948 5722 leader_election.cc:290] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.634441 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 587471d2b7e647388e7bb1e7f8e06b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.634529 5185 leader_election.cc:304] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:44.634745 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 3663033220094a4ea6df8e2982eb2188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:44.636026 5184 leader_election.cc:343] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 93d57824aab9460b83f912d9c9c8dd68
W20260927 13:49:44.636438 5184 leader_election.cc:343] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.637151 5700 raft_consensus.cc:493] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.637192 5709 raft_consensus.cc:3060] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.637317 5700 raft_consensus.cc:515] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.637535 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 85805d532ffa4c79974ce25041a72205 (DEFAULT_TABLE table=default.Table_ee17c48a3ba7447594c552e6d7f13b1a [id=eb074c2c15c542e59ca9fb68049ac69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.637843 5623 ts_tablet_manager.cc:1950] T ab9ac0e6083343debabc043435c54d95 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:44.638100 5700 leader_election.cc:290] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.638159 5228 tablet_service.cc:1511] Processing CreateTablet for tablet 3663033220094a4ea6df8e2982eb2188 (DEFAULT_TABLE table=default.Table_a9cae6841bf84f09bdea303110cd78ad [id=17e5201d16ce4ce59807538c4e68b495]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.638680 5700 raft_consensus.cc:493] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.638756 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2622078288a47b4be4dea70d594b76c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.638823 5700 raft_consensus.cc:515] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:44.639304 5045 leader_election.cc:343] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.639405 5700 leader_election.cc:290] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.639989 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fae0c413e7439c9ab18b01628d8b28" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.640231 5384 raft_consensus.cc:2468] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:44.640200 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_736d8b6f24974eeeb1ad1227ffda6ee6" } new_table_name: "default.Table_4a67727b46b74c27a439bc32c6cb411f" modify_external_catalogs: true
I20260927 13:49:44.640340 5220 tablet_service.cc:1511] Processing CreateTablet for tablet d6c46d0e50a44232a82d00c88d9f63b5 (DEFAULT_TABLE table=default.Table_abad46e19bc54aac8cf5415b2752c808 [id=e65860898b9041118d5fbb8b5aef2df4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.640816 5045 leader_election.cc:304] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:44.641247 5722 raft_consensus.cc:2804] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.641448 5700 raft_consensus.cc:2804] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.641551 5700 raft_consensus.cc:493] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.641682 5700 raft_consensus.cc:3060] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.643018 5628 tablet_bootstrap.cc:654] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.644167 5722 raft_consensus.cc:493] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.644284 5722 raft_consensus.cc:3060] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.645466 5727 consensus_queue.cc:1048] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260927 13:49:44.647449 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2622078288a47b4be4dea70d594b76c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:44.647650 5248 raft_consensus.cc:2468] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:44.648169 5626 raft_consensus.cc:359] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.648417 5626 raft_consensus.cc:385] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.648516 5626 raft_consensus.cc:740] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.648600 5044 leader_election.cc:304] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.648684 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fae0c413e7439c9ab18b01628d8b28" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:44.648852 5248 raft_consensus.cc:2468] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:44.648810 5626 consensus_queue.cc:260] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.649089 5672 raft_consensus.cc:2804] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.649169 5672 raft_consensus.cc:493] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.649255 5672 raft_consensus.cc:3060] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.655385 5351 tablet_service.cc:1511] Processing CreateTablet for tablet df271399b2c84653ac4a5b74efdc0197 (DEFAULT_TABLE table=default.Table_736d8b6f24974eeeb1ad1227ffda6ee6 [id=a8628dbf015640b9ad49c4aa66f46cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.657699 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 60fae0c413e7439c9ab18b01628d8b28
I20260927 13:49:44.658322 4921 catalog_manager.cc:6934] ReplaceTablet: tablet 60fae0c413e7439c9ab18b01628d8b28 deleted and replaced by tablet 7a4b7500f05e4b63b4d79fabde88ebe6
I20260927 13:49:44.660820 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 60fae0c413e7439c9ab18b01628d8b28 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a4b7500f05e4b63b4d79fabde88ebe6) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.664489 5625 ts_tablet_manager.cc:1929] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:44.664511 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2ba67436a544e98788e9c1b00a1c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.664661 5625 log.cc:1199] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/0e77f460b73b46db86a22886b1200836
I20260927 13:49:44.665380 5625 ts_tablet_manager.cc:1950] T 0e77f460b73b46db86a22886b1200836 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:44.665570 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c46d0e50a44232a82d00c88d9f63b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.665642 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 3663033220094a4ea6df8e2982eb2188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.665598 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 587471d2b7e647388e7bb1e7f8e06b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:44.666076 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7681d137476040788e40dd787ce74ccd consensus state has no leader
I20260927 13:49:44.666739 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 60fae0c413e7439c9ab18b01628d8b28 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a4b7500f05e4b63b4d79fabde88ebe6) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:44.667197 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2ba67436a544e98788e9c1b00a1c33 (DEFAULT_TABLE table=default.Table_1716b29ed09743aabc7f196195efefdf [id=ec11e094cff046098922a5d559575bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.667312 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3663033220094a4ea6df8e2982eb2188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.667783 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c46d0e50a44232a82d00c88d9f63b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.667955 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2801473216a3475384d1494892b8df7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.668365 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2ba67436a544e98788e9c1b00a1c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.668964 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df271399b2c84653ac4a5b74efdc0197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.669958 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85805d532ffa4c79974ce25041a72205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.671641 5727 raft_consensus.cc:493] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.671797 5727 raft_consensus.cc:515] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.672227 5722 raft_consensus.cc:515] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.672605 5727 leader_election.cc:290] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.672717 5722 leader_election.cc:290] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.672941 5709 raft_consensus.cc:515] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.675146 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bf85c1c2254063a1ffc0b7bf97eb38" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.675282 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 60fae0c413e7439c9ab18b01628d8b28 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a4b7500f05e4b63b4d79fabde88ebe6) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.675806 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bf85c1c2254063a1ffc0b7bf97eb38" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:44.675988 5109 raft_consensus.cc:2468] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:44.676208 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet b4d56bd86f814c9ead4a52f133d1c818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.676277 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fa23c312544fac8ef485a35e5ab972" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:44.676420 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fa23c312544fac8ef485a35e5ab972" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:44.676628 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:44.676635 5382 raft_consensus.cc:3060] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.679654 5382 raft_consensus.cc:2468] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:44.680635 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2ba67436a544e98788e9c1b00a1c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.680994 5184 leader_election.cc:304] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
W20260927 13:49:44.681290 5184 leader_election.cc:343] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:44.681486 5184 leader_election.cc:343] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 93d57824aab9460b83f912d9c9c8dd68
I20260927 13:49:44.680075 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d57824aab9460b83f912d9c9c8dd68" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:44.681809 5381 raft_consensus.cc:3060] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.682255 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85805d532ffa4c79974ce25041a72205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.682688 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3663033220094a4ea6df8e2982eb2188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.684690 5381 raft_consensus.cc:2468] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
W20260927 13:49:44.684900 5185 leader_election.cc:343] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.684959 5578 raft_consensus.cc:493] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.685073 5578 raft_consensus.cc:515] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.685316 5185 leader_election.cc:304] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:44.685678 5578 leader_election.cc:290] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:44.686599 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991d0dcb68964df99b1bf5b43c890e28" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:44.686868 5107 raft_consensus.cc:2393] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 79c1646c9659434b9a659382d2eb1d8a in this term.
I20260927 13:49:44.686897 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c46d0e50a44232a82d00c88d9f63b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.686666 5628 tablet_bootstrap.cc:492] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.689587 5628 ts_tablet_manager.cc:1403] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.058s user 0.005s sys 0.000s
I20260927 13:49:44.691506 5628 raft_consensus.cc:359] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.691807 5628 raft_consensus.cc:385] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.691912 5628 raft_consensus.cc:740] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.693601 5672 raft_consensus.cc:515] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.694543 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 21) took 1424 ms. Trace:
I20260927 13:49:44.694664 5623 rpcz_store.cc:276] 0927 13:49:43.270457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.278752 (+ 8295us) service_pool.cc:224] Handling call
0927 13:49:44.220082 (+941330us) ts_tablet_manager.cc:1151] Deleting tablet ab9ac0e6083343debabc043435c54d95
0927 13:49:44.220093 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:44.489560 (+269467us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.565520 (+ 75960us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.694503 (+128983us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":941092}
I20260927 13:49:44.695108 5623 tablet_replica.cc:333] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:44.696041 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991d0dcb68964df99b1bf5b43c890e28" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:44.696278 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_aa90b9036c924ed0a69d948a3f3f2d87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.696913 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa90b9036c924ed0a69d948a3f3f2d87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.696877 5319 leader_election.cc:304] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:44.697324 5578 raft_consensus.cc:3060] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.698515 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2622078288a47b4be4dea70d594b76c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:44.695678 5700 raft_consensus.cc:515] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.701177 5672 leader_election.cc:290] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.701421 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_791bee87bef64e35bb7c22d8611be6d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.702049 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_791bee87bef64e35bb7c22d8611be6d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.703845 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2e099697fd734011923ca7137a13608e" } modify_external_catalogs: true
I20260927 13:49:44.704048 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2e099697fd734011923ca7137a13608e" } modify_external_catalogs: true
I20260927 13:49:44.705394 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4da20456693f419d8b8a97398839d1b2" } new_table_name: "default.Table_1b911492fead4445a3aeb96fa99d8de2" modify_external_catalogs: true
I20260927 13:49:44.706647 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c657bd1ec67f4e679366f14cdc7aff3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.707136 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c657bd1ec67f4e679366f14cdc7aff3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.708395 5081 tablet_service.cc:1511] Processing CreateTablet for tablet df271399b2c84653ac4a5b74efdc0197 (DEFAULT_TABLE table=default.Table_736d8b6f24974eeeb1ad1227ffda6ee6 [id=a8628dbf015640b9ad49c4aa66f46cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.708822 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df271399b2c84653ac4a5b74efdc0197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.710031 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6437470f54684ecab34ab24defbe6a83" } modify_external_catalogs: true
I20260927 13:49:44.710247 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6437470f54684ecab34ab24defbe6a83" } modify_external_catalogs: true
I20260927 13:49:44.698251 5731 tablet.cc:1751] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:44.712867 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ae1f534af970471bac44446c873faddb" } modify_external_catalogs: true
I20260927 13:49:44.713027 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ae1f534af970471bac44446c873faddb" } modify_external_catalogs: true
I20260927 13:49:44.713694 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fae0c413e7439c9ab18b01628d8b28" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:44.713891 5385 raft_consensus.cc:3060] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:44.714316 5045 leader_election.cc:343] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.715298 5730 tablet.cc:1751] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:44.715811 5628 consensus_queue.cc:260] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.712457 5700 leader_election.cc:290] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.716892 5385 raft_consensus.cc:2468] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:44.717773 5185 leader_election.cc:304] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:44.718212 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fae0c413e7439c9ab18b01628d8b28" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:44.719166 5247 raft_consensus.cc:3060] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.721659 5628 ts_tablet_manager.cc:1434] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.032s user 0.003s sys 0.000s
I20260927 13:49:44.722597 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb2864ea38b4a538884a2c728f08313 (DEFAULT_TABLE table=default.Table_6972bb0d54e5418c9b4bad3e385052ce [id=8a1cfc06002240faae3fd4bb724fc5f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.723335 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb2864ea38b4a538884a2c728f08313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.723378 5625 tablet_replica.cc:333] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:44.723568 5625 raft_consensus.cc:2243] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.723749 5625 raft_consensus.cc:2272] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.724323 5625 ts_tablet_manager.cc:1916] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.724947 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 0e77f460b73b46db86a22886b1200836 (table default.Table_36801d318ea44b4398972cc6f9427d76 [id=8b642dd68f9c4068997557886fcc338e]) successfully deleted
I20260927 13:49:44.726629 5045 leader_election.cc:304] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:44.727046 5579 raft_consensus.cc:2804] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.727190 5579 raft_consensus.cc:697] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:44.727478 5628 tablet_bootstrap.cc:492] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.727511 5579 consensus_queue.cc:237] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.729598 5628 tablet_bootstrap.cc:654] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.732816 5625 ts_tablet_manager.cc:1929] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:44.739683 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet ab9ac0e6083343debabc043435c54d95 (table default.Table_b0efcc41c04d48689f399cff85ac589f [id=63d6c603fa31486b9e3ec4dcc74e0e57]) successfully deleted
I20260927 13:49:44.741504 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb2864ea38b4a538884a2c728f08313 (DEFAULT_TABLE table=default.Table_6972bb0d54e5418c9b4bad3e385052ce [id=8a1cfc06002240faae3fd4bb724fc5f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.743194 5083 tablet_service.cc:1511] Processing CreateTablet for tablet b95399b042654100a609427597d6fe72 (DEFAULT_TABLE table=default.Table_6437470f54684ecab34ab24defbe6a83 [id=c0b49915096e4176b4ff5ec9e6faa830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.743752 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95399b042654100a609427597d6fe72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.750502 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3663033220094a4ea6df8e2982eb2188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.722230 5648 raft_consensus.cc:2804] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.751375 5648 raft_consensus.cc:493] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.751475 5648 raft_consensus.cc:3060] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.751829 5628 tablet_bootstrap.cc:492] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.752100 5628 ts_tablet_manager.cc:1403] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.003s
I20260927 13:49:44.753211 5628 raft_consensus.cc:359] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.753473 5628 raft_consensus.cc:385] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.753575 5628 raft_consensus.cc:740] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.753902 5628 consensus_queue.cc:260] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.722097 5247 raft_consensus.cc:2468] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:44.722517 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2622078288a47b4be4dea70d594b76c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:44.754554 5248 raft_consensus.cc:3060] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.754735 5628 ts_tablet_manager.cc:1434] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:44.755192 5628 tablet_bootstrap.cc:492] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.757462 5248 raft_consensus.cc:2468] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:44.728717 5727 raft_consensus.cc:2804] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.757846 5727 raft_consensus.cc:697] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:44.757884 5628 tablet_bootstrap.cc:654] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.758138 5727 consensus_queue.cc:237] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.728906 5591 raft_consensus.cc:2804] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.760064 5044 leader_election.cc:304] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.738166 5213 tablet_service.cc:1511] Processing CreateTablet for tablet df271399b2c84653ac4a5b74efdc0197 (DEFAULT_TABLE table=default.Table_736d8b6f24974eeeb1ad1227ffda6ee6 [id=a8628dbf015640b9ad49c4aa66f46cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.760481 5750 raft_consensus.cc:2804] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.760643 5750 raft_consensus.cc:697] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:44.760708 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df271399b2c84653ac4a5b74efdc0197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.761062 5648 raft_consensus.cc:515] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.761004 5750 consensus_queue.cc:237] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.761946 5648 leader_election.cc:290] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.738169 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb2864ea38b4a538884a2c728f08313 (DEFAULT_TABLE table=default.Table_6972bb0d54e5418c9b4bad3e385052ce [id=8a1cfc06002240faae3fd4bb724fc5f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.765106 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb2864ea38b4a538884a2c728f08313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.768559 5578 raft_consensus.cc:2749] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:44.771034 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bf85c1c2254063a1ffc0b7bf97eb38" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:44.771260 5107 raft_consensus.cc:3060] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.772958 5628 tablet_bootstrap.cc:492] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.773993 5628 ts_tablet_manager.cc:1403] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.002s
I20260927 13:49:44.776542 5628 raft_consensus.cc:359] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.776733 5628 raft_consensus.cc:385] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.776865 5628 raft_consensus.cc:740] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.777071 5628 consensus_queue.cc:260] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.778512 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bf85c1c2254063a1ffc0b7bf97eb38" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:44.778920 5628 ts_tablet_manager.cc:1434] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260927 13:49:44.779203 5628 tablet_bootstrap.cc:492] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:49:44.779152 5185 leader_election.cc:343] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.747732 5709 leader_election.cc:290] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:44.781028 5184 consensus_peers.cc:597] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4a6a12dc2814e1d92af53bdfc759175. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:44.782236 5107 raft_consensus.cc:2468] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:44.782757 5184 leader_election.cc:304] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.782953 5628 tablet_bootstrap.cc:654] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.783524 5722 raft_consensus.cc:2804] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.783663 5722 raft_consensus.cc:697] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:44.783972 5722 consensus_queue.cc:237] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.786049 5606 ts_tablet_manager.cc:1929] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:44.786157 5732 tablet.cc:1751] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:44.786270 5606 log.cc:1199] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/6b2180cc05fd4fbbab6bfc0f0d45e096
I20260927 13:49:44.787029 5606 ts_tablet_manager.cc:1950] T 6b2180cc05fd4fbbab6bfc0f0d45e096 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:44.787796 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 19) took 1769 ms. Trace:
I20260927 13:49:44.787894 5606 rpcz_store.cc:276] 0927 13:49:43.018662 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.018723 (+ 61us) service_pool.cc:224] Handling call
0927 13:49:44.416523 (+1397800us) ts_tablet_manager.cc:1151] Deleting tablet 6b2180cc05fd4fbbab6bfc0f0d45e096
0927 13:49:44.416534 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:44.662270 (+245736us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.785970 (+123700us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.787745 (+ 1775us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1397539}
I20260927 13:49:44.788640 5606 tablet_replica.cc:333] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:44.788812 5606 raft_consensus.cc:2243] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:44.788817 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 6b2180cc05fd4fbbab6bfc0f0d45e096 (table default.Table_6a8d0b26fc9a4cfe901e0dbf641145b6 [id=13c9a4b16a83402c8747d4edee5faeb9]) successfully deleted
I20260927 13:49:44.789058 5606 pending_rounds.cc:70] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:44.789204 5606 pending_rounds.cc:77] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957566365650944 op_type: NO_OP noop_request { }
I20260927 13:49:44.789331 5606 raft_consensus.cc:2889] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:44.789423 5606 raft_consensus.cc:2272] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.789726 5628 tablet_bootstrap.cc:492] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.789768 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb2864ea38b4a538884a2c728f08313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.789884 5628 ts_tablet_manager.cc:1403] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.003s
I20260927 13:49:44.790637 5628 raft_consensus.cc:359] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.790848 5628 raft_consensus.cc:385] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.790912 5628 raft_consensus.cc:740] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.791126 5628 consensus_queue.cc:260] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.791594 5628 ts_tablet_manager.cc:1434] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:49:44.791908 5628 tablet_bootstrap.cc:492] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.793241 5623 raft_consensus.cc:2243] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.793411 5623 raft_consensus.cc:2272] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.793540 5628 tablet_bootstrap.cc:654] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.793960 5623 ts_tablet_manager.cc:1916] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.795336 5730 tablet.cc:1746] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: Skipping requested alter to schema version 3, tablet already version 3
I20260927 13:49:44.799320 5626 ts_tablet_manager.cc:1434] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.175s user 0.001s sys 0.001s
I20260927 13:49:44.799865 5626 tablet_bootstrap.cc:492] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:44.800648 5628 tablet_bootstrap.cc:492] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.800793 5628 ts_tablet_manager.cc:1403] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260927 13:49:44.801515 5628 raft_consensus.cc:359] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.801689 5628 raft_consensus.cc:385] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.801782 5628 raft_consensus.cc:740] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.802006 5628 consensus_queue.cc:260] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.802552 5628 ts_tablet_manager.cc:1434] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:44.803207 5626 tablet_bootstrap.cc:654] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.803977 5213 tablet_service.cc:1511] Processing CreateTablet for tablet b95399b042654100a609427597d6fe72 (DEFAULT_TABLE table=default.Table_6437470f54684ecab34ab24defbe6a83 [id=c0b49915096e4176b4ff5ec9e6faa830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.804716 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95399b042654100a609427597d6fe72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.742689 5625 log.cc:1199] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/55df2a9b30f04bc28eda3ff7c912df87
I20260927 13:49:44.808832 5625 ts_tablet_manager.cc:1950] T 55df2a9b30f04bc28eda3ff7c912df87 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:44.809331 5625 tablet_replica.cc:333] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:44.809985 5731 tablet.cc:1746] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: Skipping requested alter to schema version 3, tablet already version 3
I20260927 13:49:44.810025 5628 tablet_bootstrap.cc:492] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.810642 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 55df2a9b30f04bc28eda3ff7c912df87 (table default.Table_ac3ac350d3e845c7927b01fbbd301935 [id=8cbd7b92923945eaa3bf583fd5cd165b]) successfully deleted
I20260927 13:49:44.810491 5606 ts_tablet_manager.cc:1916] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.811823 5358 tablet_service.cc:1511] Processing CreateTablet for tablet b95399b042654100a609427597d6fe72 (DEFAULT_TABLE table=default.Table_6437470f54684ecab34ab24defbe6a83 [id=c0b49915096e4176b4ff5ec9e6faa830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:44.812222 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95399b042654100a609427597d6fe72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:44.812852 5628 tablet_bootstrap.cc:654] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:44.831884 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c79b1f2962f44a23916bbfe4cf55a4bc consensus state has no leader
I20260927 13:49:44.838493 5625 raft_consensus.cc:2243] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.838734 5625 raft_consensus.cc:2272] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.839457 5625 ts_tablet_manager.cc:1916] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.848464 4928 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet c6cfaf6f8b5345d199c2a3cdbb87c7a5
I20260927 13:49:44.849964 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_fad5e15f224c4392a6245ad0fcdf29d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.850713 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fad5e15f224c4392a6245ad0fcdf29d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.850493 4928 catalog_manager.cc:5838] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:44.851081 4928 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 79514522a9d142438fd6aecc91f0463e (table default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 4 got 0
W20260927 13:49:44.852319 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0018704e08254c2e8d30c7067df4420c has no consensus state
I20260927 13:49:44.852746 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7cef271e951d46f38d090f892f8e54c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.853332 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cef271e951d46f38d090f892f8e54c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:44.854836 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df271399b2c84653ac4a5b74efdc0197 consensus state has no leader
I20260927 13:49:44.855123 4925 master_service.cc:960] ReplaceTablet: received request to replace tablet a61eedf06dab4096a397da8ce98a07da from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:44.855787 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_13c484685fd1403fa4e825778a3ed2ca" } new_table_name: "default.Table_0f7abb0c16a04daf8a6f8911afd71804" modify_external_catalogs: true
I20260927 13:49:44.857911 5625 ts_tablet_manager.cc:1929] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:44.857884 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4d0bfc64d4b3422b8538a8024c9a68a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.858542 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d0bfc64d4b3422b8538a8024c9a68a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.860249 5625 log.cc:1199] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a61eedf06dab4096a397da8ce98a07da
I20260927 13:49:44.860991 5625 ts_tablet_manager.cc:1950] T a61eedf06dab4096a397da8ce98a07da P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:44.863515 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e03f455aec424b9fb05a1503d626ae3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:44.863658 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet f2622078288a47b4be4dea70d594b76c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:44.864275 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e03f455aec424b9fb05a1503d626ae3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.865602 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a61eedf06dab4096a397da8ce98a07da (table default.Table_62531a04ef9143aa9089eb9779aee6f5 [id=823e5f62db3849ce913eba29b20a4e0a]) successfully deleted
I20260927 13:49:44.865828 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f4169b61d7234a6286c6c26a3b3b2c65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:44.865949 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 14d3a3282d684415858dc971cb02eec1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14d3a3282d684415858dc971cb02eec1 already in progress: creating tablet
W20260927 13:49:44.866415 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4169b61d7234a6286c6c26a3b3b2c65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.868374 5625 tablet_replica.cc:333] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:44.868309 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3efafc6b184f4f73bd2b6fad23d8991c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:44.868620 5625 raft_consensus.cc:2243] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.868824 5625 raft_consensus.cc:2272] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:44.869138 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3efafc6b184f4f73bd2b6fad23d8991c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:44.870749 5625 ts_tablet_manager.cc:1916] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.878487 5750 raft_consensus.cc:493] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.878728 5750 raft_consensus.cc:515] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.879659 5750 leader_election.cc:290] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.888247 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfe23bef144e438ae762e401f02e8f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:44.889961 5044 leader_election.cc:343] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.890262 5619 ts_tablet_manager.cc:1434] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.211s user 0.002s sys 0.000s
I20260927 13:49:44.890705 5619 tablet_bootstrap.cc:492] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:44.892177 5732 tablet.cc:1746] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: Skipping requested alter to schema version 3, tablet already version 3
I20260927 13:49:44.892333 5628 tablet_bootstrap.cc:492] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.892519 5628 ts_tablet_manager.cc:1403] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.083s user 0.009s sys 0.022s
I20260927 13:49:44.893110 5625 ts_tablet_manager.cc:1929] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:44.893302 5625 log.cc:1199] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/7e6721aa2fa0437eae7ca052c19f0f2e
I20260927 13:49:44.893359 5628 raft_consensus.cc:359] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.893571 5628 raft_consensus.cc:385] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.893664 5628 raft_consensus.cc:740] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.893985 5628 consensus_queue.cc:260] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.894284 5625 ts_tablet_manager.cc:1950] T 7e6721aa2fa0437eae7ca052c19f0f2e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:44.900483 5591 raft_consensus.cc:697] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:44.903203 5579 raft_consensus.cc:493] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.905818 5623 ts_tablet_manager.cc:1929] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:44.917460 5623 log.cc:1199] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/03b87dca35654bbeb75695253d81f915
I20260927 13:49:44.918370 5623 ts_tablet_manager.cc:1950] T 03b87dca35654bbeb75695253d81f915 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:44.919283 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 22) took 1648 ms. Trace:
I20260927 13:49:44.919553 5626 tablet_bootstrap.cc:492] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:44.919447 5623 rpcz_store.cc:276] 0927 13:49:43.270617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.279029 (+ 8412us) service_pool.cc:224] Handling call
0927 13:49:44.695017 (+1415988us) ts_tablet_manager.cc:1151] Deleting tablet 03b87dca35654bbeb75695253d81f915
0927 13:49:44.695030 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:44.797241 (+102211us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.905712 (+108471us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.919199 (+ 13487us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97873,"tablet-delete.queue_time_us":1415792}
I20260927 13:49:44.919864 5626 ts_tablet_manager.cc:1403] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.120s user 0.006s sys 0.014s
I20260927 13:49:44.919991 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 03b87dca35654bbeb75695253d81f915 (table default.Table_b0afe34756534412a378f6fc253693bb [id=456ed8114a114f0a8cb9c74fa018fb6a]) successfully deleted
I20260927 13:49:44.920400 5623 tablet_replica.cc:333] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:44.920641 5623 raft_consensus.cc:2243] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.920745 5626 raft_consensus.cc:359] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.920922 5623 raft_consensus.cc:2272] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.921051 5626 raft_consensus.cc:385] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.921185 5626 raft_consensus.cc:740] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.921499 5623 ts_tablet_manager.cc:1916] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.921546 5626 consensus_queue.cc:260] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.923427 5626 ts_tablet_manager.cc:1434] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:49:44.924690 5626 tablet_bootstrap.cc:492] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:44.925341 5591 consensus_queue.cc:237] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.925566 5625 tablet_replica.cc:333] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:44.926674 5626 tablet_bootstrap.cc:654] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.929775 5579 raft_consensus.cc:515] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.930124 5625 raft_consensus.cc:2243] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:44.931273 5625 raft_consensus.cc:2272] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.931648 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fb19fb86ea43b0b81d6d42ce2d8a5f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.932387 5625 ts_tablet_manager.cc:1916] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.932466 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fb19fb86ea43b0b81d6d42ce2d8a5f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:44.932760 5045 leader_election.cc:343] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:44.933266 5044 leader_election.cc:343] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.933408 5044 leader_election.cc:304] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:44.933703 5750 raft_consensus.cc:2749] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:44.934095 5579 leader_election.cc:290] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.936914 5626 tablet_bootstrap.cc:492] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:44.937115 5626 ts_tablet_manager.cc:1403] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.001s
I20260927 13:49:44.937995 5626 raft_consensus.cc:359] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.938269 5626 raft_consensus.cc:385] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.938423 5626 raft_consensus.cc:740] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.938724 5626 consensus_queue.cc:260] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.940513 5626 ts_tablet_manager.cc:1434] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 13:49:44.941687 5626 tablet_bootstrap.cc:492] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:44.942943 5625 ts_tablet_manager.cc:1929] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:44.943112 5628 ts_tablet_manager.cc:1434] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260927 13:49:44.943508 5628 tablet_bootstrap.cc:492] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.943540 5626 tablet_bootstrap.cc:654] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.946206 5579 raft_consensus.cc:493] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.946413 5579 raft_consensus.cc:515] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.948002 5579 leader_election.cc:290] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:44.948100 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d303db711543e5ac23bfcd2279c993" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:44.948311 5248 raft_consensus.cc:2468] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:44.949208 5044 leader_election.cc:304] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:44.949827 5579 raft_consensus.cc:2804] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.949959 5579 raft_consensus.cc:493] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.950057 5579 raft_consensus.cc:3060] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.951625 5727 raft_consensus.cc:493] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.951787 5727 raft_consensus.cc:515] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.952414 5727 leader_election.cc:290] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.953346 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1489f766164444b9aaa7b58e81a72d9" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:44.953572 5107 raft_consensus.cc:2468] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:44.948555 5628 tablet_bootstrap.cc:654] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.954030 5184 leader_election.cc:304] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:44.954414 5727 raft_consensus.cc:2804] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:44.954504 5727 raft_consensus.cc:493] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:44.954597 5727 raft_consensus.cc:3060] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.956123 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfe23bef144e438ae762e401f02e8f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.957471 5727 raft_consensus.cc:515] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.957638 5579 raft_consensus.cc:515] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.958915 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1489f766164444b9aaa7b58e81a72d9" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:44.959036 5579 leader_election.cc:290] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:44.959096 5107 raft_consensus.cc:3060] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.960332 5625 log.cc:1199] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b0dfe23bef144e438ae762e401f02e8f
I20260927 13:49:44.960803 5625 ts_tablet_manager.cc:1950] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:44.960844 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d303db711543e5ac23bfcd2279c993" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:44.961009 5248 raft_consensus.cc:3060] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:44.961719 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b0dfe23bef144e438ae762e401f02e8f (table default.Table_eae0be8d08ec43279ba35789c84b573c [id=599a7a50e2324466b865d11e66bc51bd]) successfully deleted
I20260927 13:49:44.962348 5107 raft_consensus.cc:2468] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
W20260927 13:49:44.962767 4915 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 4295710c33714360b3691f48f47f4293 (table default.Table_97bdee39a93e4f98ae6382e7ab44eda7 [id=2fe2768ea9264c38973e4ed5206c77f2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4295710c33714360b3691f48f47f4293 consensus state has no leader
I20260927 13:49:44.963341 5625 tablet_replica.cc:333] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:44.963763 5248 raft_consensus.cc:2468] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:44.964264 5044 leader_election.cc:304] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:44.964530 5184 leader_election.cc:304] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:44.964701 5579 raft_consensus.cc:2804] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.964852 5754 raft_consensus.cc:2804] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:44.964996 5754 raft_consensus.cc:697] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:44.965360 5754 consensus_queue.cc:237] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.965974 5579 raft_consensus.cc:697] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:44.966363 5579 consensus_queue.cc:237] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.967571 5623 ts_tablet_manager.cc:1929] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 13:49:44.967680 5623 log.cc:1199] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/e4c554f876d74be5b9667f373d832e50
I20260927 13:49:44.968109 5623 ts_tablet_manager.cc:1950] T e4c554f876d74be5b9667f373d832e50 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:44.969401 5578 raft_consensus.cc:493] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:49:44.975847 5045 leader_election.cc:343] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:44.976046 5045 leader_election.cc:304] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:44.976294 5045 raft_consensus.cc:2686] T b0dfe23bef144e438ae762e401f02e8f P 34fc5fe0a32d42ab83f4aa6d07341409: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:49:44.977188 5628 tablet_bootstrap.cc:492] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.977371 5628 ts_tablet_manager.cc:1403] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.007s
I20260927 13:49:44.978377 5628 raft_consensus.cc:359] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.978611 5628 raft_consensus.cc:385] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.978713 5628 raft_consensus.cc:740] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.979060 5628 consensus_queue.cc:260] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.979375 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1489f766164444b9aaa7b58e81a72d9" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.979789 5574 raft_consensus.cc:493] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:44.979941 5574 raft_consensus.cc:515] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.980612 5574 leader_election.cc:290] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:44.980724 5628 ts_tablet_manager.cc:1434] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:44.980775 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1489f766164444b9aaa7b58e81a72d9" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:44.981195 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d303db711543e5ac23bfcd2279c993" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:44.981460 5628 tablet_bootstrap.cc:492] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.983623 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d303db711543e5ac23bfcd2279c993" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:44.983912 5628 tablet_bootstrap.cc:654] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.984771 5619 tablet_bootstrap.cc:654] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.982458 5578 raft_consensus.cc:515] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:44.985760 5625 raft_consensus.cc:2243] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
W20260927 13:49:44.986260 5319 leader_election.cc:343] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 28309730c01944a7b0c5cecc478a448b
I20260927 13:49:44.986718 5625 pending_rounds.cc:70] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: Trying to abort 1 pending ops.
I20260927 13:49:44.986727 5385 raft_consensus.cc:2468] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:44.986851 5625 pending_rounds.cc:77] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957570425974784 op_type: NO_OP noop_request { }
I20260927 13:49:44.986991 5625 raft_consensus.cc:2889] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:44.987093 5625 raft_consensus.cc:2272] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:44.988900 5625 ts_tablet_manager.cc:1916] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:44.990957 5628 tablet_bootstrap.cc:492] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:44.991166 5628 ts_tablet_manager.cc:1403] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260927 13:49:44.992185 5628 raft_consensus.cc:359] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.992436 5628 raft_consensus.cc:385] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:44.992551 5628 raft_consensus.cc:740] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:44.992871 5628 consensus_queue.cc:260] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:44.994221 5628 ts_tablet_manager.cc:1434] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260927 13:49:44.994993 5628 tablet_bootstrap.cc:492] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:44.996229 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d303db711543e5ac23bfcd2279c993" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:44.997144 5578 leader_election.cc:290] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:44.997529 5628 tablet_bootstrap.cc:654] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:44.997941 5625 ts_tablet_manager.cc:1929] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:44.998154 5625 log.cc:1199] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/11d303db711543e5ac23bfcd2279c993
I20260927 13:49:44.999053 5625 ts_tablet_manager.cc:1950] T 11d303db711543e5ac23bfcd2279c993 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.000124 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 11d303db711543e5ac23bfcd2279c993 (table default.Table_6972bb0d54e5418c9b4bad3e385052ce [id=8a1cfc06002240faae3fd4bb724fc5f4]) successfully deleted
I20260927 13:49:45.000542 5625 tablet_replica.cc:333] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.000802 5625 raft_consensus.cc:2243] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.001042 5625 raft_consensus.cc:2272] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.001627 5625 ts_tablet_manager.cc:1916] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:45.002398 5319 leader_election.cc:343] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: Tablet not RUNNING: STOPPED
I20260927 13:49:45.005753 5606 ts_tablet_manager.cc:1929] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:45.006953 5628 tablet_bootstrap.cc:492] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.007193 5628 ts_tablet_manager.cc:1403] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260927 13:49:45.007922 5606 log.cc:1199] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/55df2a9b30f04bc28eda3ff7c912df87
I20260927 13:49:45.008425 5606 ts_tablet_manager.cc:1950] T 55df2a9b30f04bc28eda3ff7c912df87 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:45.008482 5625 ts_tablet_manager.cc:1929] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.008644 5625 log.cc:1199] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/991d0dcb68964df99b1bf5b43c890e28
I20260927 13:49:45.009127 5625 ts_tablet_manager.cc:1950] T 991d0dcb68964df99b1bf5b43c890e28 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.009349 5619 tablet_bootstrap.cc:492] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:45.009443 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 17) took 2007 ms. Trace:
I20260927 13:49:45.009560 5619 ts_tablet_manager.cc:1403] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.119s user 0.003s sys 0.001s
I20260927 13:49:45.009614 5606 rpcz_store.cc:276] 0927 13:49:43.002072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.017913 (+ 15841us) service_pool.cc:224] Handling call
0927 13:49:44.788556 (+1770643us) ts_tablet_manager.cc:1151] Deleting tablet 55df2a9b30f04bc28eda3ff7c912df87
0927 13:49:44.788566 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:44.994883 (+206317us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.005681 (+ 10798us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.009357 (+ 3676us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1769391}
I20260927 13:49:45.010217 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 55df2a9b30f04bc28eda3ff7c912df87 (table default.Table_ac3ac350d3e845c7927b01fbbd301935 [id=8cbd7b92923945eaa3bf583fd5cd165b]) successfully deleted
I20260927 13:49:45.010852 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 28) took 1720 ms. Trace:
I20260927 13:49:45.011070 5606 rpcz_store.cc:276] 0927 13:49:43.290433 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.290513 (+ 80us) service_pool.cc:224] Handling call
0927 13:49:45.010634 (+1720121us) ts_tablet_manager.cc:1151] Deleting tablet ab9ac0e6083343debabc043435c54d95
0927 13:49:45.010644 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.010756 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1718557}
I20260927 13:49:45.011401 5619 raft_consensus.cc:359] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:45.011600 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet ab9ac0e6083343debabc043435c54d95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab9ac0e6083343debabc043435c54d95 already in progress: creating tablet
W20260927 13:49:45.011655 5319 consensus_peers.cc:597] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:45.011792 5619 raft_consensus.cc:385] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.011999 5606 tablet_replica.cc:333] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:45.011956 5619 raft_consensus.cc:740] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.012290 5619 consensus_queue.cc:260] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.013623 5619 ts_tablet_manager.cc:1434] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260927 13:49:45.014133 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 991d0dcb68964df99b1bf5b43c890e28 (table default.Table_4a67727b46b74c27a439bc32c6cb411f [id=a8628dbf015640b9ad49c4aa66f46cac]) successfully deleted
W20260927 13:49:45.014827 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 8b8b80eb00244f7cbcc260af06c16a52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b8b80eb00244f7cbcc260af06c16a52 already in progress: creating tablet
I20260927 13:49:45.015179 5625 tablet_replica.cc:333] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.015439 5625 raft_consensus.cc:2243] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.015647 5625 raft_consensus.cc:2272] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.016722 5628 raft_consensus.cc:359] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.016976 5628 raft_consensus.cc:385] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.017091 5628 raft_consensus.cc:740] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.017390 5628 consensus_queue.cc:260] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.018041 5628 ts_tablet_manager.cc:1434] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 13:49:45.018473 5628 tablet_bootstrap.cc:492] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.020133 5619 tablet_bootstrap.cc:492] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:45.020722 5628 tablet_bootstrap.cc:654] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.022083 5619 tablet_bootstrap.cc:654] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.022384 5625 ts_tablet_manager.cc:1916] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.024302 5606 raft_consensus.cc:2243] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:45.024637 5606 pending_rounds.cc:70] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:45.024775 5606 pending_rounds.cc:77] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957567596494848 op_type: NO_OP noop_request { }
I20260927 13:49:45.024979 5606 raft_consensus.cc:2889] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:45.025144 5606 raft_consensus.cc:2272] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.026036 5606 ts_tablet_manager.cc:1916] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.031494 5625 ts_tablet_manager.cc:1929] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.031687 5625 log.cc:1199] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/169e64b6e20544e6ad1bc31c7ec29cf2
I20260927 13:49:45.031841 5619 tablet_bootstrap.cc:492] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:45.032001 5619 ts_tablet_manager.cc:1403] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260927 13:49:45.032125 5625 ts_tablet_manager.cc:1950] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.032819 5619 raft_consensus.cc:359] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.032994 5619 raft_consensus.cc:385] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.033167 5619 raft_consensus.cc:740] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.033468 5619 consensus_queue.cc:260] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.033500 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 169e64b6e20544e6ad1bc31c7ec29cf2 (table default.Table_a23fe407dd1047ca98d605e2cee52fdc [id=4f5c882c6f8449cf9daacd66a354bc9f]) successfully deleted
I20260927 13:49:45.034914 5619 ts_tablet_manager.cc:1434] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260927 13:49:45.039237 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 399d6411d8ad4354b3c0f8f4d78779a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 399d6411d8ad4354b3c0f8f4d78779a9 already in progress: creating tablet
I20260927 13:49:45.035748 5619 tablet_bootstrap.cc:492] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:45.040036 5625 tablet_replica.cc:333] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.040215 5625 raft_consensus.cc:2243] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.040397 5625 raft_consensus.cc:2272] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.040932 5625 ts_tablet_manager.cc:1916] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.041181 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b95399b042654100a609427597d6fe72
I20260927 13:49:45.041621 5619 tablet_bootstrap.cc:654] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.045176 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_87280d4336274cfe980ae3cd3148a0f6" } modify_external_catalogs: true
I20260927 13:49:45.045363 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_87280d4336274cfe980ae3cd3148a0f6" } modify_external_catalogs: true
I20260927 13:49:44.968906 5727 leader_election.cc:290] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:44.982178 5626 tablet_bootstrap.cc:492] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:45.046396 5626 ts_tablet_manager.cc:1403] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.105s user 0.009s sys 0.003s
I20260927 13:49:45.047186 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6213adb1d84a4dce99f1cc6d8a2828ec" } modify_external_catalogs: true
I20260927 13:49:45.047202 5626 raft_consensus.cc:359] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.047361 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6213adb1d84a4dce99f1cc6d8a2828ec" } modify_external_catalogs: true
I20260927 13:49:45.047397 5626 raft_consensus.cc:385] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.047464 5626 raft_consensus.cc:740] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.047721 5626 consensus_queue.cc:260] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.048252 5626 ts_tablet_manager.cc:1434] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:45.048586 5626 tablet_bootstrap.cc:492] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:45.048877 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_885a1d72ea0640d48861b8228923ea8a" } new_table_name: "default.Table_5e272c5ede1d42d1931b0872ff6f89c5" modify_external_catalogs: true
I20260927 13:49:44.983315 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28309730c01944a7b0c5cecc478a448b" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.052879 5248 raft_consensus.cc:2393] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:49:45.052910 5626 tablet_bootstrap.cc:654] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:44.984413 5185 leader_election.cc:343] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:45.054441 5185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 69993.9us
W20260927 13:49:45.054729 5185 leader_election.cc:343] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.054857 5625 ts_tablet_manager.cc:1929] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.055011 5625 log.cc:1199] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a1489f766164444b9aaa7b58e81a72d9
I20260927 13:49:45.055426 5625 ts_tablet_manager.cc:1950] T a1489f766164444b9aaa7b58e81a72d9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.055469 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet b95399b042654100a609427597d6fe72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:44.996459 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d303db711543e5ac23bfcd2279c993" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.055776 5247 raft_consensus.cc:2393] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:49:45.056799 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet b95399b042654100a609427597d6fe72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.057371 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet b95399b042654100a609427597d6fe72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.058899 5319 leader_election.cc:304] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:45.059465 5319 leader_election.cc:304] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:45.059857 5574 raft_consensus.cc:3060] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.061275 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a1489f766164444b9aaa7b58e81a72d9 (table default.Table_055f1a3f79864929982c584ed6dec1e9 [id=2a104f24fe5e4ad8bfb52eb2dbdf9a8a]) successfully deleted
I20260927 13:49:45.062362 5578 raft_consensus.cc:3060] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:45.062562 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7dc612cbcd5d4755a188408f2a036f34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dc612cbcd5d4755a188408f2a036f34 already in progress: creating tablet
I20260927 13:49:45.063289 5625 tablet_replica.cc:333] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.063575 5625 raft_consensus.cc:2243] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.063799 5625 raft_consensus.cc:2272] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.065719 5625 ts_tablet_manager.cc:1916] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.065732 5578 raft_consensus.cc:2749] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:45.067930 5574 raft_consensus.cc:2749] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:45.075513 5628 tablet_bootstrap.cc:492] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.075491 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 23) took 1793 ms. Trace:
I20260927 13:49:45.075678 5628 ts_tablet_manager.cc:1403] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.057s user 0.012s sys 0.009s
I20260927 13:49:45.076254 5623 rpcz_store.cc:276] 0927 13:49:43.279926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.279983 (+ 57us) service_pool.cc:224] Handling call
0927 13:49:44.920311 (+1640328us) ts_tablet_manager.cc:1151] Deleting tablet e4c554f876d74be5b9667f373d832e50
0927 13:49:44.920320 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:44.958028 (+ 37708us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:44.967484 (+ 9456us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.073229 (+105745us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1640043}
I20260927 13:49:45.077216 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet e4c554f876d74be5b9667f373d832e50 (table default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549]) successfully deleted
I20260927 13:49:45.077337 5628 raft_consensus.cc:359] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.077554 5628 raft_consensus.cc:385] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.077630 5628 raft_consensus.cc:740] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.077872 5623 tablet_replica.cc:333] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:45.077855 5628 consensus_queue.cc:260] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.078819 5579 raft_consensus.cc:493] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.078985 5579 raft_consensus.cc:515] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.079636 5579 leader_election.cc:290] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.080288 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6ff9ddb6664a5a867ac0f64ac1e9a2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:45.080888 5045 leader_election.cc:343] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.082156 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6ff9ddb6664a5a867ac0f64ac1e9a2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.084648 5626 tablet_bootstrap.cc:492] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:45.084892 5626 ts_tablet_manager.cc:1403] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.036s user 0.007s sys 0.000s
I20260927 13:49:45.086272 5626 raft_consensus.cc:359] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.086609 5626 raft_consensus.cc:385] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.086766 5626 raft_consensus.cc:740] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.087178 5626 consensus_queue.cc:260] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.088040 5626 ts_tablet_manager.cc:1434] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:45.089313 5626 tablet_bootstrap.cc:492] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:49:45.090328 5044 leader_election.cc:343] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.090490 5044 leader_election.cc:304] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.091622 5579 raft_consensus.cc:2749] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:45.092041 5625 ts_tablet_manager.cc:1929] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 13:49:45.092151 5628 ts_tablet_manager.cc:1434] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.016s user 0.002s sys 0.001s
I20260927 13:49:45.092190 5625 log.cc:1199] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/fbb2e0a01a9147d597693eab481ca73b
I20260927 13:49:45.092948 5628 tablet_bootstrap.cc:492] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.093039 5625 ts_tablet_manager.cc:1950] T fbb2e0a01a9147d597693eab481ca73b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.093710 5606 ts_tablet_manager.cc:1929] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:45.093864 5606 log.cc:1199] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/03b87dca35654bbeb75695253d81f915
I20260927 13:49:45.094038 5625 tablet_replica.cc:333] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.094187 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet fbb2e0a01a9147d597693eab481ca73b (table default.Table_62b8129916de4fdeaddae3de476de360 [id=f6be2f3e0bb749108e056578f8d3cd75]) successfully deleted
I20260927 13:49:45.094251 5625 raft_consensus.cc:2243] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:45.094597 5625 raft_consensus.cc:2272] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.095943 5628 tablet_bootstrap.cc:654] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.097339 5625 ts_tablet_manager.cc:1916] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.096698 5626 tablet_bootstrap.cc:654] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.098892 5606 ts_tablet_manager.cc:1950] T 03b87dca35654bbeb75695253d81f915 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:45.099807 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 29) took 1805 ms. Trace:
I20260927 13:49:45.099941 5606 rpcz_store.cc:276] 0927 13:49:43.294383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.294475 (+ 92us) service_pool.cc:224] Handling call
0927 13:49:45.011888 (+1717413us) ts_tablet_manager.cc:1151] Deleting tablet 03b87dca35654bbeb75695253d81f915
0927 13:49:45.011898 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.029320 (+ 17422us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.093617 (+ 64297us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.099741 (+ 6124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1711871}
I20260927 13:49:45.100512 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 03b87dca35654bbeb75695253d81f915 (table default.Table_b0afe34756534412a378f6fc253693bb [id=456ed8114a114f0a8cb9c74fa018fb6a]) successfully deleted
I20260927 13:49:45.100908 5606 tablet_replica.cc:333] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:45.101631 5606 raft_consensus.cc:2243] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:45.102466 5606 raft_consensus.cc:2272] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.114212 5606 ts_tablet_manager.cc:1916] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.120702 5619 tablet_bootstrap.cc:492] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:45.120965 5619 ts_tablet_manager.cc:1403] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.000s
I20260927 13:49:45.121658 5625 ts_tablet_manager.cc:1929] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 13:49:45.121812 5625 log.cc:1199] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/c6d69f70750d4b418f850b2cec3ad721
I20260927 13:49:45.122350 5625 ts_tablet_manager.cc:1950] T c6d69f70750d4b418f850b2cec3ad721 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.118063 5623 raft_consensus.cc:2243] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.123379 5623 raft_consensus.cc:2272] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.123732 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet c6d69f70750d4b418f850b2cec3ad721 (table default.Table_1b911492fead4445a3aeb96fa99d8de2 [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
I20260927 13:49:45.123920 5625 tablet_replica.cc:333] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.124075 5623 ts_tablet_manager.cc:1916] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.124133 5625 raft_consensus.cc:2243] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
W20260927 13:49:45.124316 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 587471d2b7e647388e7bb1e7f8e06b40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 587471d2b7e647388e7bb1e7f8e06b40 already in progress: creating tablet
I20260927 13:49:45.124362 5625 pending_rounds.cc:70] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Trying to abort 1 pending ops.
I20260927 13:49:45.124435 5625 pending_rounds.cc:77] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957569446170624 op_type: NO_OP noop_request { }
I20260927 13:49:45.124545 5625 raft_consensus.cc:2889] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260927 13:49:45.124594 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 3663033220094a4ea6df8e2982eb2188 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3663033220094a4ea6df8e2982eb2188 already in progress: creating tablet
I20260927 13:49:45.124665 5625 raft_consensus.cc:2272] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:45.127161 4914 consensus_peers.cc:597] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de -> Peer 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985): Couldn't send request to peer 13a42ae8b95b495c9bcea85d6732cd77. Status: Network error: Client connection negotiation failed: client connection to 127.4.163.126:42985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260927 13:49:45.127945 5606 ts_tablet_manager.cc:1929] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 13:49:45.128145 5606 log.cc:1199] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/e4c554f876d74be5b9667f373d832e50
I20260927 13:49:45.128636 5606 ts_tablet_manager.cc:1950] T e4c554f876d74be5b9667f373d832e50 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:45.129458 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 31) took 1761 ms. Trace:
I20260927 13:49:45.129619 5606 rpcz_store.cc:276] 0927 13:49:43.367838 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.368050 (+ 212us) service_pool.cc:224] Handling call
0927 13:49:45.100825 (+1732775us) ts_tablet_manager.cc:1151] Deleting tablet e4c554f876d74be5b9667f373d832e50
0927 13:49:45.100835 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.118435 (+ 17600us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.127865 (+ 9430us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.129423 (+ 1558us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1728128}
I20260927 13:49:45.130004 5625 ts_tablet_manager.cc:1916] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.130213 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet e4c554f876d74be5b9667f373d832e50 (table default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549]) successfully deleted
I20260927 13:49:45.130242 5619 raft_consensus.cc:359] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.130437 5619 raft_consensus.cc:385] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.130522 5619 raft_consensus.cc:740] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.130708 5606 tablet_replica.cc:333] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:45.130828 5619 consensus_queue.cc:260] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.130959 5606 raft_consensus.cc:2243] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.131958 5619 ts_tablet_manager.cc:1434] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260927 13:49:45.132979 5619 tablet_bootstrap.cc:492] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:45.133131 5606 raft_consensus.cc:2272] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.133785 5606 ts_tablet_manager.cc:1916] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.135107 5619 tablet_bootstrap.cc:654] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.143141 5579 raft_consensus.cc:493] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.143355 5579 raft_consensus.cc:515] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.144014 5579 leader_election.cc:290] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.145032 5625 ts_tablet_manager.cc:1929] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:45.145545 5628 tablet_bootstrap.cc:492] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.148589 5628 ts_tablet_manager.cc:1403] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.056s user 0.006s sys 0.011s
I20260927 13:49:45.148614 5625 log.cc:1199] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/60fae0c413e7439c9ab18b01628d8b28
I20260927 13:49:45.149319 5625 ts_tablet_manager.cc:1950] T 60fae0c413e7439c9ab18b01628d8b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.149601 5628 raft_consensus.cc:359] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.150725 5628 raft_consensus.cc:385] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.150844 5628 raft_consensus.cc:740] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.151201 5628 consensus_queue.cc:260] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:45.151703 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6bf85c1c2254063a1ffc0b7bf97eb38 consensus state has no leader
I20260927 13:49:45.151850 5625 tablet_replica.cc:333] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.152060 5625 raft_consensus.cc:2243] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.152213 5625 raft_consensus.cc:2272] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.152745 5625 ts_tablet_manager.cc:1916] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.153177 5623 ts_tablet_manager.cc:1929] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.153329 5623 log.cc:1199] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/28309730c01944a7b0c5cecc478a448b
I20260927 13:49:45.153316 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 60fae0c413e7439c9ab18b01628d8b28 (table default.Table_88c5377676df4e3fb778d2781ed7a546 [id=36caa6d3649b47efb7e95cab54ca2608]) successfully deleted
I20260927 13:49:45.154354 5628 ts_tablet_manager.cc:1434] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 13:49:45.156165 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet fbb2e0a01a9147d597693eab481ca73b from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.156339 5623 ts_tablet_manager.cc:1950] T 28309730c01944a7b0c5cecc478a448b P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:45.156685 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet b0dfe23bef144e438ae762e401f02e8f from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.157130 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet 66524dd4f62f4da4be845d5efefe8db1 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.157512 5628 tablet_bootstrap.cc:492] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.157827 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 25) took 1851 ms. Trace:
I20260927 13:49:45.158186 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet b4bdd64d67d94276b20ab862dec0d2ee from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.157917 5623 rpcz_store.cc:276] 0927 13:49:43.306342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.309441 (+ 3099us) service_pool.cc:224] Handling call
0927 13:49:45.077786 (+1768345us) ts_tablet_manager.cc:1151] Deleting tablet 28309730c01944a7b0c5cecc478a448b
0927 13:49:45.077798 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.127854 (+ 50056us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.153102 (+ 25248us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.157770 (+ 4668us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1768103}
I20260927 13:49:45.159188 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 28309730c01944a7b0c5cecc478a448b (table default.Table_1ea0b188cadc40009b93843fdf653504 [id=c8c17ee713974f8099a439cb16a06056]) successfully deleted
I20260927 13:49:45.159853 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c657bd1ec67f4e679366f14cdc7aff3f" } new_table_name: "default.Table_1d4328199b424e52bc4ebaf4f317542a" modify_external_catalogs: true
I20260927 13:49:45.159988 5628 tablet_bootstrap.cc:654] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.160730 5623 tablet_replica.cc:333] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:45.161257 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_50e65c3a129d4d739bd94828014ddfc9" } modify_external_catalogs: true
I20260927 13:49:45.161407 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_50e65c3a129d4d739bd94828014ddfc9" } modify_external_catalogs: true
I20260927 13:49:45.161888 5623 raft_consensus.cc:2243] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:45.162329 5623 raft_consensus.cc:2272] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.162911 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 66524dd4f62f4da4be845d5efefe8db1
I20260927 13:49:45.163621 5626 tablet_bootstrap.cc:492] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:45.163589 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6972bb0d54e5418c9b4bad3e385052ce" } new_table_name: "default.Table_123cd6c170fc49fd97317a18b9b14021" modify_external_catalogs: true
I20260927 13:49:45.163776 5626 ts_tablet_manager.cc:1403] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.000s
I20260927 13:49:45.164688 4928 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 7b7c903578f54df299db38d2ed014615
W20260927 13:49:45.165268 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f443c863d087483493baa4c80bb64670 consensus state has no leader
I20260927 13:49:45.165539 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1b911492fead4445a3aeb96fa99d8de2" } new_table_name: "default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d" modify_external_catalogs: true
I20260927 13:49:45.168246 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d3a3282d684415858dc971cb02eec1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:45.168845 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d3a3282d684415858dc971cb02eec1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.169704 5626 raft_consensus.cc:359] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.169955 5626 raft_consensus.cc:385] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.170032 5626 raft_consensus.cc:740] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.170395 5626 consensus_queue.cc:260] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.170789 5625 ts_tablet_manager.cc:1929] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.170939 5625 log.cc:1199] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b4d56bd86f814c9ead4a52f133d1c818
I20260927 13:49:45.171259 5625 ts_tablet_manager.cc:1950] T b4d56bd86f814c9ead4a52f133d1c818 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.172974 5625 tablet_replica.cc:333] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.173272 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 66524dd4f62f4da4be845d5efefe8db1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:45.173719 5044 leader_election.cc:343] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.173991 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b4d56bd86f814c9ead4a52f133d1c818 (table default.Table_78b63dc8b0d74924b9db859769aebe53 [id=dba93d9f1c5045b29c27827599701cc9]) successfully deleted
I20260927 13:49:45.174250 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 66524dd4f62f4da4be845d5efefe8db1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.174275 5625 raft_consensus.cc:2243] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.174535 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 66524dd4f62f4da4be845d5efefe8db1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.174582 5625 raft_consensus.cc:2272] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:45.174994 5045 leader_election.cc:343] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.175143 5045 leader_election.cc:304] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.176045 5625 ts_tablet_manager.cc:1916] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.176177 5626 ts_tablet_manager.cc:1434] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260927 13:49:45.176190 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e6eff4f97e084636b5609c6c269cf5ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.176760 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6eff4f97e084636b5609c6c269cf5ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.176275 5579 raft_consensus.cc:2749] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:45.177035 5628 tablet_bootstrap.cc:492] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.177368 5628 ts_tablet_manager.cc:1403] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260927 13:49:45.178158 5628 raft_consensus.cc:359] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.178452 5628 raft_consensus.cc:385] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.178577 5628 raft_consensus.cc:740] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.178916 5628 consensus_queue.cc:260] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.179922 5628 ts_tablet_manager.cc:1434] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:45.180267 5628 tablet_bootstrap.cc:492] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.181473 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b4bdd64d67d94276b20ab862dec0d2ee
I20260927 13:49:45.181993 4930 catalog_manager.cc:6934] ReplaceTablet: tablet b4bdd64d67d94276b20ab862dec0d2ee deleted and replaced by tablet c2fc2734e88e431facdf72e9ef136106
I20260927 13:49:45.182775 5628 tablet_bootstrap.cc:654] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.184473 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet b4bdd64d67d94276b20ab862dec0d2ee with delete_type TABLET_DATA_DELETED (replaced by tablet c2fc2734e88e431facdf72e9ef136106) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.185120 5626 tablet_bootstrap.cc:492] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:45.188625 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet b4bdd64d67d94276b20ab862dec0d2ee with delete_type TABLET_DATA_DELETED (replaced by tablet c2fc2734e88e431facdf72e9ef136106) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.189172 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet b4bdd64d67d94276b20ab862dec0d2ee with delete_type TABLET_DATA_DELETED (replaced by tablet c2fc2734e88e431facdf72e9ef136106) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.189425 5626 tablet_bootstrap.cc:654] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:45.190150 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 has no consensus state
I20260927 13:49:45.190658 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_1ae91d9d1b754d34b300597015c74ff5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:45.192082 4927 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 8ff03056694b4481a01cf4be25cb8b6a
I20260927 13:49:45.192432 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c6db22e8533b46fe9fc3a57a0bdcbc9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:45.195158 5626 tablet_bootstrap.cc:492] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:45.195346 5626 ts_tablet_manager.cc:1403] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260927 13:49:45.196141 5626 raft_consensus.cc:359] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.196385 5626 raft_consensus.cc:385] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.196525 5626 raft_consensus.cc:740] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.196831 5626 consensus_queue.cc:260] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.200516 5626 ts_tablet_manager.cc:1434] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260927 13:49:45.200837 5606 ts_tablet_manager.cc:1929] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:49:45.201159 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7cb2864ea38b4a538884a2c728f08313 consensus state has no leader
W20260927 13:49:45.201635 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6db22e8533b46fe9fc3a57a0bdcbc9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.202682 5625 ts_tablet_manager.cc:1929] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.203095 5625 log.cc:1199] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/54fb19fb86ea43b0b81d6d42ce2d8a5f
I20260927 13:49:45.203637 5625 ts_tablet_manager.cc:1950] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:45.205920 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ae91d9d1b754d34b300597015c74ff5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.205942 5626 tablet_bootstrap.cc:492] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:45.209002 5628 tablet_bootstrap.cc:492] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.209167 5628 ts_tablet_manager.cc:1403] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260927 13:49:45.209178 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f (table default.Table_fafb083bcf954f6b91e326a7ca8ff4ee [id=0d47daf95d4b40e2862f1b897b210232]) successfully deleted
W20260927 13:49:45.209834 5319 consensus_peers.cc:597] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbb2e0a01a9147d597693eab481ca73b. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:45.210177 5625 tablet_replica.cc:333] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.210381 5625 raft_consensus.cc:2243] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:45.210039 5628 raft_consensus.cc:359] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.210506 5628 raft_consensus.cc:385] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.210592 5628 raft_consensus.cc:740] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.210852 5628 consensus_queue.cc:260] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.211426 5628 ts_tablet_manager.cc:1434] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:45.211701 5628 tablet_bootstrap.cc:492] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.213079 5625 pending_rounds.cc:70] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: Trying to abort 1 pending ops.
I20260927 13:49:45.213619 5625 pending_rounds.cc:77] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957569584582656 op_type: NO_OP noop_request { }
I20260927 13:49:45.213946 5625 raft_consensus.cc:2889] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:45.214231 5625 raft_consensus.cc:2272] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.215297 5625 ts_tablet_manager.cc:1916] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.217442 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ac4b7b0394ef4ce3ac5edea4fd99227f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:45.217604 4928 master_service.cc:960] ReplaceTablet: received request to replace tablet 2801473216a3475384d1494892b8df7b from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.218401 5626 tablet_bootstrap.cc:654] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.218982 5628 tablet_bootstrap.cc:654] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:45.218071 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac4b7b0394ef4ce3ac5edea4fd99227f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.225171 5623 ts_tablet_manager.cc:1916] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.201050 5606 log.cc:1199] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/28309730c01944a7b0c5cecc478a448b
I20260927 13:49:45.225764 5606 ts_tablet_manager.cc:1950] T 28309730c01944a7b0c5cecc478a448b P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:45.228434 5625 ts_tablet_manager.cc:1929] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:45.229238 5626 tablet_bootstrap.cc:492] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:45.229456 5626 ts_tablet_manager.cc:1403] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260927 13:49:45.230321 5626 raft_consensus.cc:359] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.230360 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2801473216a3475384d1494892b8df7b
I20260927 13:49:45.230607 5626 raft_consensus.cc:385] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.230638 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 33) took 1849 ms. Trace:
I20260927 13:49:45.230733 5626 raft_consensus.cc:740] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.231036 4928 catalog_manager.cc:6934] ReplaceTablet: tablet 2801473216a3475384d1494892b8df7b deleted and replaced by tablet 72711f14f26a479c9699b172b41b1db0
I20260927 13:49:45.231045 5626 consensus_queue.cc:260] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.231541 5626 ts_tablet_manager.cc:1434] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:45.231930 5626 tablet_bootstrap.cc:492] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:45.232213 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 2801473216a3475384d1494892b8df7b with delete_type TABLET_DATA_DELETED (replaced by tablet 72711f14f26a479c9699b172b41b1db0) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.233057 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 2801473216a3475384d1494892b8df7b with delete_type TABLET_DATA_DELETED (replaced by tablet 72711f14f26a479c9699b172b41b1db0) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.234163 4925 catalog_manager.cc:5838] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:45.234632 4925 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (table default.Table_0f7abb0c16a04daf8a6f8911afd71804 [id=c16d7a8a2339458b8c973cedf99c32bf]). Expected version 2 got 0
I20260927 13:49:45.235306 5626 tablet_bootstrap.cc:654] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.235580 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 32fa23c312544fac8ef485a35e5ab972
W20260927 13:49:45.236264 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0018704e08254c2e8d30c7067df4420c consensus state has no leader
I20260927 13:49:45.237335 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 32fa23c312544fac8ef485a35e5ab972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.237571 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 32fa23c312544fac8ef485a35e5ab972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.239581 5625 log.cc:1199] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f2622078288a47b4be4dea70d594b76c
I20260927 13:49:45.240156 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 169e64b6e20544e6ad1bc31c7ec29cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.240370 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e6721aa2fa0437eae7ca052c19f0f2e with delete_type TABLET_DATA_DELETED (replaced by tablet 7dc612cbcd5d4755a188408f2a036f34) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.240592 5625 ts_tablet_manager.cc:1950] T f2622078288a47b4be4dea70d594b76c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.240588 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d69f70750d4b418f850b2cec3ad721 with delete_type TABLET_DATA_DELETED (replaced by tablet 0018704e08254c2e8d30c7067df4420c) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.243435 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f2622078288a47b4be4dea70d594b76c (table default.Table_c697b442911e41d898013105071efae8 [id=3922762a78fe4981b87c3ecbb25a8e2b]) successfully deleted
I20260927 13:49:45.235261 5628 tablet_bootstrap.cc:492] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.236977 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 32fa23c312544fac8ef485a35e5ab972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.239979 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 60fae0c413e7439c9ab18b01628d8b28 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a4b7500f05e4b63b4d79fabde88ebe6) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.234313 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 2801473216a3475384d1494892b8df7b with delete_type TABLET_DATA_DELETED (replaced by tablet 72711f14f26a479c9699b172b41b1db0) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.243955 5355 tablet_service.cc:1511] Processing CreateTablet for tablet cd4c568b96084baeb7438a4857adadc1 (DEFAULT_TABLE table=default.Table_aca59e0ffb234d4c96a55c95d3e0967e [id=9c366b9f762a47eb9a449b565111014a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.244176 5628 ts_tablet_manager.cc:1403] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.001s
I20260927 13:49:45.244396 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4c568b96084baeb7438a4857adadc1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:45.244771 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b95399b042654100a609427597d6fe72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b95399b042654100a609427597d6fe72 already in progress: creating tablet
I20260927 13:49:45.244824 5625 tablet_replica.cc:333] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.245043 5625 raft_consensus.cc:2243] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:45.245271 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 66524dd4f62f4da4be845d5efefe8db1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66524dd4f62f4da4be845d5efefe8db1 already in progress: creating tablet
I20260927 13:49:45.246940 5625 raft_consensus.cc:2272] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.247325 5213 tablet_service.cc:1511] Processing CreateTablet for tablet cd4c568b96084baeb7438a4857adadc1 (DEFAULT_TABLE table=default.Table_aca59e0ffb234d4c96a55c95d3e0967e [id=9c366b9f762a47eb9a449b565111014a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.247786 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4c568b96084baeb7438a4857adadc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.248646 5351 tablet_service.cc:1511] Processing CreateTablet for tablet d2e0b4c217ca41b98013155b8d952fe6 (DEFAULT_TABLE table=default.Table_268838ff93954800813c2850f8dbef43 [id=393d91e6e8194f008d5ef165bcfb6b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.248997 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e0b4c217ca41b98013155b8d952fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.249140 5625 ts_tablet_manager.cc:1916] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.250430 5579 raft_consensus.cc:493] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.250600 5579 raft_consensus.cc:515] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.251382 5579 leader_election.cc:290] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.246488 5083 tablet_service.cc:1511] Processing CreateTablet for tablet cd4c568b96084baeb7438a4857adadc1 (DEFAULT_TABLE table=default.Table_aca59e0ffb234d4c96a55c95d3e0967e [id=9c366b9f762a47eb9a449b565111014a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.252261 5357 tablet_service.cc:1511] Processing CreateTablet for tablet b783ffbf2a05453fa43797ce495f8e7a (DEFAULT_TABLE table=default.Table_4d67b784836e4d3b93bfc13e260f4761 [id=ee0789e9d1f34c3791d35794473e2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.252526 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4c568b96084baeb7438a4857adadc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.252648 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b783ffbf2a05453fa43797ce495f8e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.256448 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b73420c2074d10ab2e78c6f15df93c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:45.260655 5080 tablet_service.cc:1511] Processing CreateTablet for tablet d2e0b4c217ca41b98013155b8d952fe6 (DEFAULT_TABLE table=default.Table_268838ff93954800813c2850f8dbef43 [id=393d91e6e8194f008d5ef165bcfb6b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.260950 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_62b8129916de4fdeaddae3de476de360" } modify_external_catalogs: true
W20260927 13:49:45.261070 5045 leader_election.cc:343] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.261137 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_62b8129916de4fdeaddae3de476de360" } modify_external_catalogs: true
I20260927 13:49:45.261092 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e0b4c217ca41b98013155b8d952fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.264005 5628 raft_consensus.cc:359] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.264405 5619 tablet_bootstrap.cc:492] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:45.264403 5628 raft_consensus.cc:385] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.264592 5628 raft_consensus.cc:740] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.265113 5619 ts_tablet_manager.cc:1403] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.132s user 0.002s sys 0.007s
I20260927 13:49:45.265051 5628 consensus_queue.cc:260] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.266047 5606 rpcz_store.cc:276] 0927 13:49:43.380745 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.380810 (+ 65us) service_pool.cc:224] Handling call
0927 13:49:45.130638 (+1749828us) ts_tablet_manager.cc:1151] Deleting tablet 28309730c01944a7b0c5cecc478a448b
0927 13:49:45.130650 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.139107 (+ 8457us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.200753 (+ 61646us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.230570 (+ 29817us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1744530}
I20260927 13:49:45.267609 5606 tablet_replica.cc:333] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:45.267970 5628 ts_tablet_manager.cc:1434] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260927 13:49:45.268059 5606 raft_consensus.cc:2243] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.268230 5606 raft_consensus.cc:2272] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.268999 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 4295710c33714360b3691f48f47f4293 (table default.Table_97bdee39a93e4f98ae6382e7ab44eda7 [id=2fe2768ea9264c38973e4ed5206c77f2]). Expected version 1 got 0
I20260927 13:49:45.269224 5628 tablet_bootstrap.cc:492] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.269308 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet f443c863d087483493baa4c80bb64670 (table default.Table_5e272c5ede1d42d1931b0872ff6f89c5 [id=3653a6192dca4f8b9df5f4862eb512a8]). Expected version 1 got 0
I20260927 13:49:45.266986 5619 raft_consensus.cc:359] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.269572 5619 raft_consensus.cc:385] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.269672 5619 raft_consensus.cc:740] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.269994 5619 consensus_queue.cc:260] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.270430 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 28309730c01944a7b0c5cecc478a448b (table default.Table_1ea0b188cadc40009b93843fdf653504 [id=c8c17ee713974f8099a439cb16a06056]) successfully deleted
I20260927 13:49:45.270677 5606 ts_tablet_manager.cc:1916] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.270840 5625 ts_tablet_manager.cc:1929] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.271732 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_34e3d06c06ed4b90b3444e8c803d2e07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.272349 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34e3d06c06ed4b90b3444e8c803d2e07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.273710 5625 log.cc:1199] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b4bdd64d67d94276b20ab862dec0d2ee
I20260927 13:49:45.274084 5625 ts_tablet_manager.cc:1950] T b4bdd64d67d94276b20ab862dec0d2ee P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.271370 5628 tablet_bootstrap.cc:654] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.276304 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b4bdd64d67d94276b20ab862dec0d2ee (table default.Table_d8a6c02dc5f54a3cb24bb9cdb9d87eff [id=3a103249799f4a5383c5091fda81153e]) successfully deleted
W20260927 13:49:45.278405 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 169e64b6e20544e6ad1bc31c7ec29cf2 because the tablet was not found. No further retry: Not found: Tablet not found: 169e64b6e20544e6ad1bc31c7ec29cf2
W20260927 13:49:45.279490 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7e6721aa2fa0437eae7ca052c19f0f2e because the tablet was not found. No further retry: Not found: Tablet not found: 7e6721aa2fa0437eae7ca052c19f0f2e
W20260927 13:49:45.280516 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet c6d69f70750d4b418f850b2cec3ad721 because the tablet was not found. No further retry: Not found: Tablet not found: c6d69f70750d4b418f850b2cec3ad721
I20260927 13:49:45.281356 5625 tablet_replica.cc:333] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.281560 5625 raft_consensus.cc:2243] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.281744 5625 raft_consensus.cc:2272] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.282307 5625 ts_tablet_manager.cc:1916] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.284286 4924 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 4295710c33714360b3691f48f47f4293 (table default.Table_97bdee39a93e4f98ae6382e7ab44eda7 [id=2fe2768ea9264c38973e4ed5206c77f2]). Expected version 1 got 0
I20260927 13:49:45.284504 4924 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet f443c863d087483493baa4c80bb64670 (table default.Table_5e272c5ede1d42d1931b0872ff6f89c5 [id=3653a6192dca4f8b9df5f4862eb512a8]). Expected version 1 got 0
I20260927 13:49:45.277050 5619 ts_tablet_manager.cc:1434] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260927 13:49:45.285910 5628 tablet_bootstrap.cc:492] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.286160 5628 ts_tablet_manager.cc:1403] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.001s
I20260927 13:49:45.286720 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b8b80eb00244f7cbcc260af06c16a52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.287604 5619 tablet_bootstrap.cc:492] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:45.287545 5628 raft_consensus.cc:359] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.287842 5628 raft_consensus.cc:385] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.287986 5628 raft_consensus.cc:740] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.288347 5628 consensus_queue.cc:260] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.289305 5628 ts_tablet_manager.cc:1434] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 13:49:45.289424 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b73420c2074d10ab2e78c6f15df93c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:45.290550 5044 leader_election.cc:343] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.290724 5044 leader_election.cc:304] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.291183 5579 raft_consensus.cc:2749] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:45.291721 5628 tablet_bootstrap.cc:492] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.293493 5619 tablet_bootstrap.cc:654] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.293845 5591 raft_consensus.cc:493] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.294097 5727 consensus_queue.cc:1048] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260927 13:49:45.295459 5591 raft_consensus.cc:515] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.296314 5217 tablet_service.cc:1511] Processing CreateTablet for tablet d2e0b4c217ca41b98013155b8d952fe6 (DEFAULT_TABLE table=default.Table_268838ff93954800813c2850f8dbef43 [id=393d91e6e8194f008d5ef165bcfb6b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.296658 5591 leader_election.cc:290] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.296705 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e0b4c217ca41b98013155b8d952fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.296077 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_87c2ff7de94d4663aebf61e88f2d5080"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.297895 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87c2ff7de94d4663aebf61e88f2d5080 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.298770 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fb19fb86ea43b0b81d6d42ce2d8a5f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:45.303033 5108 raft_consensus.cc:1275] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Refusing update from remote peer 79c1646c9659434b9a659382d2eb1d8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:45.303702 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet dce1bbbe9dbb443c9f0c001107ffebdf
I20260927 13:49:45.304929 5628 tablet_bootstrap.cc:654] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:45.306136 5185 consensus_peers.cc:597] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a -> Peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Couldn't send request to peer bb28c54312c94d7dafb1c2abf7870735. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:45.306339 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet dce1bbbe9dbb443c9f0c001107ffebdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:45.306385 5185 leader_election.cc:343] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:45.306670 5184 consensus_peers.cc:597] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 991d0dcb68964df99b1bf5b43c890e28. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:45.307322 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet dce1bbbe9dbb443c9f0c001107ffebdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:45.307329 5184 leader_election.cc:343] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 54fb19fb86ea43b0b81d6d42ce2d8a5f
I20260927 13:49:45.307760 5184 leader_election.cc:304] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.309113 5591 raft_consensus.cc:2749] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:45.309505 5754 consensus_queue.cc:1048] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260927 13:49:45.317015 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet dce1bbbe9dbb443c9f0c001107ffebdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.318766 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet b4bdd64d67d94276b20ab862dec0d2ee with delete_type TABLET_DATA_DELETED (replaced by tablet c2fc2734e88e431facdf72e9ef136106) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.321565 5625 ts_tablet_manager.cc:1929] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.324187 5625 log.cc:1199] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/32fa23c312544fac8ef485a35e5ab972
I20260927 13:49:45.324333 5626 tablet_bootstrap.cc:492] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:45.324570 5626 ts_tablet_manager.cc:1403] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.093s user 0.018s sys 0.011s
I20260927 13:49:45.324841 5625 ts_tablet_manager.cc:1950] T 32fa23c312544fac8ef485a35e5ab972 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.326277 5623 ts_tablet_manager.cc:1929] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:45.326473 5623 log.cc:1199] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/c4a6a12dc2814e1d92af53bdfc759175
I20260927 13:49:45.326504 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 32fa23c312544fac8ef485a35e5ab972 (table default.Table_ae1f534af970471bac44446c873faddb [id=a51ccdf3dce04c65b40dd44a1f8c16f1]) successfully deleted
I20260927 13:49:45.327948 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d3a3282d684415858dc971cb02eec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:45.328200 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 60fae0c413e7439c9ab18b01628d8b28 because the tablet was not found. No further retry: Not found: Tablet not found: 60fae0c413e7439c9ab18b01628d8b28
W20260927 13:49:45.331353 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 2801473216a3475384d1494892b8df7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2801473216a3475384d1494892b8df7b already in progress: creating tablet
I20260927 13:49:45.332631 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 (DEFAULT_TABLE table=default.Table_db24dbfc253c4e76ab35b8bb7770eb8b [id=3b60feafc4a7467b8e301307adaa8187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.332964 5080 tablet_service.cc:1511] Processing CreateTablet for tablet b783ffbf2a05453fa43797ce495f8e7a (DEFAULT_TABLE table=default.Table_4d67b784836e4d3b93bfc13e260f4761 [id=ee0789e9d1f34c3791d35794473e2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.333338 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f549f487ea4dbb8c7fceee6f8a6db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.333472 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b783ffbf2a05453fa43797ce495f8e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.335007 5787 raft_consensus.cc:493] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.335148 5787 raft_consensus.cc:515] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.335810 5787 leader_election.cc:290] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:45.337021 5319 leader_election.cc:343] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7e6721aa2fa0437eae7ca052c19f0f2e
I20260927 13:49:45.339488 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6721aa2fa0437eae7ca052c19f0f2e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.341130 5625 tablet_replica.cc:333] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.341768 5625 raft_consensus.cc:2243] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.342423 5625 raft_consensus.cc:2272] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.345256 5606 ts_tablet_manager.cc:1929] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.347672 5623 ts_tablet_manager.cc:1950] T c4a6a12dc2814e1d92af53bdfc759175 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:45.347434 5626 raft_consensus.cc:359] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.347997 5626 raft_consensus.cc:385] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.347921 5221 tablet_service.cc:1511] Processing CreateTablet for tablet b783ffbf2a05453fa43797ce495f8e7a (DEFAULT_TABLE table=default.Table_4d67b784836e4d3b93bfc13e260f4761 [id=ee0789e9d1f34c3791d35794473e2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.348644 5606 log.cc:1199] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/93d57824aab9460b83f912d9c9c8dd68
I20260927 13:49:45.348780 5247 raft_consensus.cc:2468] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:45.348925 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 (DEFAULT_TABLE table=default.Table_db24dbfc253c4e76ab35b8bb7770eb8b [id=3b60feafc4a7467b8e301307adaa8187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.349115 5606 ts_tablet_manager.cc:1950] T 93d57824aab9460b83f912d9c9c8dd68 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:45.349382 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f549f487ea4dbb8c7fceee6f8a6db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.349364 5319 leader_election.cc:304] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:45.346180 5619 tablet_bootstrap.cc:492] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:45.349678 5619 ts_tablet_manager.cc:1403] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.005s
I20260927 13:49:45.349819 5787 raft_consensus.cc:2804] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:45.349996 5626 raft_consensus.cc:740] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.350070 5787 raft_consensus.cc:493] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:45.350198 5787 raft_consensus.cc:3060] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.350251 5626 consensus_queue.cc:260] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.350601 5625 ts_tablet_manager.cc:1916] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.352015 5626 ts_tablet_manager.cc:1434] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260927 13:49:45.352164 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b783ffbf2a05453fa43797ce495f8e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.352725 5626 tablet_bootstrap.cc:492] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:45.353086 5787 raft_consensus.cc:515] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.354995 5732 tablet.cc:1751] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260927 13:49:45.358225 5319 leader_election.cc:343] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7e6721aa2fa0437eae7ca052c19f0f2e
I20260927 13:49:45.359196 4930 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c79b1f2962f44a23916bbfe4cf55a4bc (table default.Table_847c101270804f9f856b7e564cc9fbbe [id=d140ef61df2143d8bd6f44d8f92153c9]). Expected version 1 got 0
I20260927 13:49:45.359315 5787 leader_election.cc:290] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:45.359611 4930 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (table default.Table_0f7abb0c16a04daf8a6f8911afd71804 [id=c16d7a8a2339458b8c973cedf99c32bf]). Expected version 2 got 0
I20260927 13:49:45.362162 5351 tablet_service.cc:1511] Processing CreateTablet for tablet d9b04383cb494f65be7ba507a0f0b441 (DEFAULT_TABLE table=default.Table_f2d64a3ffe674d5ebbab910acdf51b20 [id=d30e7ed235504af3a53544c14e35b456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.361366 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 26) took 2050 ms. Trace:
I20260927 13:49:45.363101 5579 raft_consensus.cc:493] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.363091 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6721aa2fa0437eae7ca052c19f0f2e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:45.363293 5579 raft_consensus.cc:515] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.364004 5579 leader_election.cc:290] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.364883 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56df07d0a524e5184bdc7fc8d95857c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.368062 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b04383cb494f65be7ba507a0f0b441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.368703 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_009df0f55a87479eab602a85d1503bf9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.369338 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_009df0f55a87479eab602a85d1503bf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.370409 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2d2e604b60684aaf8e96c35bdebf8b2e" } new_table_name: "default.Table_aa1bf158677c41169551c2625573ebbe" modify_external_catalogs: true
I20260927 13:49:45.362134 5619 raft_consensus.cc:359] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.364497 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56df07d0a524e5184bdc7fc8d95857c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:45.373575 5619 raft_consensus.cc:385] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.373661 5619 raft_consensus.cc:740] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.373898 5619 consensus_queue.cc:260] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:45.374303 5045 leader_election.cc:343] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.374750 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_de419f4cfd244caeaa7707f22194c5bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:45.375236 5625 ts_tablet_manager.cc:1929] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:49:45.375761 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de419f4cfd244caeaa7707f22194c5bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.376963 5623 rpcz_store.cc:276] 0927 13:49:43.307524 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.309486 (+ 1962us) service_pool.cc:224] Handling call
0927 13:49:45.160648 (+1851162us) ts_tablet_manager.cc:1151] Deleting tablet c4a6a12dc2814e1d92af53bdfc759175
0927 13:49:45.160659 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.229511 (+ 68852us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.326183 (+ 96672us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.357639 (+ 31456us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1850940}
I20260927 13:49:45.377396 5623 tablet_replica.cc:333] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:45.377375 5625 log.cc:1199] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/8b8b80eb00244f7cbcc260af06c16a52
I20260927 13:49:45.377755 5625 ts_tablet_manager.cc:1950] T 8b8b80eb00244f7cbcc260af06c16a52 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.377766 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet c4a6a12dc2814e1d92af53bdfc759175 (table default.Table_7e3e9dcedc5b4da784103acb480dedef [id=81cc900733bf4b35bd0051eb72c0d88d]) successfully deleted
I20260927 13:49:45.378212 5623 raft_consensus.cc:2243] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:45.378335 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 8b8b80eb00244f7cbcc260af06c16a52 (table default.Table_c06fd2ea93254d09a8daffb63dd4a4e5 [id=5562b818949449e8ab5c21843d710d6d]) successfully deleted
I20260927 13:49:45.378487 5623 pending_rounds.cc:70] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
W20260927 13:49:45.378947 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet dce1bbbe9dbb443c9f0c001107ffebdf because the tablet was not found. No further retry: Not found: Tablet not found: dce1bbbe9dbb443c9f0c001107ffebdf
I20260927 13:49:45.379570 5628 tablet_bootstrap.cc:492] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
W20260927 13:49:45.379541 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b4bdd64d67d94276b20ab862dec0d2ee because the tablet was not found. No further retry: Not found: Tablet not found: b4bdd64d67d94276b20ab862dec0d2ee
I20260927 13:49:45.379729 5628 ts_tablet_manager.cc:1403] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.089s user 0.011s sys 0.001s
I20260927 13:49:45.380029 5623 pending_rounds.cc:77] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957570257915904 op_type: NO_OP noop_request { }
I20260927 13:49:45.380151 5623 raft_consensus.cc:2889] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:45.380589 5628 raft_consensus.cc:359] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.380891 5628 raft_consensus.cc:385] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.381018 5628 raft_consensus.cc:740] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.381134 5619 ts_tablet_manager.cc:1434] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.031s user 0.000s sys 0.002s
I20260927 13:49:45.381366 5628 consensus_queue.cc:260] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.381875 5628 ts_tablet_manager.cc:1434] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:45.382551 5628 tablet_bootstrap.cc:492] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.382906 5625 tablet_replica.cc:333] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.383308 5591 raft_consensus.cc:493] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.383371 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_00fb64d2378d4fecbcc59cd9c70072aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.384187 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00fb64d2378d4fecbcc59cd9c70072aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.384244 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4a67727b46b74c27a439bc32c6cb411f" } modify_external_catalogs: true
I20260927 13:49:45.384263 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_123cd6c170fc49fd97317a18b9b14021" } new_table_name: "default.Table_3e04bdb3f0cd4ebea2e3f8efefa7f056" modify_external_catalogs: true
I20260927 13:49:45.384464 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4a67727b46b74c27a439bc32c6cb411f" } modify_external_catalogs: true
I20260927 13:49:45.385623 5625 raft_consensus.cc:2243] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.385701 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_aa90b9036c924ed0a69d948a3f3f2d87" } modify_external_catalogs: true
I20260927 13:49:45.385870 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_aa90b9036c924ed0a69d948a3f3f2d87" } modify_external_catalogs: true
I20260927 13:49:45.386076 5625 raft_consensus.cc:2272] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.386087 5628 tablet_bootstrap.cc:654] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.386318 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_53d78eb35ded40078e11e532d5ed0d25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.386771 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53d78eb35ded40078e11e532d5ed0d25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.387867 5625 ts_tablet_manager.cc:1916] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.388945 5623 raft_consensus.cc:2272] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.389230 5247 raft_consensus.cc:3060] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.391602 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 32) took 2020 ms. Trace:
I20260927 13:49:45.391716 5606 rpcz_store.cc:276] 0927 13:49:43.371390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.371486 (+ 96us) service_pool.cc:224] Handling call
0927 13:49:45.267530 (+1896044us) ts_tablet_manager.cc:1151] Deleting tablet 93d57824aab9460b83f912d9c9c8dd68
0927 13:49:45.267539 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.327738 (+ 60199us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.345158 (+ 17420us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.391560 (+ 46402us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40974,"tablet-delete.queue_time_us":1881314}
I20260927 13:49:45.392082 5247 raft_consensus.cc:2468] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:45.392252 5722 raft_consensus.cc:493] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.392311 5248 raft_consensus.cc:2468] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:45.392494 5626 tablet_bootstrap.cc:654] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.392414 5722 raft_consensus.cc:515] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.393124 5722 leader_election.cc:290] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.393396 5591 raft_consensus.cc:515] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.393905 5591 leader_election.cc:290] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.394219 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 93d57824aab9460b83f912d9c9c8dd68 (table default.Table_357e5541a8744640b98a8e6c1874748d [id=4b6887b0689b4a08a9bf9229a19b3ae7]) successfully deleted
W20260927 13:49:45.394272 5184 leader_election.cc:343] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b0dfe23bef144e438ae762e401f02e8f
W20260927 13:49:45.394942 5184 leader_election.cc:343] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a61eedf06dab4096a397da8ce98a07da
I20260927 13:49:45.394889 5044 leader_election.cc:304] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.395253 5319 leader_election.cc:304] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:45.395360 5579 raft_consensus.cc:2804] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:45.395442 5579 raft_consensus.cc:493] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:45.395539 5579 raft_consensus.cc:3060] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.395790 5787 raft_consensus.cc:2804] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:45.395923 5787 raft_consensus.cc:697] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:45.396214 5787 consensus_queue.cc:237] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.398903 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61eedf06dab4096a397da8ce98a07da" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:45.399366 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfe23bef144e438ae762e401f02e8f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:45.399585 5385 raft_consensus.cc:2468] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:45.402266 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2ffc2d6e22ae4c8a995011874dc6cde0" } new_table_name: "default.Table_f91dab3c58974becbe03c7d55f1a01d4" modify_external_catalogs: true
I20260927 13:49:45.404215 4925 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 4fe6a7394da94edf87166a184a9a04ba (table default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]). Expected version 1 got 0
I20260927 13:49:45.405045 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 (DEFAULT_TABLE table=default.Table_db24dbfc253c4e76ab35b8bb7770eb8b [id=3b60feafc4a7467b8e301307adaa8187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.406371 5083 tablet_service.cc:1511] Processing CreateTablet for tablet d9b04383cb494f65be7ba507a0f0b441 (DEFAULT_TABLE table=default.Table_f2d64a3ffe674d5ebbab910acdf51b20 [id=d30e7ed235504af3a53544c14e35b456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.406528 5579 raft_consensus.cc:515] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.406858 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b04383cb494f65be7ba507a0f0b441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.407270 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f549f487ea4dbb8c7fceee6f8a6db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.407882 5355 tablet_service.cc:1511] Processing CreateTablet for tablet dff5992b27f049f5890e65d5a8dcc3cf (DEFAULT_TABLE table=default.Table_20d4690ba5644595ab69e0049b196531 [id=e6628f5e1e7448fe80da09bdd45dd251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.408255 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff5992b27f049f5890e65d5a8dcc3cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.409657 5606 tablet_replica.cc:333] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:45.410450 5591 raft_consensus.cc:493] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.410625 5591 raft_consensus.cc:515] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.411270 5591 leader_election.cc:290] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.411880 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295710c33714360b3691f48f47f4293" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:45.412060 5625 ts_tablet_manager.cc:1929] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.412109 5107 raft_consensus.cc:2468] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:45.412200 5625 log.cc:1199] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/14d3a3282d684415858dc971cb02eec1
I20260927 13:49:45.412642 5625 ts_tablet_manager.cc:1950] T 14d3a3282d684415858dc971cb02eec1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.412724 5184 leader_election.cc:304] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
W20260927 13:49:45.405131 5185 leader_election.cc:343] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.412936 5185 leader_election.cc:304] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.413070 5591 raft_consensus.cc:2804] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:45.413173 5591 raft_consensus.cc:493] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:45.413254 5591 raft_consensus.cc:3060] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.413419 5185 leader_election.cc:304] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:45.414815 5754 raft_consensus.cc:2749] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:45.414997 5754 raft_consensus.cc:2804] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:45.415083 5754 raft_consensus.cc:493] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:45.415162 5754 raft_consensus.cc:3060] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.416349 5591 raft_consensus.cc:515] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.417629 5591 leader_election.cc:290] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.418545 5217 tablet_service.cc:1511] Processing CreateTablet for tablet dff5992b27f049f5890e65d5a8dcc3cf (DEFAULT_TABLE table=default.Table_20d4690ba5644595ab69e0049b196531 [id=e6628f5e1e7448fe80da09bdd45dd251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.419095 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff5992b27f049f5890e65d5a8dcc3cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.417358 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295710c33714360b3691f48f47f4293" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:45.419288 5107 raft_consensus.cc:3060] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.419734 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 14d3a3282d684415858dc971cb02eec1 (table default.Table_4333e4f147f24db68f8d26c70e28f4a4 [id=ff8466657bb24dd18b44b8d901412d8b]) successfully deleted
I20260927 13:49:45.420361 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56df07d0a524e5184bdc7fc8d95857c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:45.420572 5248 raft_consensus.cc:3060] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.405712 5623 ts_tablet_manager.cc:1916] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.417717 5080 tablet_service.cc:1511] Processing CreateTablet for tablet dff5992b27f049f5890e65d5a8dcc3cf (DEFAULT_TABLE table=default.Table_20d4690ba5644595ab69e0049b196531 [id=e6628f5e1e7448fe80da09bdd45dd251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.422398 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff5992b27f049f5890e65d5a8dcc3cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.423866 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295710c33714360b3691f48f47f4293" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:45.424221 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295710c33714360b3691f48f47f4293" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:45.406509 5221 tablet_service.cc:1511] Processing CreateTablet for tablet d9b04383cb494f65be7ba507a0f0b441 (DEFAULT_TABLE table=default.Table_f2d64a3ffe674d5ebbab910acdf51b20 [id=d30e7ed235504af3a53544c14e35b456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.424706 5358 tablet_service.cc:1511] Processing CreateTablet for tablet a8c1b74943b9479e8b37969b2933c5a4 (DEFAULT_TABLE table=default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.424732 5754 raft_consensus.cc:515] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.425079 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c1b74943b9479e8b37969b2933c5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.425336 5754 leader_election.cc:290] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.426949 5107 raft_consensus.cc:2468] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:45.428560 5248 raft_consensus.cc:2468] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:45.429222 5184 leader_election.cc:304] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:45.430368 5579 leader_election.cc:290] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.430624 5754 raft_consensus.cc:2804] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:45.430823 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56df07d0a524e5184bdc7fc8d95857c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:45.431083 5754 raft_consensus.cc:697] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
W20260927 13:49:45.432027 5045 leader_election.cc:343] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.431380 5754 consensus_queue.cc:237] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.434165 5606 raft_consensus.cc:2243] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.434551 5044 leader_election.cc:304] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.434650 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0dfe23bef144e438ae762e401f02e8f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:45.434834 5385 raft_consensus.cc:3060] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:45.435155 5185 leader_election.cc:343] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:45.435501 5185 leader_election.cc:343] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.435845 5750 raft_consensus.cc:2804] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:45.438038 5385 raft_consensus.cc:2468] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:45.438707 5606 raft_consensus.cc:2272] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.439251 5579 raft_consensus.cc:493] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.439421 5579 raft_consensus.cc:515] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.440021 5606 ts_tablet_manager.cc:1916] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:45.440348 5184 leader_election.cc:343] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b0dfe23bef144e438ae762e401f02e8f
I20260927 13:49:45.440529 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b04383cb494f65be7ba507a0f0b441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.442662 5185 leader_election.cc:304] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:45.447685 5722 raft_consensus.cc:2804] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:45.447834 5722 raft_consensus.cc:697] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:45.448129 5722 consensus_queue.cc:237] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.450503 5623 ts_tablet_manager.cc:1929] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:45.450685 5623 log.cc:1199] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/93d57824aab9460b83f912d9c9c8dd68
I20260927 13:49:45.451257 5623 ts_tablet_manager.cc:1950] T 93d57824aab9460b83f912d9c9c8dd68 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:45.452183 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 24) took 2146 ms. Trace:
I20260927 13:49:45.457967 5579 leader_election.cc:290] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.458717 5750 raft_consensus.cc:697] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:45.458931 5623 rpcz_store.cc:276] 0927 13:49:43.305253 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.309756 (+ 4503us) service_pool.cc:224] Handling call
0927 13:49:45.377319 (+2067563us) ts_tablet_manager.cc:1151] Deleting tablet 93d57824aab9460b83f912d9c9c8dd68
0927 13:49:45.377332 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.446212 (+ 68880us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.450411 (+ 4199us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.452130 (+ 1719us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2067411}
I20260927 13:49:45.453465 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79b1f2962f44a23916bbfe4cf55a4bc" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.459376 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 32) took 2099 ms. Trace:
I20260927 13:49:45.459491 5623 rpcz_store.cc:276] 0927 13:49:43.360378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.360897 (+ 519us) service_pool.cc:224] Handling call
0927 13:49:45.459260 (+2098363us) ts_tablet_manager.cc:1151] Deleting tablet 8ebc0095d7414152a8abd08a65328974
0927 13:49:45.459269 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.459339 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2096134}
W20260927 13:49:45.459723 5044 leader_election.cc:343] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.459801 5623 tablet_replica.cc:333] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:45.460005 5623 raft_consensus.cc:2243] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.460170 5623 raft_consensus.cc:2272] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.459095 5750 consensus_queue.cc:237] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.460564 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 93d57824aab9460b83f912d9c9c8dd68 (table default.Table_357e5541a8744640b98a8e6c1874748d [id=4b6887b0689b4a08a9bf9229a19b3ae7]) successfully deleted
I20260927 13:49:45.460696 5623 ts_tablet_manager.cc:1916] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:45.460839 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 8ebc0095d7414152a8abd08a65328974 because the tablet was not found. No further retry: Not found: Tablet not found: 8ebc0095d7414152a8abd08a65328974
I20260927 13:49:45.445449 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79b1f2962f44a23916bbfe4cf55a4bc" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:45.463150 5045 leader_election.cc:343] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.463305 5045 leader_election.cc:304] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.464744 5080 tablet_service.cc:1511] Processing CreateTablet for tablet a8c1b74943b9479e8b37969b2933c5a4 (DEFAULT_TABLE table=default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.465291 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c1b74943b9479e8b37969b2933c5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.465368 5817 tablet.cc:1751] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:45.470082 5081 tablet_service.cc:1511] Processing CreateTablet for tablet dce1bbbe9dbb443c9f0c001107ffebdf (DEFAULT_TABLE table=default.Table_62b8129916de4fdeaddae3de476de360 [id=f6be2f3e0bb749108e056578f8d3cd75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.470498 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce1bbbe9dbb443c9f0c001107ffebdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.472326 5089 tablet_service.cc:1511] Processing CreateTablet for tablet b0fd6fb92eb64e948e67f70c512376e2 (DEFAULT_TABLE table=default.Table_10932d72525a4a12a6543c89e1a3b19d [id=aa02060d09be44a7ad563c010ba2b274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.472708 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fd6fb92eb64e948e67f70c512376e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.473650 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1716b29ed09743aabc7f196195efefdf" } modify_external_catalogs: true
I20260927 13:49:45.473824 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1716b29ed09743aabc7f196195efefdf" } modify_external_catalogs: true
I20260927 13:49:45.478214 5220 tablet_service.cc:1511] Processing CreateTablet for tablet dce1bbbe9dbb443c9f0c001107ffebdf (DEFAULT_TABLE table=default.Table_62b8129916de4fdeaddae3de476de360 [id=f6be2f3e0bb749108e056578f8d3cd75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.478658 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce1bbbe9dbb443c9f0c001107ffebdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.481022 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 (DEFAULT_TABLE table=default.Table_88c5377676df4e3fb778d2781ed7a546 [id=36caa6d3649b47efb7e95cab54ca2608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.481494 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4b7500f05e4b63b4d79fabde88ebe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.483735 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet df271399b2c84653ac4a5b74efdc0197
W20260927 13:49:45.483826 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7cb2864ea38b4a538884a2c728f08313 consensus state has no leader
I20260927 13:49:45.484268 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_dfa0edbdb581445c9522850dade3fc99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:45.484475 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fad5e15f224c4392a6245ad0fcdf29d1" } new_table_name: "default.Table_bf207d12ec6444c8a164ae27e8055482" modify_external_catalogs: true
W20260927 13:49:45.484886 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfa0edbdb581445c9522850dade3fc99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.485029 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 0018704e08254c2e8d30c7067df4420c (DEFAULT_TABLE table=default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.485462 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0018704e08254c2e8d30c7067df4420c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:45.485764 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7681d137476040788e40dd787ce74ccd consensus state has no leader
I20260927 13:49:45.486158 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_393b924b35284f7ab739c7df3b388bf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.486670 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_393b924b35284f7ab739c7df3b388bf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.486976 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet df271399b2c84653ac4a5b74efdc0197 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.487639 4928 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (table default.Table_0f7abb0c16a04daf8a6f8911afd71804 [id=c16d7a8a2339458b8c973cedf99c32bf]). Expected version 2 got 0
W20260927 13:49:45.489243 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet df271399b2c84653ac4a5b74efdc0197 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df271399b2c84653ac4a5b74efdc0197 already in progress: creating tablet
I20260927 13:49:45.490646 4922 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 431c9505eec14af4af8cff672fb809aa
I20260927 13:49:45.490986 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5344269f62464fe7b79f4ec748b4abe7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.491431 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5344269f62464fe7b79f4ec748b4abe7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.494729 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f0f1b6b8e509487daa886cd3ad6645f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.495273 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0f1b6b8e509487daa886cd3ad6645f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.496814 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_db24dbfc253c4e76ab35b8bb7770eb8b" } modify_external_catalogs: true
I20260927 13:49:45.496987 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_db24dbfc253c4e76ab35b8bb7770eb8b" } modify_external_catalogs: true
W20260927 13:49:45.498612 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72711f14f26a479c9699b172b41b1db0 has no consensus state
I20260927 13:49:45.498952 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4d0bfc64d4b3422b8538a8024c9a68a6" } new_table_name: "default.Table_71b0f958b1ec49bf9f334180403b5e3f" modify_external_catalogs: true
I20260927 13:49:45.501159 4925 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_0f7abb0c16a04daf8a6f8911afd71804 [id=c16d7a8a2339458b8c973cedf99c32bf] alter complete (version 2)
I20260927 13:49:45.507784 5628 tablet_bootstrap.cc:492] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.507956 5628 ts_tablet_manager.cc:1403] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.126s user 0.012s sys 0.018s
I20260927 13:49:45.508952 5628 raft_consensus.cc:359] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.509178 5628 raft_consensus.cc:385] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.509271 5628 raft_consensus.cc:740] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.509529 5628 consensus_queue.cc:260] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.510706 5579 raft_consensus.cc:2749] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:45.511904 5579 raft_consensus.cc:493] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.512033 5628 ts_tablet_manager.cc:1434] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:49:45.512133 5579 raft_consensus.cc:515] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.512920 5628 tablet_bootstrap.cc:492] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.512882 5579 leader_election.cc:290] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.517360 5628 tablet_bootstrap.cc:654] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.518148 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 4fe6a7394da94edf87166a184a9a04ba (table default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]). Expected version 1 got 0
I20260927 13:49:45.518500 4925 catalog_manager.cc:5838] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65). New cstate: current_term: 1 leader_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:45.519481 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2a2ba67436a544e98788e9c1b00a1c33
I20260927 13:49:45.519608 4928 master_service.cc:960] ReplaceTablet: received request to replace tablet 399d6411d8ad4354b3c0f8f4d78779a9 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.520164 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ba67436a544e98788e9c1b00a1c33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.520578 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet 7cb2864ea38b4a538884a2c728f08313 from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:45.520754 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 2a2ba67436a544e98788e9c1b00a1c33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a2ba67436a544e98788e9c1b00a1c33 already in progress: creating tablet
I20260927 13:49:45.521905 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d1197bee2d477ab77d15cbd4907595" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:45.522615 5045 leader_election.cc:343] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.525699 5619 tablet_bootstrap.cc:492] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:45.528683 5358 tablet_service.cc:1511] Processing CreateTablet for tablet b0fd6fb92eb64e948e67f70c512376e2 (DEFAULT_TABLE table=default.Table_10932d72525a4a12a6543c89e1a3b19d [id=aa02060d09be44a7ad563c010ba2b274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.529204 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fd6fb92eb64e948e67f70c512376e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.531078 5628 tablet_bootstrap.cc:492] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.531253 5628 ts_tablet_manager.cc:1403] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260927 13:49:45.532181 5628 raft_consensus.cc:359] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.532433 5628 raft_consensus.cc:385] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.532513 5628 raft_consensus.cc:740] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.532874 5628 consensus_queue.cc:260] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.534603 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 (DEFAULT_TABLE table=default.Table_88c5377676df4e3fb778d2781ed7a546 [id=36caa6d3649b47efb7e95cab54ca2608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.535023 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ba67436a544e98788e9c1b00a1c33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.536450 5628 ts_tablet_manager.cc:1434] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260927 13:49:45.536525 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet df271399b2c84653ac4a5b74efdc0197 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.537195 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4b7500f05e4b63b4d79fabde88ebe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.538022 5628 tablet_bootstrap.cc:492] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.539671 5750 raft_consensus.cc:493] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.539827 5750 raft_consensus.cc:515] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.540823 5750 leader_election.cc:290] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.541092 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 0018704e08254c2e8d30c7067df4420c (DEFAULT_TABLE table=default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.541595 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0018704e08254c2e8d30c7067df4420c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.542590 5628 tablet_bootstrap.cc:654] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.550982 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f443c863d087483493baa4c80bb64670" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:45.551680 5045 leader_election.cc:343] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.553786 5619 tablet_bootstrap.cc:654] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.554488 5628 tablet_bootstrap.cc:492] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.554659 5628 ts_tablet_manager.cc:1403] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.001s
I20260927 13:49:45.555580 5628 raft_consensus.cc:359] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.555796 5628 raft_consensus.cc:385] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.555891 5628 raft_consensus.cc:740] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.556260 5628 consensus_queue.cc:260] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.558915 5628 ts_tablet_manager.cc:1434] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:45.559302 5628 tablet_bootstrap.cc:492] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.568610 5628 tablet_bootstrap.cc:654] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.569294 5355 tablet_service.cc:1511] Processing CreateTablet for tablet dce1bbbe9dbb443c9f0c001107ffebdf (DEFAULT_TABLE table=default.Table_62b8129916de4fdeaddae3de476de360 [id=f6be2f3e0bb749108e056578f8d3cd75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.571094 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce1bbbe9dbb443c9f0c001107ffebdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.576586 5628 tablet_bootstrap.cc:492] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.576786 5628 ts_tablet_manager.cc:1403] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.004s
I20260927 13:49:45.577729 5628 raft_consensus.cc:359] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.577966 5628 raft_consensus.cc:385] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.578043 5628 raft_consensus.cc:740] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.578414 5628 consensus_queue.cc:260] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.582862 5628 ts_tablet_manager.cc:1434] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260927 13:49:45.585347 5628 tablet_bootstrap.cc:492] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.588059 5628 tablet_bootstrap.cc:654] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:45.591223 4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.125:42239, user_credentials={real_user=slave}} blocked reactor thread for 63312.8us
I20260927 13:49:45.597368 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet 4fe6a7394da94edf87166a184a9a04ba from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.597437 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f2d64a3ffe674d5ebbab910acdf51b20" } modify_external_catalogs: true
I20260927 13:49:45.597612 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f2d64a3ffe674d5ebbab910acdf51b20" } modify_external_catalogs: true
I20260927 13:49:45.597880 5628 tablet_bootstrap.cc:492] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.598042 5628 ts_tablet_manager.cc:1403] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.001s
I20260927 13:49:45.598762 4929 master_service.cc:960] ReplaceTablet: received request to replace tablet 6bb5fdbfebd5401e92186997f9a30d36 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.599231 5628 raft_consensus.cc:359] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.599458 5628 raft_consensus.cc:385] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.599552 5628 raft_consensus.cc:740] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.599807 5628 consensus_queue.cc:260] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:45.599987 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cc174eab36b46fb8e276b3168fbfbcd has no consensus state
I20260927 13:49:45.600260 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet f443c863d087483493baa4c80bb64670 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.603511 5628 ts_tablet_manager.cc:1434] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:49:45.604038 5628 tablet_bootstrap.cc:492] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.606403 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 77f549f487ea4dbb8c7fceee6f8a6db0
I20260927 13:49:45.606901 5628 tablet_bootstrap.cc:654] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.607123 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d47e75198129467fb676323164970dc6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.607700 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d47e75198129467fb676323164970dc6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.608295 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8e62dc01ecf2498e92021a381e28862a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.608759 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e62dc01ecf2498e92021a381e28862a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:45.609929 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5bf9ba5d857421ebc783d4c567f411c has no consensus state
I20260927 13:49:45.610725 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.610816 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 399d6411d8ad4354b3c0f8f4d78779a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.611323 5625 tablet_replica.cc:333] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.611574 5625 raft_consensus.cc:2243] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.611752 5625 raft_consensus.cc:2272] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.612422 5628 tablet_bootstrap.cc:492] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.612566 5628 ts_tablet_manager.cc:1403] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260927 13:49:45.612653 5625 ts_tablet_manager.cc:1916] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:45.612691 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77f549f487ea4dbb8c7fceee6f8a6db0 already in progress: creating tablet
I20260927 13:49:45.614585 5628 raft_consensus.cc:359] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.615265 5628 raft_consensus.cc:385] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.615347 5628 raft_consensus.cc:740] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.615371 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 7cb2864ea38b4a538884a2c728f08313
I20260927 13:49:45.616048 5628 consensus_queue.cc:260] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.616202 4923 catalog_manager.cc:6934] ReplaceTablet: tablet 7cb2864ea38b4a538884a2c728f08313 deleted and replaced by tablet 0caf934bc99c4ad38eea5fc812b60931
I20260927 13:49:45.616734 5628 ts_tablet_manager.cc:1434] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:45.616964 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cb2864ea38b4a538884a2c728f08313 with delete_type TABLET_DATA_DELETED (replaced by tablet 0caf934bc99c4ad38eea5fc812b60931) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.617059 5628 tablet_bootstrap.cc:492] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.617136 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cb2864ea38b4a538884a2c728f08313 with delete_type TABLET_DATA_DELETED (replaced by tablet 0caf934bc99c4ad38eea5fc812b60931) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.618276 5619 tablet_bootstrap.cc:492] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:45.618422 5619 ts_tablet_manager.cc:1403] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.161s user 0.000s sys 0.006s
I20260927 13:49:45.618857 5628 tablet_bootstrap.cc:654] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.619417 5619 raft_consensus.cc:359] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.619585 5619 raft_consensus.cc:385] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.619663 5619 raft_consensus.cc:740] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.619961 5619 consensus_queue.cc:260] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.623553 5619 ts_tablet_manager.cc:1434] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:45.623879 5619 tablet_bootstrap.cc:492] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:45.624670 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 587471d2b7e647388e7bb1e7f8e06b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.624941 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 66524dd4f62f4da4be845d5efefe8db1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.625133 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc612cbcd5d4755a188408f2a036f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.625792 5619 tablet_bootstrap.cc:654] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.626060 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.627113 5628 tablet_bootstrap.cc:492] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.627243 5628 ts_tablet_manager.cc:1403] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260927 13:49:45.627573 5606 ts_tablet_manager.cc:1929] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:45.627697 5606 log.cc:1199] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/c4a6a12dc2814e1d92af53bdfc759175
I20260927 13:49:45.628080 5606 ts_tablet_manager.cc:1950] T c4a6a12dc2814e1d92af53bdfc759175 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:45.628435 5628 raft_consensus.cc:359] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.628618 5628 raft_consensus.cc:385] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.628703 5628 raft_consensus.cc:740] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.628844 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 34) took 2242 ms. Trace:
I20260927 13:49:45.628933 5606 rpcz_store.cc:276] 0927 13:49:43.389873 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.399963 (+ 10090us) service_pool.cc:224] Handling call
0927 13:49:45.409585 (+2009622us) ts_tablet_manager.cc:1151] Deleting tablet c4a6a12dc2814e1d92af53bdfc759175
0927 13:49:45.409596 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.565068 (+155472us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.627496 (+ 62428us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.628792 (+ 1296us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1972029}
I20260927 13:49:45.628978 5628 consensus_queue.cc:260] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.629588 5628 ts_tablet_manager.cc:1434] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:45.629565 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet c4a6a12dc2814e1d92af53bdfc759175 (table default.Table_7e3e9dcedc5b4da784103acb480dedef [id=81cc900733bf4b35bd0051eb72c0d88d]) successfully deleted
I20260927 13:49:45.629873 5628 tablet_bootstrap.cc:492] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.631026 5606 tablet_replica.cc:333] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:45.631210 5606 raft_consensus.cc:2243] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.631599 5628 tablet_bootstrap.cc:654] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.632954 4923 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 79514522a9d142438fd6aecc91f0463e (table default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 4 got 0
I20260927 13:49:45.634526 5625 ts_tablet_manager.cc:1929] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.634795 5625 log.cc:1199] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/399d6411d8ad4354b3c0f8f4d78779a9
I20260927 13:49:45.635514 5625 ts_tablet_manager.cc:1950] T 399d6411d8ad4354b3c0f8f4d78779a9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.636356 4923 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 7681d137476040788e40dd787ce74ccd (table default.Table_f91dab3c58974becbe03c7d55f1a01d4 [id=a22a9a93ae2543e583d24dd648813233]). Expected version 2 got 0
I20260927 13:49:45.636917 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 6bb5fdbfebd5401e92186997f9a30d36
I20260927 13:49:45.637524 4929 catalog_manager.cc:6934] ReplaceTablet: tablet 6bb5fdbfebd5401e92186997f9a30d36 deleted and replaced by tablet 825a73d47bff4246965be82eb482f7aa
I20260927 13:49:45.638639 5606 raft_consensus.cc:2272] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.639201 5606 ts_tablet_manager.cc:1916] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.639863 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 3663033220094a4ea6df8e2982eb2188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.640097 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb5fdbfebd5401e92186997f9a30d36 with delete_type TABLET_DATA_DELETED (replaced by tablet 825a73d47bff4246965be82eb482f7aa) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.640354 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 399d6411d8ad4354b3c0f8f4d78779a9 (table default.Table_ba82da1367c447beadfb286a237a81de [id=3557e871819045648d0e38a96c9d6b52]) successfully deleted
I20260927 13:49:45.640847 5628 tablet_bootstrap.cc:492] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.641004 5628 ts_tablet_manager.cc:1403] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.006s
W20260927 13:49:45.641027 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7cb2864ea38b4a538884a2c728f08313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cb2864ea38b4a538884a2c728f08313 already in progress: creating tablet
I20260927 13:49:45.641815 5625 tablet_replica.cc:333] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.644766 5385 raft_consensus.cc:3060] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.646348 5625 raft_consensus.cc:2243] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.646538 5625 raft_consensus.cc:2272] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.642221 5628 raft_consensus.cc:359] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.646719 5628 raft_consensus.cc:385] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.646806 5628 raft_consensus.cc:740] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.647037 5628 consensus_queue.cc:260] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.647892 5619 tablet_bootstrap.cc:492] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:45.648104 5619 ts_tablet_manager.cc:1403] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.001s
I20260927 13:49:45.648330 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb5fdbfebd5401e92186997f9a30d36 with delete_type TABLET_DATA_DELETED (replaced by tablet 825a73d47bff4246965be82eb482f7aa) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.648469 5628 ts_tablet_manager.cc:1434] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260927 13:49:45.648799 5628 tablet_bootstrap.cc:492] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.650333 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet d9b04383cb494f65be7ba507a0f0b441
I20260927 13:49:45.650388 5628 tablet_bootstrap.cc:654] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.651448 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b04383cb494f65be7ba507a0f0b441 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.651791 5625 ts_tablet_manager.cc:1916] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.652393 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet f443c863d087483493baa4c80bb64670
I20260927 13:49:45.652812 4926 catalog_manager.cc:6934] ReplaceTablet: tablet f443c863d087483493baa4c80bb64670 deleted and replaced by tablet c989f70385f64593a46f633c98267627
I20260927 13:49:45.653359 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet f443c863d087483493baa4c80bb64670 with delete_type TABLET_DATA_DELETED (replaced by tablet c989f70385f64593a46f633c98267627) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.654263 5619 raft_consensus.cc:359] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.654450 5619 raft_consensus.cc:385] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.654516 5619 raft_consensus.cc:740] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.654826 5619 consensus_queue.cc:260] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.655607 5619 ts_tablet_manager.cc:1434] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 13:49:45.656347 5619 tablet_bootstrap.cc:492] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:45.657240 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet f443c863d087483493baa4c80bb64670 with delete_type TABLET_DATA_DELETED (replaced by tablet c989f70385f64593a46f633c98267627) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.660535 5606 ts_tablet_manager.cc:1929] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.660640 5606 log.cc:1199] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b4d56bd86f814c9ead4a52f133d1c818
I20260927 13:49:45.661019 5606 ts_tablet_manager.cc:1950] T b4d56bd86f814c9ead4a52f133d1c818 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:45.661772 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 48) took 1892 ms. Trace:
I20260927 13:49:45.661882 5606 rpcz_store.cc:276] 0927 13:49:43.769388 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.769444 (+ 56us) service_pool.cc:224] Handling call
0927 13:49:45.630937 (+1861493us) ts_tablet_manager.cc:1151] Deleting tablet b4d56bd86f814c9ead4a52f133d1c818
0927 13:49:45.630948 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.642843 (+ 11895us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.660451 (+ 17608us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.661725 (+ 1274us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1861220}
I20260927 13:49:45.662158 5625 ts_tablet_manager.cc:1929] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.662281 5625 log.cc:1199] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/587471d2b7e647388e7bb1e7f8e06b40
I20260927 13:49:45.662339 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b4d56bd86f814c9ead4a52f133d1c818 (table default.Table_78b63dc8b0d74924b9db859769aebe53 [id=dba93d9f1c5045b29c27827599701cc9]) successfully deleted
I20260927 13:49:45.662657 5625 ts_tablet_manager.cc:1950] T 587471d2b7e647388e7bb1e7f8e06b40 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.663044 5619 tablet_bootstrap.cc:654] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.663746 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 587471d2b7e647388e7bb1e7f8e06b40 (table default.Table_f7b0ebc78f334f75b9104777be4c6c68 [id=f44e5332ddd545c3b7e52da7a624181a]) successfully deleted
I20260927 13:49:45.664121 5625 tablet_replica.cc:333] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.664376 5625 raft_consensus.cc:2243] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.664552 5625 raft_consensus.cc:2272] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.665366 5625 ts_tablet_manager.cc:1916] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.672526 5625 ts_tablet_manager.cc:1929] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.672648 5625 log.cc:1199] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/66524dd4f62f4da4be845d5efefe8db1
I20260927 13:49:45.672940 5625 ts_tablet_manager.cc:1950] T 66524dd4f62f4da4be845d5efefe8db1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.673939 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 66524dd4f62f4da4be845d5efefe8db1 (table default.Table_87280d4336274cfe980ae3cd3148a0f6 [id=5b0f9f411500412ca8745dfe54c6cfe5]) successfully deleted
I20260927 13:49:45.674324 5625 tablet_replica.cc:333] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.674551 5625 raft_consensus.cc:2243] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.674746 5625 raft_consensus.cc:2272] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.675542 5625 ts_tablet_manager.cc:1916] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.676056 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (table default.Table_0f7abb0c16a04daf8a6f8911afd71804 [id=c16d7a8a2339458b8c973cedf99c32bf]). Expected version 2 got 0
I20260927 13:49:45.679850 5628 tablet_bootstrap.cc:492] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.680003 5628 ts_tablet_manager.cc:1403] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.004s
I20260927 13:49:45.680920 5628 raft_consensus.cc:359] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.681118 5628 raft_consensus.cc:385] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.681212 5628 raft_consensus.cc:740] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.681447 5628 consensus_queue.cc:260] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.683655 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b04383cb494f65be7ba507a0f0b441 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.683797 5628 ts_tablet_manager.cc:1434] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:49:45.684508 5625 ts_tablet_manager.cc:1929] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.684635 5625 log.cc:1199] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/7dc612cbcd5d4755a188408f2a036f34
I20260927 13:49:45.685029 5625 ts_tablet_manager.cc:1950] T 7dc612cbcd5d4755a188408f2a036f34 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.685672 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 47) took 1916 ms. Trace:
I20260927 13:49:45.685794 5606 rpcz_store.cc:276] 0927 13:49:43.769168 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.772527 (+ 3359us) service_pool.cc:224] Handling call
0927 13:49:45.685505 (+1912978us) ts_tablet_manager.cc:1151] Deleting tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f
0927 13:49:45.685517 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.685633 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1912728}
I20260927 13:49:45.686156 5606 tablet_replica.cc:333] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:45.686272 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 7dc612cbcd5d4755a188408f2a036f34 (table default.Table_6f09b6613d87411faca990bffef9d028 [id=7f846a3fd7cf4362870ca0e938dd45bd]) successfully deleted
I20260927 13:49:45.686357 5606 raft_consensus.cc:2243] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:45.686368 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f already in progress: creating tablet
I20260927 13:49:45.686519 5606 raft_consensus.cc:2272] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.686653 5625 tablet_replica.cc:333] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.686903 5625 raft_consensus.cc:2243] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.687317 5628 tablet_bootstrap.cc:492] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.687074 5625 raft_consensus.cc:2272] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.689214 5625 ts_tablet_manager.cc:1916] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.689194 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_791bee87bef64e35bb7c22d8611be6d5" } modify_external_catalogs: true
I20260927 13:49:45.689392 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_791bee87bef64e35bb7c22d8611be6d5" } modify_external_catalogs: true
I20260927 13:49:45.689751 5619 tablet_bootstrap.cc:492] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:45.689884 5619 ts_tablet_manager.cc:1403] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.003s
I20260927 13:49:45.690083 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c6db22e8533b46fe9fc3a57a0bdcbc9b" } new_table_name: "default.Table_67437b4c9aca4cad9e3206df11173845" modify_external_catalogs: true
I20260927 13:49:45.691828 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8e62dc01ecf2498e92021a381e28862a" } new_table_name: "default.Table_178d88a5d7a44720b4c553f38d8fd9d7" modify_external_catalogs: true
I20260927 13:49:45.697733 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f3b7b12a18cd41dc98240136b5611848"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.698305 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3b7b12a18cd41dc98240136b5611848 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.699738 5625 ts_tablet_manager.cc:1929] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.697775 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4acaf9798ba44467a19273723178f257"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.700138 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4acaf9798ba44467a19273723178f257 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.700163 5628 tablet_bootstrap.cc:654] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.701407 5625 log.cc:1199] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/3663033220094a4ea6df8e2982eb2188
I20260927 13:49:45.701608 5823 raft_consensus.cc:493] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.701853 5625 ts_tablet_manager.cc:1950] T 3663033220094a4ea6df8e2982eb2188 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.701756 5823 raft_consensus.cc:515] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.702634 5823 leader_election.cc:290] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.703430 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe6a7394da94edf87166a184a9a04ba" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:45.703837 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 3663033220094a4ea6df8e2982eb2188 (table default.Table_a9cae6841bf84f09bdea303110cd78ad [id=17e5201d16ce4ce59807538c4e68b495]) successfully deleted
W20260927 13:49:45.704005 5045 leader_election.cc:343] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.704627 5619 raft_consensus.cc:359] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.705235 5619 raft_consensus.cc:385] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.705492 5619 raft_consensus.cc:740] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.705852 5625 tablet_replica.cc:333] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.706096 5625 raft_consensus.cc:2243] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.705904 5619 consensus_queue.cc:260] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.706355 5625 raft_consensus.cc:2272] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:45.706975 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0004ef0b2dd841ac860798d804374dc1 has no consensus state
I20260927 13:49:45.708046 5625 ts_tablet_manager.cc:1916] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.711215 5619 ts_tablet_manager.cc:1434] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.021s user 0.000s sys 0.003s
I20260927 13:49:45.712263 5619 tablet_bootstrap.cc:492] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:45.716147 5619 tablet_bootstrap.cc:654] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:45.717319 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 129c2f99d5b143b3bd25731cfeb0009e has no consensus state
I20260927 13:49:45.719312 5628 tablet_bootstrap.cc:492] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.719524 5628 ts_tablet_manager.cc:1403] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.002s
I20260927 13:49:45.720337 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7dacecf959774572955f40d737467ebd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:45.720469 5628 raft_consensus.cc:359] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.720700 5628 raft_consensus.cc:385] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.720777 5628 raft_consensus.cc:740] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.721068 5628 consensus_queue.cc:260] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:45.721257 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7dacecf959774572955f40d737467ebd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.716822 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet ab9ac0e6083343debabc043435c54d95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.722218 5628 ts_tablet_manager.cc:1434] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260927 13:49:45.723196 5628 tablet_bootstrap.cc:492] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.723225 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_88c5377676df4e3fb778d2781ed7a546" } modify_external_catalogs: true
I20260927 13:49:45.723416 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_88c5377676df4e3fb778d2781ed7a546" } modify_external_catalogs: true
I20260927 13:49:45.725370 5628 tablet_bootstrap.cc:654] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.726227 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7eb7d784240942aa8d68de267ce1a586"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.727003 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7eb7d784240942aa8d68de267ce1a586 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.729140 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_dfa0edbdb581445c9522850dade3fc99" } modify_external_catalogs: true
I20260927 13:49:45.729326 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_dfa0edbdb581445c9522850dade3fc99" } modify_external_catalogs: true
I20260927 13:49:45.729563 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5b8d20a834144e15bc76cbfce0c082b8" } new_table_name: "default.Table_74f9ae67b4d74b60b0b23b5597426bf9" modify_external_catalogs: true
I20260927 13:49:45.729974 5625 ts_tablet_manager.cc:1929] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.730096 5625 log.cc:1199] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/6bb5fdbfebd5401e92186997f9a30d36
I20260927 13:49:45.730522 5625 ts_tablet_manager.cc:1950] T 6bb5fdbfebd5401e92186997f9a30d36 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.731705 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 6bb5fdbfebd5401e92186997f9a30d36 (table default.Table_5b8d20a834144e15bc76cbfce0c082b8 [id=119de2adb4d24563b76c6099dec2d9a9]) successfully deleted
W20260927 13:49:45.732610 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet d9b04383cb494f65be7ba507a0f0b441 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9b04383cb494f65be7ba507a0f0b441 already in progress: creating tablet
I20260927 13:49:45.733107 5625 tablet_replica.cc:333] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.733623 5625 raft_consensus.cc:2243] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.734136 5625 raft_consensus.cc:2272] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.736477 5625 ts_tablet_manager.cc:1916] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.737721 5628 tablet_bootstrap.cc:492] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.738320 5628 ts_tablet_manager.cc:1403] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260927 13:49:45.738832 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d1197bee2d477ab77d15cbd4907595" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.739657 5628 raft_consensus.cc:359] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.739925 5628 raft_consensus.cc:385] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.740106 5628 raft_consensus.cc:740] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.740566 5619 tablet_bootstrap.cc:492] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:45.740537 5628 consensus_queue.cc:260] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.740753 5619 ts_tablet_manager.cc:1403] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.001s
I20260927 13:49:45.741340 5628 ts_tablet_manager.cc:1434] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:49:45.741966 5628 tablet_bootstrap.cc:492] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.742347 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 0018704e08254c2e8d30c7067df4420c (DEFAULT_TABLE table=default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.744854 5219 tablet_service.cc:1511] Processing CreateTablet for tablet b0fd6fb92eb64e948e67f70c512376e2 (DEFAULT_TABLE table=default.Table_10932d72525a4a12a6543c89e1a3b19d [id=aa02060d09be44a7ad563c010ba2b274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.741686 5722 consensus_queue.cc:1048] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.094s
W20260927 13:49:45.749225 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 825a73d47bff4246965be82eb482f7aa has no consensus state
W20260927 13:49:45.749540 5184 consensus_peers.cc:597] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 32fa23c312544fac8ef485a35e5ab972. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:45.749836 4925 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 458dfdf4356e44c5ab19216507da714c
I20260927 13:49:45.750806 5628 tablet_bootstrap.cc:654] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.752647 5221 tablet_service.cc:1511] Processing CreateTablet for tablet a8c1b74943b9479e8b37969b2933c5a4 (DEFAULT_TABLE table=default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.757112 5628 tablet_bootstrap.cc:492] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.757316 5628 ts_tablet_manager.cc:1403] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.003s
I20260927 13:49:45.758312 5628 raft_consensus.cc:359] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.758576 5628 raft_consensus.cc:385] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.758673 5628 raft_consensus.cc:740] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.758996 5628 consensus_queue.cc:260] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.760316 5628 ts_tablet_manager.cc:1434] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260927 13:49:45.761090 5628 tablet_bootstrap.cc:492] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.764570 5625 ts_tablet_manager.cc:1929] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.764747 5625 log.cc:1199] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f443c863d087483493baa4c80bb64670
I20260927 13:49:45.765164 5625 ts_tablet_manager.cc:1950] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.766089 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f443c863d087483493baa4c80bb64670 (table default.Table_5e272c5ede1d42d1931b0872ff6f89c5 [id=3653a6192dca4f8b9df5f4862eb512a8]) successfully deleted
I20260927 13:49:45.767844 5628 tablet_bootstrap.cc:654] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.768620 5355 tablet_service.cc:1511] Processing CreateTablet for tablet 2efee56b495340baa6dd51f0f3e2aaa7 (DEFAULT_TABLE table=default.Table_009df0f55a87479eab602a85d1503bf9 [id=1ea34fa23bae4ba88424a02d4e54a803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.769098 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efee56b495340baa6dd51f0f3e2aaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.776139 5628 tablet_bootstrap.cc:492] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.776333 5628 ts_tablet_manager.cc:1403] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.010s
I20260927 13:49:45.777360 5628 raft_consensus.cc:359] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.777855 5628 raft_consensus.cc:385] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.778434 5628 raft_consensus.cc:740] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.778779 5628 consensus_queue.cc:260] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.779533 5628 ts_tablet_manager.cc:1434] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260927 13:49:45.780514 5628 tablet_bootstrap.cc:492] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.783387 5628 tablet_bootstrap.cc:654] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.784427 5619 raft_consensus.cc:359] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.784637 5619 raft_consensus.cc:385] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.784724 5619 raft_consensus.cc:740] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.785035 5619 consensus_queue.cc:260] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.789235 5606 ts_tablet_manager.cc:1916] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.789330 5619 ts_tablet_manager.cc:1434] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.048s user 0.002s sys 0.001s
I20260927 13:49:45.791828 5628 tablet_bootstrap.cc:492] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.792021 5628 ts_tablet_manager.cc:1403] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260927 13:49:45.792939 5628 raft_consensus.cc:359] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.793179 5619 tablet_bootstrap.cc:492] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:45.793195 5628 raft_consensus.cc:385] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.793278 5628 raft_consensus.cc:740] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.793588 5628 consensus_queue.cc:260] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.795116 5628 ts_tablet_manager.cc:1434] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260927 13:49:45.796031 5628 tablet_bootstrap.cc:492] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.796278 4926 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d6c46d0e50a44232a82d00c88d9f63b5 (table default.Table_abad46e19bc54aac8cf5415b2752c808 [id=e65860898b9041118d5fbb8b5aef2df4]). Expected version 1 got 0
I20260927 13:49:45.798012 5619 tablet_bootstrap.cc:654] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.798178 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 2801473216a3475384d1494892b8df7b with delete_type TABLET_DATA_DELETED (replaced by tablet 72711f14f26a479c9699b172b41b1db0) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.798454 5625 tablet_replica.cc:333] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.798698 5625 raft_consensus.cc:2243] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.798878 5625 raft_consensus.cc:2272] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.798964 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet df271399b2c84653ac4a5b74efdc0197 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.800019 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ba67436a544e98788e9c1b00a1c33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.800182 5625 ts_tablet_manager.cc:1916] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.803210 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 2efee56b495340baa6dd51f0f3e2aaa7 (DEFAULT_TABLE table=default.Table_009df0f55a87479eab602a85d1503bf9 [id=1ea34fa23bae4ba88424a02d4e54a803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.803689 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efee56b495340baa6dd51f0f3e2aaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.805497 5619 tablet_bootstrap.cc:492] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:45.809448 5619 ts_tablet_manager.cc:1403] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260927 13:49:45.810077 5625 ts_tablet_manager.cc:1929] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.810259 5625 log.cc:1199] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/2801473216a3475384d1494892b8df7b
I20260927 13:49:45.811076 5823 raft_consensus.cc:493] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.811239 5625 ts_tablet_manager.cc:1950] T 2801473216a3475384d1494892b8df7b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.811131 5619 raft_consensus.cc:359] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.811717 5619 raft_consensus.cc:385] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.811707 5823 raft_consensus.cc:515] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.811810 5619 raft_consensus.cc:740] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.812520 5823 leader_election.cc:290] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:45.812726 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 2801473216a3475384d1494892b8df7b (table default.Table_aa1bf158677c41169551c2625573ebbe [id=aa9bfeb5b20c499d9897f950fa6db2a9]) successfully deleted
I20260927 13:49:45.810721 5628 tablet_bootstrap.cc:654] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.813432 5619 consensus_queue.cc:260] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.813665 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85805d532ffa4c79974ce25041a72205" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:45.814304 5625 tablet_replica.cc:333] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
W20260927 13:49:45.814296 5045 leader_election.cc:343] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.814635 5625 raft_consensus.cc:2243] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.814827 5625 raft_consensus.cc:2272] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.815557 5625 ts_tablet_manager.cc:1916] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.821301 5628 tablet_bootstrap.cc:492] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.821455 5628 ts_tablet_manager.cc:1403] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260927 13:49:45.822273 5628 raft_consensus.cc:359] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.822443 5628 raft_consensus.cc:385] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.822525 5628 raft_consensus.cc:740] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.822726 5628 consensus_queue.cc:260] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.823264 5628 ts_tablet_manager.cc:1434] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:45.824753 5628 tablet_bootstrap.cc:492] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.829505 5625 ts_tablet_manager.cc:1929] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.829681 5625 log.cc:1199] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/df271399b2c84653ac4a5b74efdc0197
I20260927 13:49:45.830137 5625 ts_tablet_manager.cc:1950] T df271399b2c84653ac4a5b74efdc0197 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.831624 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f5e45d5a82894bd3a24dc602992d9aba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.832355 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5e45d5a82894bd3a24dc602992d9aba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.833937 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet df271399b2c84653ac4a5b74efdc0197 (table default.Table_4a67727b46b74c27a439bc32c6cb411f [id=a8628dbf015640b9ad49c4aa66f46cac]) successfully deleted
I20260927 13:49:45.834568 5625 tablet_replica.cc:333] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.834870 5625 raft_consensus.cc:2243] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:45.835348 5625 raft_consensus.cc:2272] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.836459 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.836621 5248 raft_consensus.cc:2468] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:45.837240 5625 ts_tablet_manager.cc:1916] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.837682 5352 tablet_service.cc:1511] Processing CreateTablet for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 (DEFAULT_TABLE table=default.Table_87c2ff7de94d4663aebf61e88f2d5080 [id=c4c8708f397345919b0e8b06ab47b367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.838173 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.839191 5083 tablet_service.cc:1511] Processing CreateTablet for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 (DEFAULT_TABLE table=default.Table_87c2ff7de94d4663aebf61e88f2d5080 [id=c4c8708f397345919b0e8b06ab47b367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.839823 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 195ce37d4abf4b92af22b46654b86ba5 (DEFAULT_TABLE table=default.Table_34e3d06c06ed4b90b3444e8c803d2e07 [id=ce8690509c5c4110bf5dd62244aceb46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.840198 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195ce37d4abf4b92af22b46654b86ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.842204 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.842221 5754 consensus_queue.cc:1048] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.097s
I20260927 13:49:45.848381 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe6a7394da94edf87166a184a9a04ba" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.848608 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fd6fb92eb64e948e67f70c512376e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.837278 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f443c863d087483493baa4c80bb64670" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.851655 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2aebae054f8449988cd389e188502781"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.852258 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2aebae054f8449988cd389e188502781 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.854344 5044 leader_election.cc:304] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.854808 5823 raft_consensus.cc:2804] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:45.854916 5823 raft_consensus.cc:493] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:45.855037 5823 raft_consensus.cc:3060] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.858253 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet df271399b2c84653ac4a5b74efdc0197 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.858552 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cb2864ea38b4a538884a2c728f08313 with delete_type TABLET_DATA_DELETED (replaced by tablet 0caf934bc99c4ad38eea5fc812b60931) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.859680 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 (DEFAULT_TABLE table=default.Table_88c5377676df4e3fb778d2781ed7a546 [id=36caa6d3649b47efb7e95cab54ca2608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.859853 5247 raft_consensus.cc:2468] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:45.860203 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ba67436a544e98788e9c1b00a1c33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.860339 5626 tablet_bootstrap.cc:492] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:45.860678 5044 leader_election.cc:304] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:45.860942 5044 raft_consensus.cc:2686] T f443c863d087483493baa4c80bb64670 P 34fc5fe0a32d42ab83f4aa6d07341409: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:49:45.862360 5626 ts_tablet_manager.cc:1403] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.508s user 0.045s sys 0.054s
I20260927 13:49:45.862321 5249 raft_consensus.cc:2468] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:45.861984 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85805d532ffa4c79974ce25041a72205" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.863022 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet f443c863d087483493baa4c80bb64670 with delete_type TABLET_DATA_DELETED (replaced by tablet c989f70385f64593a46f633c98267627) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.866180 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 2efee56b495340baa6dd51f0f3e2aaa7 (DEFAULT_TABLE table=default.Table_009df0f55a87479eab602a85d1503bf9 [id=1ea34fa23bae4ba88424a02d4e54a803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.866569 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b04383cb494f65be7ba507a0f0b441 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.868959 5044 leader_election.cc:304] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.869309 5579 raft_consensus.cc:493] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:49:45.869890 5044 leader_election.cc:343] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.869997 5750 raft_consensus.cc:2804] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:45.870162 5750 raft_consensus.cc:493] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:45.870273 5750 raft_consensus.cc:3060] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.874477 5626 raft_consensus.cc:359] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.869899 5579 raft_consensus.cc:515] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.875774 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0018704e08254c2e8d30c7067df4420c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.875898 5579 leader_election.cc:290] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.876106 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb5fdbfebd5401e92186997f9a30d36 with delete_type TABLET_DATA_DELETED (replaced by tablet 825a73d47bff4246965be82eb482f7aa) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.876307 5229 tablet_service.cc:1511] Processing CreateTablet for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 (DEFAULT_TABLE table=default.Table_87c2ff7de94d4663aebf61e88f2d5080 [id=c4c8708f397345919b0e8b06ab47b367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.876600 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb2864ea38b4a538884a2c728f08313" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:45.870023 5044 leader_election.cc:304] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:45.877409 5045 leader_election.cc:343] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.878227 5579 raft_consensus.cc:2749] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:45.877432 5823 raft_consensus.cc:515] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.879524 5750 raft_consensus.cc:515] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.880384 5823 leader_election.cc:290] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.880849 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d1197bee2d477ab77d15cbd4907595" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
W20260927 13:49:45.881470 5045 leader_election.cc:343] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.881734 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efee56b495340baa6dd51f0f3e2aaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.881696 5626 raft_consensus.cc:385] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.881809 5626 raft_consensus.cc:740] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.882059 5626 consensus_queue.cc:260] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.883652 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_aa1bf158677c41169551c2625573ebbe" } new_table_name: "default.Table_a3789979cff14454ae09dd578f449218" modify_external_catalogs: true
I20260927 13:49:45.885324 5750 leader_election.cc:290] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:45.886243 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb2864ea38b4a538884a2c728f08313" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.886791 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe6a7394da94edf87166a184a9a04ba" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:45.886775 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_db71c9d8deb14250b83d10519ab3af81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:45.887161 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4b7500f05e4b63b4d79fabde88ebe6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:45.887322 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db71c9d8deb14250b83d10519ab3af81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:45.887614 5045 leader_election.cc:343] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:45.888700 5044 leader_election.cc:343] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:45.888887 5044 leader_election.cc:304] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.889395 5750 raft_consensus.cc:2749] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:45.890554 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.891544 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2f1b1efb4dbd43b8b3a3008a37acb490"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:45.892047 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f1b1efb4dbd43b8b3a3008a37acb490 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:45.894230 5626 ts_tablet_manager.cc:1434] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.028s user 0.002s sys 0.001s
I20260927 13:49:45.894053 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe6a7394da94edf87166a184a9a04ba" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:45.895390 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d1197bee2d477ab77d15cbd4907595" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:45.896155 5249 raft_consensus.cc:3060] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.899004 5625 ts_tablet_manager.cc:1929] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:45.899163 5625 log.cc:1199] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/2a2ba67436a544e98788e9c1b00a1c33
I20260927 13:49:45.899500 5249 raft_consensus.cc:2468] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:45.899646 5625 ts_tablet_manager.cc:1950] T 2a2ba67436a544e98788e9c1b00a1c33 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.900389 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 2a2ba67436a544e98788e9c1b00a1c33 (table default.Table_1716b29ed09743aabc7f196195efefdf [id=ec11e094cff046098922a5d559575bcb]) successfully deleted
I20260927 13:49:45.900467 5044 leader_election.cc:304] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.900802 5248 raft_consensus.cc:3060] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.901166 5750 raft_consensus.cc:2804] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:45.901384 5750 raft_consensus.cc:697] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:45.901691 5750 consensus_queue.cc:237] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.903410 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_eae0be8d08ec43279ba35789c84b573c" } modify_external_catalogs: true
I20260927 13:49:45.903599 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_eae0be8d08ec43279ba35789c84b573c" } modify_external_catalogs: true
I20260927 13:49:45.905009 5628 tablet_bootstrap.cc:654] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.905198 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_bf207d12ec6444c8a164ae27e8055482" } new_table_name: "default.Table_22e247f0a5544a5b92efa16ac0dc61bd" modify_external_catalogs: true
I20260927 13:49:45.908097 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 4fe6a7394da94edf87166a184a9a04ba
I20260927 13:49:45.908602 5626 tablet_bootstrap.cc:492] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:45.908720 4922 catalog_manager.cc:6934] ReplaceTablet: tablet 4fe6a7394da94edf87166a184a9a04ba deleted and replaced by tablet 74226753751a49fa8ce98eafb2ca1250
I20260927 13:49:45.910084 4922 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 79514522a9d142438fd6aecc91f0463e (table default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 4 got 0
I20260927 13:49:45.910795 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet dff5992b27f049f5890e65d5a8dcc3cf from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.911342 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c1b74943b9479e8b37969b2933c5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.912225 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fe6a7394da94edf87166a184a9a04ba with delete_type TABLET_DATA_DELETED (replaced by tablet 74226753751a49fa8ce98eafb2ca1250) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.912819 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fe6a7394da94edf87166a184a9a04ba with delete_type TABLET_DATA_DELETED (replaced by tablet 74226753751a49fa8ce98eafb2ca1250) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.913403 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 7a4b7500f05e4b63b4d79fabde88ebe6
I20260927 13:49:45.914151 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:45.915035 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 2a2ba67436a544e98788e9c1b00a1c33 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.915078 5625 tablet_replica.cc:333] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:45.915475 5625 raft_consensus.cc:2243] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:45.915822 5625 pending_rounds.cc:70] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: Trying to abort 1 pending ops.
I20260927 13:49:45.915901 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:45.915962 5625 pending_rounds.cc:77] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957574254895104 op_type: NO_OP noop_request { }
I20260927 13:49:45.916230 5625 raft_consensus.cc:2889] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:45.916436 5625 raft_consensus.cc:2272] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:45.915136 5248 raft_consensus.cc:2468] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:45.917491 5625 ts_tablet_manager.cc:1916] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:45.917821 5044 leader_election.cc:304] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:45.919958 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fe6a7394da94edf87166a184a9a04ba with delete_type TABLET_DATA_DELETED (replaced by tablet 74226753751a49fa8ce98eafb2ca1250) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.922175 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:45.923754 5750 raft_consensus.cc:2804] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:45.923964 5750 raft_consensus.cc:697] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:45.924403 5750 consensus_queue.cc:237] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.926220 5625 ts_tablet_manager.cc:1929] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:45.928519 5625 log.cc:1199] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/4fe6a7394da94edf87166a184a9a04ba
I20260927 13:49:45.928978 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:45.929551 5754 consensus_queue.cc:1048] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260927 13:49:45.929788 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 195ce37d4abf4b92af22b46654b86ba5 (DEFAULT_TABLE table=default.Table_34e3d06c06ed4b90b3444e8c803d2e07 [id=ce8690509c5c4110bf5dd62244aceb46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.930259 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195ce37d4abf4b92af22b46654b86ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.934520 5355 tablet_service.cc:1511] Processing CreateTablet for tablet c7670d5f54df49f4a074588ab9269145 (DEFAULT_TABLE table=default.Table_1ae91d9d1b754d34b300597015c74ff5 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.939031 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 195ce37d4abf4b92af22b46654b86ba5 (DEFAULT_TABLE table=default.Table_34e3d06c06ed4b90b3444e8c803d2e07 [id=ce8690509c5c4110bf5dd62244aceb46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.939851 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195ce37d4abf4b92af22b46654b86ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.941504 5625 ts_tablet_manager.cc:1950] T 4fe6a7394da94edf87166a184a9a04ba P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:45.942490 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 4fe6a7394da94edf87166a184a9a04ba (table default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]) successfully deleted
W20260927 13:49:45.943941 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a4b7500f05e4b63b4d79fabde88ebe6 already in progress: creating tablet
I20260927 13:49:45.944720 5384 raft_consensus.cc:3060] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:45.953871 5880 tablet.cc:1751] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:45.955240 5628 tablet_bootstrap.cc:492] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:45.955446 5628 ts_tablet_manager.cc:1403] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.131s user 0.001s sys 0.004s
I20260927 13:49:45.956346 5628 raft_consensus.cc:359] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.956561 5628 raft_consensus.cc:385] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:45.956636 5628 raft_consensus.cc:740] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:45.956873 5628 consensus_queue.cc:260] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:45.957403 5628 ts_tablet_manager.cc:1434] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:45.957726 5628 tablet_bootstrap.cc:492] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:45.958148 5626 tablet_bootstrap.cc:654] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:45.959345 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7670d5f54df49f4a074588ab9269145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.960196 5878 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.163.126:42985 every 8 connection(s)
I20260927 13:49:45.960623 5564 rpc_server.cc:307] RPC server started. Bound to: 127.4.163.126:42985
I20260927 13:49:45.964542 5564 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-0/data/info.pb
I20260927 13:49:45.973524 4749 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu as pid 5564
I20260927 13:49:45.973738 5083 tablet_service.cc:1511] Processing CreateTablet for tablet c7670d5f54df49f4a074588ab9269145 (DEFAULT_TABLE table=default.Table_1ae91d9d1b754d34b300597015c74ff5 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.974236 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7670d5f54df49f4a074588ab9269145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.977506 5787 raft_consensus.cc:493] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:45.977698 5787 raft_consensus.cc:515] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:45.978433 5787 leader_election.cc:290] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:45.978526 5219 tablet_service.cc:1511] Processing CreateTablet for tablet c7670d5f54df49f4a074588ab9269145 (DEFAULT_TABLE table=default.Table_1ae91d9d1b754d34b300597015c74ff5 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.978945 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7670d5f54df49f4a074588ab9269145. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:45.979943 5319 leader_election.cc:343] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a1489f766164444b9aaa7b58e81a72d9
I20260927 13:49:45.980469 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1489f766164444b9aaa7b58e81a72d9" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:45.981014 5319 leader_election.cc:304] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:45.981452 5787 raft_consensus.cc:2749] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:45.984035 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 76add3b9ef254ece958121a336e87936 (DEFAULT_TABLE table=default.Table_ac4b7b0394ef4ce3ac5edea4fd99227f [id=d570c2cfe66d4c0e9fdfaee2c644aab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.984519 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76add3b9ef254ece958121a336e87936. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:45.988755 4915 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 0004ef0b2dd841ac860798d804374dc1 (table default.Table_67437b4c9aca4cad9e3206df11173845 [id=ba243c4b6c524b69ae2ab5e7c8720ba2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0004ef0b2dd841ac860798d804374dc1 consensus state has no leader
W20260927 13:49:45.989166 4914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.126:42985, user_credentials={real_user=slave}} blocked reactor thread for 304050us
I20260927 13:49:45.990424 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 76add3b9ef254ece958121a336e87936 (DEFAULT_TABLE table=default.Table_ac4b7b0394ef4ce3ac5edea4fd99227f [id=d570c2cfe66d4c0e9fdfaee2c644aab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.990760 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 0004ef0b2dd841ac860798d804374dc1 (DEFAULT_TABLE table=default.Table_67437b4c9aca4cad9e3206df11173845 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.991078 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76add3b9ef254ece958121a336e87936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.991744 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0004ef0b2dd841ac860798d804374dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.992023 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 76add3b9ef254ece958121a336e87936 (DEFAULT_TABLE table=default.Table_ac4b7b0394ef4ce3ac5edea4fd99227f [id=d570c2cfe66d4c0e9fdfaee2c644aab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:45.992455 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76add3b9ef254ece958121a336e87936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:45.999476 5606 ts_tablet_manager.cc:1929] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:49:46.005060 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cc174eab36b46fb8e276b3168fbfbcd consensus state has no leader
I20260927 13:49:46.005937 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 910b73528ed949bc86badcc4cf6c74a3
I20260927 13:49:46.008728 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e6eff4f97e084636b5609c6c269cf5ec" } modify_external_catalogs: true
I20260927 13:49:46.008944 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e6eff4f97e084636b5609c6c269cf5ec" } modify_external_catalogs: true
I20260927 13:49:46.010489 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 910b73528ed949bc86badcc4cf6c74a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.010871 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cb2864ea38b4a538884a2c728f08313 with delete_type TABLET_DATA_DELETED (replaced by tablet 0caf934bc99c4ad38eea5fc812b60931) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.010916 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet b95399b042654100a609427597d6fe72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.011363 5625 tablet_replica.cc:333] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:46.011633 5625 raft_consensus.cc:2243] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:46.009307 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72711f14f26a479c9699b172b41b1db0 consensus state has no leader
I20260927 13:49:46.011837 5625 raft_consensus.cc:2272] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.011785 4923 catalog_manager.cc:5838] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:46.012056 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_0f7abb0c16a04daf8a6f8911afd71804" } new_table_name: "default.Table_183e16824f194b1caa9327d0973f607b" modify_external_catalogs: true
I20260927 13:49:46.012190 4923 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 4295710c33714360b3691f48f47f4293 (table default.Table_97bdee39a93e4f98ae6382e7ab44eda7 [id=2fe2768ea9264c38973e4ed5206c77f2]). Expected version 1 got 0
W20260927 13:49:46.012624 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 910b73528ed949bc86badcc4cf6c74a3 because the tablet was not found. No further retry: Not found: Tablet not found: 910b73528ed949bc86badcc4cf6c74a3
I20260927 13:49:46.012910 4923 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 79514522a9d142438fd6aecc91f0463e (table default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 4 got 0
I20260927 13:49:46.013128 5625 ts_tablet_manager.cc:1916] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.010596 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_fec7020fbf30493cbe6a218ae1cc9dab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:46.014779 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fec7020fbf30493cbe6a218ae1cc9dab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.011577 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_298f6b42cb084ec7abaaea11e41d12b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:46.016160 5623 ts_tablet_manager.cc:1929] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:49:46.016201 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_298f6b42cb084ec7abaaea11e41d12b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.016309 5623 log.cc:1199] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/54fb19fb86ea43b0b81d6d42ce2d8a5f
I20260927 13:49:46.016700 5623 ts_tablet_manager.cc:1950] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.020592 5625 ts_tablet_manager.cc:1929] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.020831 5625 log.cc:1199] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/7cb2864ea38b4a538884a2c728f08313
I20260927 13:49:46.021286 5625 ts_tablet_manager.cc:1950] T 7cb2864ea38b4a538884a2c728f08313 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:46.022189 5625 tablet_replica.cc:333] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:46.022464 5625 raft_consensus.cc:2243] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.022753 5625 raft_consensus.cc:2272] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:46.023129 5184 consensus_peers.cc:597] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a1489f766164444b9aaa7b58e81a72d9. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:46.023667 5625 ts_tablet_manager.cc:1916] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.026510 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet f9b019bbec5d40609dbf1c556cc26a63
I20260927 13:49:46.028894 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 7cb2864ea38b4a538884a2c728f08313 (table default.Table_3e04bdb3f0cd4ebea2e3f8efefa7f056 [id=8a1cfc06002240faae3fd4bb724fc5f4]) successfully deleted
I20260927 13:49:46.029633 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet f9b019bbec5d40609dbf1c556cc26a63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:46.029786 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet f9b019bbec5d40609dbf1c556cc26a63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.029953 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet dff5992b27f049f5890e65d5a8dcc3cf
I20260927 13:49:46.031912 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 910b73528ed949bc86badcc4cf6c74a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:46.033217 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet dff5992b27f049f5890e65d5a8dcc3cf with delete_type TABLET_DATA_DELETED (replaced by tablet 1f5dfa3e80454463908df19a49454764) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.034523 4922 catalog_manager.cc:6934] ReplaceTablet: tablet dff5992b27f049f5890e65d5a8dcc3cf deleted and replaced by tablet 1f5dfa3e80454463908df19a49454764
I20260927 13:49:46.034842 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet dff5992b27f049f5890e65d5a8dcc3cf with delete_type TABLET_DATA_DELETED (replaced by tablet 1f5dfa3e80454463908df19a49454764) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:46.035079 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8f56db43a65c4bd5a295fc1966c944a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:46.036013 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2
I20260927 13:49:46.036796 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e959f8c6fa74a1bbaf06d91c3e484bc) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.037374 5883 sys_catalog.cc:263] Verifying existing consensus state
I20260927 13:49:46.037915 4924 catalog_manager.cc:6934] ReplaceTablet: tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2 deleted and replaced by tablet 8e959f8c6fa74a1bbaf06d91c3e484bc
I20260927 13:49:46.038823 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_67437b4c9aca4cad9e3206df11173845" } new_table_name: "default.Table_5f2f268fd879476db40bf7a96885d2a5" modify_external_catalogs: true
I20260927 13:49:46.038969 5156 heartbeater.cc:344] Connected to a master server at 127.4.163.126:42985
I20260927 13:49:46.039621 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d8a6c02dc5f54a3cb24bb9cdb9d87eff" } new_table_name: "default.Table_3612744880954a2fbd6f1d46583fb14b" modify_external_catalogs: true
I20260927 13:49:46.041054 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3e04bdb3f0cd4ebea2e3f8efefa7f056" } modify_external_catalogs: true
W20260927 13:49:46.041687 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f56db43a65c4bd5a295fc1966c944a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.043555 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3e04bdb3f0cd4ebea2e3f8efefa7f056" } modify_external_catalogs: true
I20260927 13:49:46.045496 5750 raft_consensus.cc:493] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.045727 5750 raft_consensus.cc:515] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.047050 5625 ts_tablet_manager.cc:1929] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.047173 5625 log.cc:1199] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b95399b042654100a609427597d6fe72
I20260927 13:49:46.047586 5625 ts_tablet_manager.cc:1950] T b95399b042654100a609427597d6fe72 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:46.048420 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f749329ec19643379f5f81a6b895d21b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:46.048707 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b95399b042654100a609427597d6fe72 (table default.Table_6437470f54684ecab34ab24defbe6a83 [id=c0b49915096e4176b4ff5ec9e6faa830]) successfully deleted
W20260927 13:49:46.049111 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f749329ec19643379f5f81a6b895d21b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.048468 5625 tablet_replica.cc:333] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:46.049889 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 39) took 2300 ms. Trace:
I20260927 13:49:46.050004 5623 rpcz_store.cc:276] 0927 13:49:43.749135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.749192 (+ 57us) service_pool.cc:224] Handling call
0927 13:49:45.459742 (+1710550us) ts_tablet_manager.cc:1151] Deleting tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f
0927 13:49:45.459752 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.747682 (+287930us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.016083 (+268401us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.049829 (+ 33746us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1710328}
I20260927 13:49:46.050498 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f (table default.Table_fafb083bcf954f6b91e326a7ca8ff4ee [id=0d47daf95d4b40e2862f1b897b210232]) successfully deleted
I20260927 13:49:46.050565 5625 raft_consensus.cc:2243] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.050722 5625 raft_consensus.cc:2272] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.051093 5623 tablet_replica.cc:333] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.051345 5623 raft_consensus.cc:2243] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.051491 5625 ts_tablet_manager.cc:1916] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.051651 5623 raft_consensus.cc:2272] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.052302 5623 ts_tablet_manager.cc:1916] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.052309 5883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Bootstrap starting.
I20260927 13:49:46.057247 5754 raft_consensus.cc:493] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.057482 5754 raft_consensus.cc:515] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.058856 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79b1f2962f44a23916bbfe4cf55a4bc" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:46.059098 5108 raft_consensus.cc:2468] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:46.059105 5754 leader_election.cc:290] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:46.059955 5184 leader_election.cc:304] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:46.060289 5754 raft_consensus.cc:2804] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:46.060382 5754 raft_consensus.cc:493] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:46.060482 5754 raft_consensus.cc:3060] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.063632 5754 raft_consensus.cc:515] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.064736 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79b1f2962f44a23916bbfe4cf55a4bc" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:46.064945 5108 raft_consensus.cc:3060] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.065166 5754 leader_election.cc:290] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:46.067835 5108 raft_consensus.cc:2468] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:46.068429 5184 leader_election.cc:304] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:46.068876 5750 leader_election.cc:290] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.068954 5727 raft_consensus.cc:2804] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:46.069298 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c46d0e50a44232a82d00c88d9f63b5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:46.070027 5044 leader_election.cc:343] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.071416 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e959f8c6fa74a1bbaf06d91c3e484bc) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:46.078310 4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.125:42239, user_credentials={real_user=slave}} blocked reactor thread for 77555.9us
I20260927 13:49:46.079967 5295 heartbeater.cc:344] Connected to a master server at 127.4.163.126:42985
I20260927 13:49:46.089818 5625 ts_tablet_manager.cc:1929] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.090529 5625 log.cc:1199] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f9b019bbec5d40609dbf1c556cc26a63
I20260927 13:49:46.091137 5625 ts_tablet_manager.cc:1950] T f9b019bbec5d40609dbf1c556cc26a63 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:46.092408 5626 tablet_bootstrap.cc:492] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:46.092715 5625 tablet_replica.cc:333] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:46.092825 5626 ts_tablet_manager.cc:1403] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.198s user 0.007s sys 0.006s
I20260927 13:49:46.092931 5625 raft_consensus.cc:2243] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.093134 5625 raft_consensus.cc:2272] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.095060 5626 raft_consensus.cc:359] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.095304 5626 raft_consensus.cc:385] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.095397 5623 ts_tablet_manager.cc:1929] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.095419 5626 raft_consensus.cc:740] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.099526 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f9b019bbec5d40609dbf1c556cc26a63 (table default.Table_eae0be8d08ec43279ba35789c84b573c [id=599a7a50e2324466b865d11e66bc51bd]) successfully deleted
I20260927 13:49:46.101331 5626 consensus_queue.cc:260] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:46.101826 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet dff5992b27f049f5890e65d5a8dcc3cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff5992b27f049f5890e65d5a8dcc3cf already in progress: creating tablet
I20260927 13:49:46.101920 5626 ts_tablet_manager.cc:1434] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260927 13:49:46.102227 5626 tablet_bootstrap.cc:492] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:46.106982 5625 ts_tablet_manager.cc:1916] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.111824 5628 tablet_bootstrap.cc:654] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.020736 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 910b73528ed949bc86badcc4cf6c74a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:46.020959 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:46.031229 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet dff5992b27f049f5890e65d5a8dcc3cf with delete_type TABLET_DATA_DELETED (replaced by tablet 1f5dfa3e80454463908df19a49454764) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:46.032021 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet f9b019bbec5d40609dbf1c556cc26a63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:46.038719 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e959f8c6fa74a1bbaf06d91c3e484bc) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:46.041528 5431 heartbeater.cc:344] Connected to a master server at 127.4.163.126:42985
I20260927 13:49:46.047633 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c46d0e50a44232a82d00c88d9f63b5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:46.113163 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
W20260927 13:49:46.114002 5045 leader_election.cc:343] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.114212 5045 leader_election.cc:304] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:46.114884 5750 raft_consensus.cc:2749] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:46.115260 5606 log.cc:1199] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/f2622078288a47b4be4dea70d594b76c
I20260927 13:49:46.115731 5606 ts_tablet_manager.cc:1950] T f2622078288a47b4be4dea70d594b76c P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:46.048476 5619 ts_tablet_manager.cc:1434] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.239s user 0.002s sys 0.000s
I20260927 13:49:46.065243 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79b1f2962f44a23916bbfe4cf55a4bc" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:46.067044 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79b1f2962f44a23916bbfe4cf55a4bc" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:46.109892 5880 tablet.cc:1751] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 13:49:46.117441 5625 ts_tablet_manager.cc:1929] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.118328 5619 tablet_bootstrap.cc:492] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:46.119648 5185 leader_election.cc:343] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.119931 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:46.121130 5626 tablet_bootstrap.cc:654] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:46.121287 5185 leader_election.cc:343] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.095523 5623 log.cc:1199] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b4d56bd86f814c9ead4a52f133d1c818
I20260927 13:49:46.127883 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:46.128134 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 49) took 2208 ms. Trace:
I20260927 13:49:46.128279 5606 rpcz_store.cc:276] 0927 13:49:43.919802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.919858 (+ 56us) service_pool.cc:224] Handling call
0927 13:49:45.686069 (+1766211us) ts_tablet_manager.cc:1151] Deleting tablet f2622078288a47b4be4dea70d594b76c
0927 13:49:45.686080 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:45.932929 (+246849us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:45.999413 (+ 66484us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.128076 (+128663us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1765969}
I20260927 13:49:46.128549 5727 raft_consensus.cc:697] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:46.128851 5623 ts_tablet_manager.cc:1950] T b4d56bd86f814c9ead4a52f133d1c818 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.128921 5606 tablet_replica.cc:333] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:46.129016 5727 consensus_queue.cc:237] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.129151 5606 raft_consensus.cc:2243] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.129365 5606 raft_consensus.cc:2272] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.129571 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 40) took 2378 ms. Trace:
I20260927 13:49:46.129860 5623 rpcz_store.cc:276] 0927 13:49:43.751563 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.751626 (+ 63us) service_pool.cc:224] Handling call
0927 13:49:46.051006 (+2299380us) ts_tablet_manager.cc:1151] Deleting tablet b4d56bd86f814c9ead4a52f133d1c818
0927 13:49:46.051017 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.092212 (+ 41195us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.095299 (+ 3087us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.129509 (+ 34210us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2299152}
I20260927 13:49:46.122047 5883 log.cc:826] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Log is configured to *not* fsync() on all Append() calls
I20260927 13:49:46.131001 5623 tablet_replica.cc:333] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.131090 5606 ts_tablet_manager.cc:1916] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.131558 5623 raft_consensus.cc:2243] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.131919 5623 raft_consensus.cc:2272] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.135901 5623 ts_tablet_manager.cc:1916] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.143702 5385 raft_consensus.cc:3060] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.144922 5625 log.cc:1199] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/9b6ff9ddb6664a5a867ac0f64ac1e9a2
I20260927 13:49:46.145403 5625 ts_tablet_manager.cc:1950] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:46.151521 5727 consensus_queue.cc:1048] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:46.153909 5628 tablet_bootstrap.cc:492] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:46.154066 5626 tablet_bootstrap.cc:492] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:46.154294 5628 ts_tablet_manager.cc:1403] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.197s user 0.002s sys 0.002s
I20260927 13:49:46.155335 5628 raft_consensus.cc:359] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.155601 5628 raft_consensus.cc:385] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.155735 5628 raft_consensus.cc:740] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.155284 5626 ts_tablet_manager.cc:1403] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.007s
I20260927 13:49:46.156433 5628 consensus_queue.cc:260] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.156325 5899 tablet.cc:1751] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 13:49:46.159817 5626 raft_consensus.cc:359] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.160611 5626 raft_consensus.cc:385] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.160912 5626 raft_consensus.cc:740] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.161610 5628 ts_tablet_manager.cc:1434] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260927 13:49:46.161898 5626 consensus_queue.cc:260] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.164448 5626 ts_tablet_manager.cc:1434] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260927 13:49:46.165609 5626 tablet_bootstrap.cc:492] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:46.167178 5628 tablet_bootstrap.cc:492] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:46.172894 5619 tablet_bootstrap.cc:654] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.175948 5623 ts_tablet_manager.cc:1929] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.177030 5623 log.cc:1199] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f2622078288a47b4be4dea70d594b76c
I20260927 13:49:46.178984 5623 ts_tablet_manager.cc:1950] T f2622078288a47b4be4dea70d594b76c P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.179692 5626 tablet_bootstrap.cc:654] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.182746 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet f2622078288a47b4be4dea70d594b76c (table default.Table_c697b442911e41d898013105071efae8 [id=3922762a78fe4981b87c3ecbb25a8e2b]) successfully deleted
I20260927 13:49:46.183707 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 41) took 2262 ms. Trace:
I20260927 13:49:46.182610 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b4d56bd86f814c9ead4a52f133d1c818 (table default.Table_78b63dc8b0d74924b9db859769aebe53 [id=dba93d9f1c5045b29c27827599701cc9]) successfully deleted
W20260927 13:49:46.185232 4916 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 54581.6us
I20260927 13:49:46.184118 5623 rpcz_store.cc:276] 0927 13:49:43.921046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:43.921108 (+ 62us) service_pool.cc:224] Handling call
0927 13:49:46.130917 (+2209809us) ts_tablet_manager.cc:1151] Deleting tablet f2622078288a47b4be4dea70d594b76c
0927 13:49:46.130928 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.155226 (+ 24298us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.175570 (+ 20344us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.183231 (+ 7661us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2209533}
I20260927 13:49:46.185936 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2 (table default.Table_3ab0995080774a95967ee1d1ce7c9fdf [id=4dfd5d250a6f4ccd87ae40d6b0061394]) successfully deleted
I20260927 13:49:46.187076 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 0004ef0b2dd841ac860798d804374dc1 (DEFAULT_TABLE table=default.Table_67437b4c9aca4cad9e3206df11173845 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.187629 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0004ef0b2dd841ac860798d804374dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.187927 5903 tablet.cc:1751] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 13:49:46.189224 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 2c976a667e7c4b948b3aa176b13b7d0d (DEFAULT_TABLE table=default.Table_3efafc6b184f4f73bd2b6fad23d8991c [id=d6e13461272741bb8e15183f5bc473d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.189626 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c976a667e7c4b948b3aa176b13b7d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.191839 5606 ts_tablet_manager.cc:1929] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:46.191973 5606 log.cc:1199] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/d47c71b038c34a729ca20965d133c488
I20260927 13:49:46.192487 5606 ts_tablet_manager.cc:1950] T d47c71b038c34a729ca20965d133c488 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:46.201049 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 52) took 2182 ms. Trace:
I20260927 13:49:46.201598 5606 rpcz_store.cc:276] 0927 13:49:44.018539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.018823 (+ 284us) service_pool.cc:224] Handling call
0927 13:49:46.128824 (+2110001us) ts_tablet_manager.cc:1151] Deleting tablet d47c71b038c34a729ca20965d133c488
0927 13:49:46.128834 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.150761 (+ 21927us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.191749 (+ 40988us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.201003 (+ 9254us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2109741}
I20260927 13:49:46.202183 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f2622078288a47b4be4dea70d594b76c (table default.Table_c697b442911e41d898013105071efae8 [id=3922762a78fe4981b87c3ecbb25a8e2b]) successfully deleted
I20260927 13:49:46.204977 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 54) took 2133 ms. Trace:
I20260927 13:49:46.209401 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet d47c71b038c34a729ca20965d133c488 (table default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]) successfully deleted
I20260927 13:49:46.210419 5365 tablet_service.cc:1511] Processing CreateTablet for tablet f5bf9ba5d857421ebc783d4c567f411c (DEFAULT_TABLE table=default.Table_71b0f958b1ec49bf9f334180403b5e3f [id=e84cfb4f1dc04be8928d31ded73197c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.210803 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5bf9ba5d857421ebc783d4c567f411c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.213454 5083 tablet_service.cc:1511] Processing CreateTablet for tablet c2fc2734e88e431facdf72e9ef136106 (DEFAULT_TABLE table=default.Table_d8a6c02dc5f54a3cb24bb9cdb9d87eff [id=3a103249799f4a5383c5091fda81153e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.214253 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fc2734e88e431facdf72e9ef136106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.214251 5355 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc174eab36b46fb8e276b3168fbfbcd (DEFAULT_TABLE table=default.Table_22e247f0a5544a5b92efa16ac0dc61bd [id=e0fbdd8436ba42fabce301642d17dabe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.214735 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 910b73528ed949bc86badcc4cf6c74a3 (DEFAULT_TABLE table=default.Table_791bee87bef64e35bb7c22d8611be6d5 [id=53769bb0c70748e6b710b518250b2649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.215252 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 2999bd61907847938975a6232e3899e4 (DEFAULT_TABLE table=default.Table_7cef271e951d46f38d090f892f8e54c0 [id=55be6819da774e158af5a660b686a1f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.215890 5358 tablet_service.cc:1511] Processing CreateTablet for tablet c2fc2734e88e431facdf72e9ef136106 (DEFAULT_TABLE table=default.Table_d8a6c02dc5f54a3cb24bb9cdb9d87eff [id=3a103249799f4a5383c5091fda81153e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.216526 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc174eab36b46fb8e276b3168fbfbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.216804 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2999bd61907847938975a6232e3899e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.217419 5080 tablet_service.cc:1511] Processing CreateTablet for tablet f5bf9ba5d857421ebc783d4c567f411c (DEFAULT_TABLE table=default.Table_71b0f958b1ec49bf9f334180403b5e3f [id=e84cfb4f1dc04be8928d31ded73197c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.217759 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5bf9ba5d857421ebc783d4c567f411c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.220885 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 910b73528ed949bc86badcc4cf6c74a3 (DEFAULT_TABLE table=default.Table_791bee87bef64e35bb7c22d8611be6d5 [id=53769bb0c70748e6b710b518250b2649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.222324 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910b73528ed949bc86badcc4cf6c74a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.226296 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fc2734e88e431facdf72e9ef136106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.227653 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910b73528ed949bc86badcc4cf6c74a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.229907 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 72711f14f26a479c9699b172b41b1db0 (DEFAULT_TABLE table=default.Table_a3789979cff14454ae09dd578f449218 [id=aa9bfeb5b20c499d9897f950fa6db2a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.230571 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72711f14f26a479c9699b172b41b1db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.231267 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 2999bd61907847938975a6232e3899e4 (DEFAULT_TABLE table=default.Table_7cef271e951d46f38d090f892f8e54c0 [id=55be6819da774e158af5a660b686a1f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.231688 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 72711f14f26a479c9699b172b41b1db0 (DEFAULT_TABLE table=default.Table_a3789979cff14454ae09dd578f449218 [id=aa9bfeb5b20c499d9897f950fa6db2a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.232107 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc174eab36b46fb8e276b3168fbfbcd (DEFAULT_TABLE table=default.Table_22e247f0a5544a5b92efa16ac0dc61bd [id=e0fbdd8436ba42fabce301642d17dabe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.239127 5353 tablet_service.cc:1511] Processing CreateTablet for tablet effce815011d47df960df2c79d41aa1f (DEFAULT_TABLE table=default.Table_e03f455aec424b9fb05a1503d626ae3a [id=0f6fb382a33d46cc973e8a81ed234faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.239530 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effce815011d47df960df2c79d41aa1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.239801 5077 tablet_service.cc:1511] Processing CreateTablet for tablet effce815011d47df960df2c79d41aa1f (DEFAULT_TABLE table=default.Table_e03f455aec424b9fb05a1503d626ae3a [id=0f6fb382a33d46cc973e8a81ed234faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.240337 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72711f14f26a479c9699b172b41b1db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.240938 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effce815011d47df960df2c79d41aa1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.241436 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2999bd61907847938975a6232e3899e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.241371 5078 tablet_service.cc:1511] Processing CreateTablet for tablet bc8f6354c1034814af3cc20df25ddb47 (DEFAULT_TABLE table=default.Table_e6eff4f97e084636b5609c6c269cf5ec [id=4f32d603a6764a359605a945c924f6c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.241956 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc174eab36b46fb8e276b3168fbfbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.242962 5360 tablet_service.cc:1511] Processing CreateTablet for tablet bc8f6354c1034814af3cc20df25ddb47 (DEFAULT_TABLE table=default.Table_e6eff4f97e084636b5609c6c269cf5ec [id=4f32d603a6764a359605a945c924f6c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.243366 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8f6354c1034814af3cc20df25ddb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.244169 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (DEFAULT_TABLE table=default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.244520 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.246412 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (DEFAULT_TABLE table=default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.246752 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.258018 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8f6354c1034814af3cc20df25ddb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.263430 5628 tablet_bootstrap.cc:654] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.271584 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 1f34f2d0f6e9420a8ad38d708b658b17 (DEFAULT_TABLE table=default.Table_f4169b61d7234a6286c6c26a3b3b2c65 [id=30320123ccb44660bb6013069aa42e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.272140 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f34f2d0f6e9420a8ad38d708b658b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.272383 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 2c976a667e7c4b948b3aa176b13b7d0d (DEFAULT_TABLE table=default.Table_3efafc6b184f4f73bd2b6fad23d8991c [id=d6e13461272741bb8e15183f5bc473d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.272498 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 1f34f2d0f6e9420a8ad38d708b658b17 (DEFAULT_TABLE table=default.Table_f4169b61d7234a6286c6c26a3b3b2c65 [id=30320123ccb44660bb6013069aa42e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.272825 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c976a667e7c4b948b3aa176b13b7d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.273823 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f34f2d0f6e9420a8ad38d708b658b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.276435 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc174eab36b46fb8e276b3168fbfbcd (DEFAULT_TABLE table=default.Table_22e247f0a5544a5b92efa16ac0dc61bd [id=e0fbdd8436ba42fabce301642d17dabe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.276942 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 45) took 2127 ms. Trace:
I20260927 13:49:46.278795 5219 tablet_service.cc:1511] Processing CreateTablet for tablet 2c976a667e7c4b948b3aa176b13b7d0d (DEFAULT_TABLE table=default.Table_3efafc6b184f4f73bd2b6fad23d8991c [id=d6e13461272741bb8e15183f5bc473d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.278980 5215 tablet_service.cc:1511] Processing CreateTablet for tablet f5bf9ba5d857421ebc783d4c567f411c (DEFAULT_TABLE table=default.Table_71b0f958b1ec49bf9f334180403b5e3f [id=e84cfb4f1dc04be8928d31ded73197c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.279436 5787 consensus_queue.cc:1048] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:46.281282 5623 rpcz_store.cc:276] 0927 13:49:44.059871 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.059940 (+ 69us) service_pool.cc:224] Handling call
0927 13:49:46.186351 (+2126411us) ts_tablet_manager.cc:1151] Deleting tablet 14d3a3282d684415858dc971cb02eec1
0927 13:49:46.186363 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.186848 (+ 485us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2125901}
I20260927 13:49:46.209662 5606 rpcz_store.cc:276] 0927 13:49:44.071565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.071633 (+ 68us) service_pool.cc:224] Handling call
0927 13:49:46.204789 (+2133156us) ts_tablet_manager.cc:1151] Deleting tablet a61eedf06dab4096a397da8ce98a07da
0927 13:49:46.204805 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.204941 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2132883}
I20260927 13:49:46.287477 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc174eab36b46fb8e276b3168fbfbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.288265 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5bf9ba5d857421ebc783d4c567f411c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.291208 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 0004ef0b2dd841ac860798d804374dc1 (DEFAULT_TABLE table=default.Table_67437b4c9aca4cad9e3206df11173845 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.291384 5225 tablet_service.cc:1511] Processing CreateTablet for tablet c2fc2734e88e431facdf72e9ef136106 (DEFAULT_TABLE table=default.Table_d8a6c02dc5f54a3cb24bb9cdb9d87eff [id=3a103249799f4a5383c5091fda81153e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.293793 5623 tablet_replica.cc:333] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.294045 5623 raft_consensus.cc:2243] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:46.294492 5623 raft_consensus.cc:2272] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.295097 5623 ts_tablet_manager.cc:1916] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:46.296016 5184 consensus_peers.cc:597] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0dfe23bef144e438ae762e401f02e8f. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:46.296758 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 910b73528ed949bc86badcc4cf6c74a3 (DEFAULT_TABLE table=default.Table_791bee87bef64e35bb7c22d8611be6d5 [id=53769bb0c70748e6b710b518250b2649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.297377 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c976a667e7c4b948b3aa176b13b7d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.298801 5628 tablet_bootstrap.cc:492] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:46.302815 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 2999bd61907847938975a6232e3899e4 (DEFAULT_TABLE table=default.Table_7cef271e951d46f38d090f892f8e54c0 [id=55be6819da774e158af5a660b686a1f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.303476 5213 tablet_service.cc:1511] Processing CreateTablet for tablet bc8f6354c1034814af3cc20df25ddb47 (DEFAULT_TABLE table=default.Table_e6eff4f97e084636b5609c6c269cf5ec [id=4f32d603a6764a359605a945c924f6c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.303948 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (DEFAULT_TABLE table=default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.304883 5883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Bootstrap replayed 1/1 log segments. Stats: ops{read=27 overwritten=0 applied=27 ignored=0} inserts{seen=25 ignored=0} mutations{seen=23 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 13:49:46.306564 5883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: Bootstrap complete.
W20260927 13:49:46.307751 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 14d3a3282d684415858dc971cb02eec1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14d3a3282d684415858dc971cb02eec1 already in progress: creating tablet
I20260927 13:49:46.309610 5628 ts_tablet_manager.cc:1403] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.132s user 0.002s sys 0.002s
I20260927 13:49:46.311053 5628 raft_consensus.cc:359] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.319607 5883 raft_consensus.cc:359] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:46.320730 5883 raft_consensus.cc:740] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13a42ae8b95b495c9bcea85d6732cd77, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.321650 5883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 27, Last appended: 1.27, Last appended by leader: 27, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:46.322757 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fc2734e88e431facdf72e9ef136106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.323024 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.323691 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2999bd61907847938975a6232e3899e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.324154 5228 tablet_service.cc:1511] Processing CreateTablet for tablet effce815011d47df960df2c79d41aa1f (DEFAULT_TABLE table=default.Table_e03f455aec424b9fb05a1503d626ae3a [id=0f6fb382a33d46cc973e8a81ed234faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.324542 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effce815011d47df960df2c79d41aa1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.329032 5911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:46.331290 5911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:46.331159 5883 sys_catalog.cc:565] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 13:49:46.332995 5628 raft_consensus.cc:385] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.333184 5628 raft_consensus.cc:740] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.327049 5893 consensus_queue.cc:1048] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260927 13:49:46.336365 5809 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 1 FOLLOWER]: Advancing to term 3
I20260927 13:49:46.343281 5628 consensus_queue.cc:260] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.343792 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910b73528ed949bc86badcc4cf6c74a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.346920 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 1f34f2d0f6e9420a8ad38d708b658b17 (DEFAULT_TABLE table=default.Table_f4169b61d7234a6286c6c26a3b3b2c65 [id=30320123ccb44660bb6013069aa42e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.348543 5628 ts_tablet_manager.cc:1434] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.039s user 0.003s sys 0.000s
I20260927 13:49:46.349502 5750 raft_consensus.cc:493] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.349733 5750 raft_consensus.cc:515] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.350622 5750 leader_election.cc:290] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.353159 5750 consensus_queue.cc:1048] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:46.353395 5220 tablet_service.cc:1511] Processing CreateTablet for tablet 72711f14f26a479c9699b172b41b1db0 (DEFAULT_TABLE table=default.Table_a3789979cff14454ae09dd578f449218 [id=aa9bfeb5b20c499d9897f950fa6db2a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.354179 5626 tablet_bootstrap.cc:492] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:46.356635 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8f6354c1034814af3cc20df25ddb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.359010 5626 ts_tablet_manager.cc:1403] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.189s user 0.014s sys 0.042s
W20260927 13:49:46.360625 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0004ef0b2dd841ac860798d804374dc1 consensus state has no leader
I20260927 13:49:46.361033 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2e1239a5183b45839ad4a031b7398f95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:46.365203 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f549f487ea4dbb8c7fceee6f8a6db0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:46.366214 5044 leader_election.cc:343] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.366513 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0004ef0b2dd841ac860798d804374dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.367800 5626 raft_consensus.cc:359] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.367988 5626 raft_consensus.cc:385] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.368281 5626 raft_consensus.cc:740] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.368564 5626 consensus_queue.cc:260] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.369753 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72711f14f26a479c9699b172b41b1db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.371536 5626 ts_tablet_manager.cc:1434] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
W20260927 13:49:46.372653 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e1239a5183b45839ad4a031b7398f95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.377427 5628 tablet_bootstrap.cc:492] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:46.378434 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_fab1230046a44991874933aff1c03068"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:46.304833 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:46.307046 5619 tablet_bootstrap.cc:492] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.352257 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f549f487ea4dbb8c7fceee6f8a6db0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:46.379525 5619 ts_tablet_manager.cc:1403] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.261s user 0.002s sys 0.011s
W20260927 13:49:46.380034 5045 leader_election.cc:343] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.380214 5045 leader_election.cc:304] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:46.380383 5619 raft_consensus.cc:359] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.380594 5619 raft_consensus.cc:385] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.380658 5750 raft_consensus.cc:2749] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:46.380676 5619 raft_consensus.cc:740] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.380939 5619 consensus_queue.cc:260] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.381469 5619 ts_tablet_manager.cc:1434] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:46.381780 5619 tablet_bootstrap.cc:492] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.383240 4924 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 0caf934bc99c4ad38eea5fc812b60931
I20260927 13:49:46.383949 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet d9b04383cb494f65be7ba507a0f0b441 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:46.384429 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet bc8f6354c1034814af3cc20df25ddb47
W20260927 13:49:46.382516 5319 consensus_peers.cc:597] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e6721aa2fa0437eae7ca052c19f0f2e. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:46.366485 5787 raft_consensus.cc:493] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.386014 5787 raft_consensus.cc:515] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.386943 5626 tablet_bootstrap.cc:492] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:46.387038 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f34f2d0f6e9420a8ad38d708b658b17. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:46.387748 5319 leader_election.cc:343] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 54fb19fb86ea43b0b81d6d42ce2d8a5f
I20260927 13:49:46.388793 5787 leader_election.cc:290] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.394153 5787 raft_consensus.cc:493] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.394435 5787 raft_consensus.cc:515] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.395001 5893 raft_consensus.cc:493] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.395970 5893 raft_consensus.cc:515] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:46.396152 5319 leader_election.cc:343] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: ab9ac0e6083343debabc043435c54d95
I20260927 13:49:46.396834 5893 leader_election.cc:290] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:46.397365 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8b80eb00244f7cbcc260af06c16a52" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:46.399564 5185 leader_election.cc:343] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:46.399765 5184 leader_election.cc:343] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 8b8b80eb00244f7cbcc260af06c16a52
I20260927 13:49:46.399955 5184 leader_election.cc:304] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:46.402725 5892 raft_consensus.cc:2749] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:46.403708 5628 tablet_bootstrap.cc:654] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.400372 5619 tablet_bootstrap.cc:654] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:46.412660 5319 leader_election.cc:343] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 54fb19fb86ea43b0b81d6d42ce2d8a5f
I20260927 13:49:46.415014 5319 leader_election.cc:304] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:49:46.415964 5319 leader_election.cc:343] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: ab9ac0e6083343debabc043435c54d95
I20260927 13:49:46.416107 5319 leader_election.cc:304] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:46.409154 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:46.416458 5896 raft_consensus.cc:2749] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:46.416625 5896 raft_consensus.cc:2749] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:46.418709 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet c7670d5f54df49f4a074588ab9269145 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:46.419629 4929 master_service.cc:960] ReplaceTablet: received request to replace tablet 0018704e08254c2e8d30c7067df4420c from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:46.420478 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet bc8f6354c1034814af3cc20df25ddb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.420809 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_22e247f0a5544a5b92efa16ac0dc61bd" } new_table_name: "default.Table_6c94b6fc356049de8f16c25b4cba8c43" modify_external_catalogs: true
I20260927 13:49:46.402634 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 53) took 2341 ms. Trace:
I20260927 13:49:46.424381 5606 rpcz_store.cc:276] 0927 13:49:44.061077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.080001 (+ 18924us) service_pool.cc:224] Handling call
0927 13:49:46.402494 (+2322493us) ts_tablet_manager.cc:1151] Deleting tablet 14d3a3282d684415858dc971cb02eec1
0927 13:49:46.402503 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.402593 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322283}
I20260927 13:49:46.398955 5787 leader_election.cc:290] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.429665 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 55) took 2343 ms. Trace:
I20260927 13:49:46.430047 5606 rpcz_store.cc:276] 0927 13:49:44.085699 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.093517 (+ 7818us) service_pool.cc:224] Handling call
0927 13:49:46.429098 (+2335581us) ts_tablet_manager.cc:1151] Deleting tablet 14d3a3282d684415858dc971cb02eec1
0927 13:49:46.429108 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.429606 (+ 498us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2335321}
I20260927 13:49:46.432236 5606 tablet_replica.cc:333] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:46.433898 5606 raft_consensus.cc:2243] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.434406 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet bc8f6354c1034814af3cc20df25ddb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:46.435138 5606 raft_consensus.cc:2272] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.439863 5626 tablet_bootstrap.cc:654] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:46.440491 5185 consensus_peers.cc:597] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a -> Peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Couldn't send request to peer bb28c54312c94d7dafb1c2abf7870735. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:46.444489 5606 ts_tablet_manager.cc:1916] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.447597 5750 raft_consensus.cc:493] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.447757 5750 raft_consensus.cc:515] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.448633 5750 leader_election.cc:290] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:46.449507 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7681d137476040788e40dd787ce74ccd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:46.450675 5045 leader_election.cc:343] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.453382 5619 tablet_bootstrap.cc:492] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.453641 5619 ts_tablet_manager.cc:1403] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.004s
I20260927 13:49:46.455540 5619 raft_consensus.cc:359] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.455917 5619 raft_consensus.cc:385] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.456140 5619 raft_consensus.cc:740] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.456656 5619 consensus_queue.cc:260] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.457475 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:46.458950 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7681d137476040788e40dd787ce74ccd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:46.459720 5044 leader_election.cc:343] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.459901 5044 leader_election.cc:304] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:46.460382 5750 raft_consensus.cc:2749] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:46.464812 5185 consensus_peers.cc:597] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a -> Peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Couldn't send request to peer bb28c54312c94d7dafb1c2abf7870735. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:46.468083 5619 ts_tablet_manager.cc:1434] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260927 13:49:46.469666 5619 tablet_bootstrap.cc:492] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.469892 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
W20260927 13:49:46.479223 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fab1230046a44991874933aff1c03068 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.479821 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_87c2ff7de94d4663aebf61e88f2d5080" } modify_external_catalogs: true
W20260927 13:49:46.480218 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet bc8f6354c1034814af3cc20df25ddb47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc8f6354c1034814af3cc20df25ddb47 already in progress: creating tablet
W20260927 13:49:46.480397 4916 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 59076.6us
W20260927 13:49:46.420791 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a61eedf06dab4096a397da8ce98a07da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a61eedf06dab4096a397da8ce98a07da already in progress: creating tablet
I20260927 13:49:46.481506 5619 tablet_bootstrap.cc:654] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:46.481781 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2fc2734e88e431facdf72e9ef136106 consensus state has no leader
W20260927 13:49:46.483853 4917 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 77933.3us
I20260927 13:49:46.485402 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_87c2ff7de94d4663aebf61e88f2d5080" } modify_external_catalogs: true
I20260927 13:49:46.486858 5787 raft_consensus.cc:493] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.487052 5787 raft_consensus.cc:515] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.487720 5787 leader_election.cc:290] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:46.489104 5319 leader_election.cc:343] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 169e64b6e20544e6ad1bc31c7ec29cf2
I20260927 13:49:46.489156 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169e64b6e20544e6ad1bc31c7ec29cf2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:46.490216 5248 raft_consensus.cc:2468] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:46.490847 5319 leader_election.cc:304] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:46.491467 5787 raft_consensus.cc:2804] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:46.491601 5787 raft_consensus.cc:493] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:46.491696 5787 raft_consensus.cc:3060] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.494344 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f91dab3c58974becbe03c7d55f1a01d4" } modify_external_catalogs: true
I20260927 13:49:46.495697 5787 raft_consensus.cc:515] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.496381 5623 ts_tablet_manager.cc:1929] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:46.496507 5623 log.cc:1199] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/d47c71b038c34a729ca20965d133c488
W20260927 13:49:46.497129 5319 leader_election.cc:343] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 169e64b6e20544e6ad1bc31c7ec29cf2
I20260927 13:49:46.497836 5787 leader_election.cc:290] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.498343 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f91dab3c58974becbe03c7d55f1a01d4" } modify_external_catalogs: true
I20260927 13:49:46.498705 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169e64b6e20544e6ad1bc31c7ec29cf2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:46.501868 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_0956a69da22a495691888f08a70b62dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:46.502480 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0956a69da22a495691888f08a70b62dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.504675 4930 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 79514522a9d142438fd6aecc91f0463e (table default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 4 got 0
I20260927 13:49:46.504917 4930 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (table default.Table_183e16824f194b1caa9327d0973f607b [id=c16d7a8a2339458b8c973cedf99c32bf]). Expected version 3 got 2
I20260927 13:49:46.506330 5619 tablet_bootstrap.cc:492] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.506606 5619 ts_tablet_manager.cc:1403] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.003s
I20260927 13:49:46.507879 5619 raft_consensus.cc:359] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.508240 5619 raft_consensus.cc:385] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.508386 5619 raft_consensus.cc:740] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.508339 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7eb7d784240942aa8d68de267ce1a586" } new_table_name: "default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b" modify_external_catalogs: true
I20260927 13:49:46.509127 5619 consensus_queue.cc:260] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.509693 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
W20260927 13:49:46.510548 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 14d3a3282d684415858dc971cb02eec1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14d3a3282d684415858dc971cb02eec1 already in progress: creating tablet
W20260927 13:49:46.510838 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 14d3a3282d684415858dc971cb02eec1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14d3a3282d684415858dc971cb02eec1 already in progress: creating tablet
I20260927 13:49:46.515236 5619 ts_tablet_manager.cc:1434] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260927 13:49:46.515609 5619 tablet_bootstrap.cc:492] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.516382 5248 raft_consensus.cc:3060] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.517395 5619 tablet_bootstrap.cc:654] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.514441 5606 ts_tablet_manager.cc:1929] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.519945 5606 log.cc:1199] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b0dfe23bef144e438ae762e401f02e8f
I20260927 13:49:46.520766 5623 ts_tablet_manager.cc:1950] T d47c71b038c34a729ca20965d133c488 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.520841 5606 ts_tablet_manager.cc:1950] T b0dfe23bef144e438ae762e401f02e8f P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:46.521834 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 56) took 2420 ms. Trace:
I20260927 13:49:46.522085 5248 raft_consensus.cc:2468] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:46.522320 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 44) took 2469 ms. Trace:
I20260927 13:49:46.522446 5623 rpcz_store.cc:276] 0927 13:49:44.051661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.051809 (+ 148us) service_pool.cc:224] Handling call
0927 13:49:46.281572 (+2229763us) ts_tablet_manager.cc:1151] Deleting tablet d47c71b038c34a729ca20965d133c488
0927 13:49:46.281582 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.457628 (+176046us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.496005 (+ 38377us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.521156 (+ 25151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2221164}
I20260927 13:49:46.522589 5319 leader_election.cc:304] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:46.522670 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:46.522943 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet d47c71b038c34a729ca20965d133c488 (table default.Table_5bc1a994e68f4119a73bfcdbe454caa3 [id=eefd9636d7c1431d8d0ea214090cf216]) successfully deleted
I20260927 13:49:46.523181 5787 raft_consensus.cc:2804] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:46.523231 5623 tablet_replica.cc:333] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.523331 5787 raft_consensus.cc:697] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:46.523465 5623 raft_consensus.cc:2243] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.523610 5623 raft_consensus.cc:2272] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.523613 5787 consensus_queue.cc:237] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.524236 5623 ts_tablet_manager.cc:1916] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.526342 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet bc8f6354c1034814af3cc20df25ddb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:46.522022 5606 rpcz_store.cc:276] 0927 13:49:44.101302 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.101356 (+ 54us) service_pool.cc:224] Handling call
0927 13:49:46.431757 (+2330401us) ts_tablet_manager.cc:1151] Deleting tablet b0dfe23bef144e438ae762e401f02e8f
0927 13:49:46.431771 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.482995 (+ 51224us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.514367 (+ 31372us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.521774 (+ 7407us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2330106}
I20260927 13:49:46.528790 5606 tablet_replica.cc:333] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:46.529235 5606 raft_consensus.cc:2243] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:46.530310 5628 tablet_bootstrap.cc:492] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:46.530531 5628 ts_tablet_manager.cc:1403] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.153s user 0.004s sys 0.000s
I20260927 13:49:46.531235 5899 tablet.cc:1751] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:46.531674 5606 raft_consensus.cc:2272] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.532253 5628 raft_consensus.cc:359] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.532437 5628 raft_consensus.cc:385] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.532528 5628 raft_consensus.cc:740] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.532692 5903 tablet.cc:1751] T b6bf85c1c2254063a1ffc0b7bf97eb38 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:46.532758 5628 consensus_queue.cc:260] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.533259 5628 ts_tablet_manager.cc:1434] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:46.533288 5880 tablet.cc:1751] T b6bf85c1c2254063a1ffc0b7bf97eb38 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:46.536089 5628 tablet_bootstrap.cc:492] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:46.536983 5606 ts_tablet_manager.cc:1916] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.550768 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a0d3e839f0b941a7a8d6d59a62ae8507"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:46.551425 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0d3e839f0b941a7a8d6d59a62ae8507 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:46.553453 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cc174eab36b46fb8e276b3168fbfbcd consensus state has no leader
W20260927 13:49:46.553579 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6817fb4caf6a445b899830c6702bf911 has no consensus state
I20260927 13:49:46.553902 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d4e41f2afdee4a93ad03e1b7a65c5641"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:46.553851 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e802abef0baa46cfb73fb666fc0772be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:46.554394 5431 heartbeater.cc:344] Connected to a master server at 127.4.163.126:42985
W20260927 13:49:46.554450 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e802abef0baa46cfb73fb666fc0772be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.554577 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
W20260927 13:49:46.556246 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4e41f2afdee4a93ad03e1b7a65c5641 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.557750 5619 tablet_bootstrap.cc:492] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.557951 5619 ts_tablet_manager.cc:1403] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.002s
I20260927 13:49:46.558833 5626 tablet_bootstrap.cc:492] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:46.559012 5626 ts_tablet_manager.cc:1403] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.187s user 0.005s sys 0.005s
I20260927 13:49:46.559128 5619 raft_consensus.cc:359] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.559396 5619 raft_consensus.cc:385] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.559523 5619 raft_consensus.cc:740] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.559819 5626 raft_consensus.cc:359] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.559872 5619 consensus_queue.cc:260] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.560051 5626 raft_consensus.cc:385] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.560159 5626 raft_consensus.cc:740] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.560556 5156 heartbeater.cc:344] Connected to a master server at 127.4.163.126:42985
I20260927 13:49:46.560686 5626 consensus_queue.cc:260] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.560868 5619 ts_tablet_manager.cc:1434] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:46.561556 5619 tablet_bootstrap.cc:492] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.561555 5626 ts_tablet_manager.cc:1434] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:46.561837 5626 tablet_bootstrap.cc:492] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:46.563912 5619 tablet_bootstrap.cc:654] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.568753 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:46.572788 5606 ts_tablet_manager.cc:1929] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:46.572989 5606 log.cc:1199] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/7e6721aa2fa0437eae7ca052c19f0f2e
I20260927 13:49:46.573567 5606 ts_tablet_manager.cc:1950] T 7e6721aa2fa0437eae7ca052c19f0f2e P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:46.574097 5626 tablet_bootstrap.cc:654] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.574488 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 57) took 2469 ms. Trace:
I20260927 13:49:46.574649 5606 rpcz_store.cc:276] 0927 13:49:44.104786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.105389 (+ 603us) service_pool.cc:224] Handling call
0927 13:49:46.528706 (+2423317us) ts_tablet_manager.cc:1151] Deleting tablet 7e6721aa2fa0437eae7ca052c19f0f2e
0927 13:49:46.528715 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.551784 (+ 23069us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.572690 (+ 20906us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.574454 (+ 1764us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2423112}
I20260927 13:49:46.575387 5606 tablet_replica.cc:333] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:46.575641 5606 raft_consensus.cc:2243] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.575877 5606 raft_consensus.cc:2272] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.578815 5606 ts_tablet_manager.cc:1916] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.587344 5619 tablet_bootstrap.cc:492] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.587587 5619 ts_tablet_manager.cc:1403] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.000s
I20260927 13:49:46.587965 5623 ts_tablet_manager.cc:1929] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.588073 5623 log.cc:1199] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/a61eedf06dab4096a397da8ce98a07da
I20260927 13:49:46.588320 5623 ts_tablet_manager.cc:1950] T a61eedf06dab4096a397da8ce98a07da P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.588781 5619 raft_consensus.cc:359] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.589051 5619 raft_consensus.cc:385] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.589169 5619 raft_consensus.cc:740] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.589381 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 46) took 2513 ms. Trace:
I20260927 13:49:46.589533 5619 consensus_queue.cc:260] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.590384 5619 ts_tablet_manager.cc:1434] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:46.590829 5619 tablet_bootstrap.cc:492] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.592935 5619 tablet_bootstrap.cc:654] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.593232 5628 tablet_bootstrap.cc:654] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.589550 5623 rpcz_store.cc:276] 0927 13:49:44.075702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.076378 (+ 676us) service_pool.cc:224] Handling call
0927 13:49:46.523170 (+2446792us) ts_tablet_manager.cc:1151] Deleting tablet a61eedf06dab4096a397da8ce98a07da
0927 13:49:46.523178 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.536059 (+ 12881us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.587906 (+ 51847us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.589314 (+ 1408us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2436069}
I20260927 13:49:46.593881 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet a61eedf06dab4096a397da8ce98a07da (table default.Table_62531a04ef9143aa9089eb9779aee6f5 [id=823e5f62db3849ce913eba29b20a4e0a]) successfully deleted
I20260927 13:49:46.594632 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 47) took 2500 ms. Trace:
I20260927 13:49:46.594815 5623 rpcz_store.cc:276] 0927 13:49:44.093701 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.095270 (+ 1569us) service_pool.cc:224] Handling call
0927 13:49:46.594442 (+2499172us) ts_tablet_manager.cc:1151] Deleting tablet 14d3a3282d684415858dc971cb02eec1
0927 13:49:46.594455 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.594574 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2498950}
W20260927 13:49:46.595441 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 14d3a3282d684415858dc971cb02eec1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14d3a3282d684415858dc971cb02eec1 already in progress: creating tablet
I20260927 13:49:46.596457 5623 tablet_replica.cc:333] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.596688 5623 raft_consensus.cc:2243] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.596933 5623 raft_consensus.cc:2272] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.597831 5623 ts_tablet_manager.cc:1916] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.603528 5606 ts_tablet_manager.cc:1929] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:46.603961 5606 log.cc:1199] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/991d0dcb68964df99b1bf5b43c890e28
I20260927 13:49:46.605835 5623 ts_tablet_manager.cc:1929] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:46.605878 5606 ts_tablet_manager.cc:1950] T 991d0dcb68964df99b1bf5b43c890e28 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:46.605978 5623 log.cc:1199] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/7e6721aa2fa0437eae7ca052c19f0f2e
I20260927 13:49:46.606437 5623 ts_tablet_manager.cc:1950] T 7e6721aa2fa0437eae7ca052c19f0f2e P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.606926 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 70) took 2415 ms. Trace:
I20260927 13:49:46.607514 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3ab0995080774a95967ee1d1ce7c9fdf" } modify_external_catalogs: true
I20260927 13:49:46.607698 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3ab0995080774a95967ee1d1ce7c9fdf" } modify_external_catalogs: true
I20260927 13:49:46.608511 5628 tablet_bootstrap.cc:492] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:46.608665 5628 ts_tablet_manager.cc:1403] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.000s
I20260927 13:49:46.608919 4927 master_service.cc:960] ReplaceTablet: received request to replace tablet e56df07d0a524e5184bdc7fc8d95857c from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:46.610378 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet 70d1197bee2d477ab77d15cbd4907595 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:46.612079 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 49) took 2502 ms. Trace:
I20260927 13:49:46.612208 5623 rpcz_store.cc:276] 0927 13:49:44.109114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.117093 (+ 7979us) service_pool.cc:224] Handling call
0927 13:49:46.595767 (+2478674us) ts_tablet_manager.cc:1151] Deleting tablet 7e6721aa2fa0437eae7ca052c19f0f2e
0927 13:49:46.595779 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.602827 (+ 7048us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.605762 (+ 2935us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.612044 (+ 6282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2027,"tablet-delete.queue_time_us":2438295}
I20260927 13:49:46.612674 5623 tablet_replica.cc:333] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.612912 5623 raft_consensus.cc:2243] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.613072 5623 raft_consensus.cc:2272] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.614288 5623 ts_tablet_manager.cc:1916] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.614760 5628 raft_consensus.cc:359] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.614970 5628 raft_consensus.cc:385] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.615052 5628 raft_consensus.cc:740] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.619700 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet e56df07d0a524e5184bdc7fc8d95857c
I20260927 13:49:46.620198 4927 catalog_manager.cc:6934] ReplaceTablet: tablet e56df07d0a524e5184bdc7fc8d95857c deleted and replaced by tablet 03917a40b5884401a6bc09c7925fd1ae
I20260927 13:49:46.620537 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_80d468d713554a8fb3b781794b43157a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:46.620797 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet e56df07d0a524e5184bdc7fc8d95857c with delete_type TABLET_DATA_DELETED (replaced by tablet 03917a40b5884401a6bc09c7925fd1ae) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:46.620875 5623 ts_tablet_manager.cc:1929] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.621006 5623 log.cc:1199] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/11d303db711543e5ac23bfcd2279c993
W20260927 13:49:46.621135 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80d468d713554a8fb3b781794b43157a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.621393 5628 consensus_queue.cc:260] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.622298 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet e56df07d0a524e5184bdc7fc8d95857c with delete_type TABLET_DATA_DELETED (replaced by tablet 03917a40b5884401a6bc09c7925fd1ae) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.622596 5625 tablet_replica.cc:333] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:46.623307 5623 ts_tablet_manager.cc:1950] T 11d303db711543e5ac23bfcd2279c993 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.624198 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 62) took 2425 ms. Trace:
I20260927 13:49:46.624298 5623 rpcz_store.cc:276] 0927 13:49:44.198814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.199158 (+ 344us) service_pool.cc:224] Handling call
0927 13:49:46.612604 (+2413446us) ts_tablet_manager.cc:1151] Deleting tablet 11d303db711543e5ac23bfcd2279c993
0927 13:49:46.612614 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.617715 (+ 5101us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.620801 (+ 3086us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.624144 (+ 3343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2390961}
I20260927 13:49:46.624644 5623 tablet_replica.cc:333] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.624814 5623 raft_consensus.cc:2243] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.625033 5623 raft_consensus.cc:2272] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.625527 5623 ts_tablet_manager.cc:1916] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.626489 5628 ts_tablet_manager.cc:1434] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260927 13:49:46.626931 5628 tablet_bootstrap.cc:492] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:46.629042 5628 tablet_bootstrap.cc:654] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.633061 5623 ts_tablet_manager.cc:1929] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.633188 5623 log.cc:1199] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/8b8b80eb00244f7cbcc260af06c16a52
I20260927 13:49:46.633522 5623 ts_tablet_manager.cc:1950] T 8b8b80eb00244f7cbcc260af06c16a52 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.634303 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 64) took 2435 ms. Trace:
I20260927 13:49:46.634495 5626 tablet_bootstrap.cc:492] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:46.634687 5626 ts_tablet_manager.cc:1403] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.002s
I20260927 13:49:46.635736 5626 raft_consensus.cc:359] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.635993 5626 raft_consensus.cc:385] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.636139 5626 raft_consensus.cc:740] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.636451 5626 consensus_queue.cc:260] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.636663 5623 rpcz_store.cc:276] 0927 13:49:44.199058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.199180 (+ 122us) service_pool.cc:224] Handling call
0927 13:49:46.624561 (+2425381us) ts_tablet_manager.cc:1151] Deleting tablet 8b8b80eb00244f7cbcc260af06c16a52
0927 13:49:46.624570 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.629247 (+ 4677us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.632987 (+ 3740us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.634266 (+ 1279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2402663}
I20260927 13:49:46.637019 5623 tablet_replica.cc:333] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.637140 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 8b8b80eb00244f7cbcc260af06c16a52 (table default.Table_c06fd2ea93254d09a8daffb63dd4a4e5 [id=5562b818949449e8ab5c21843d710d6d]) successfully deleted
I20260927 13:49:46.637290 5623 raft_consensus.cc:2243] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.637524 5626 ts_tablet_manager.cc:1434] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:46.637851 5626 tablet_bootstrap.cc:492] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:46.638355 5623 raft_consensus.cc:2272] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.641481 5623 ts_tablet_manager.cc:1916] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.612627 5787 raft_consensus.cc:493] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.612977 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:46.643927 5787 raft_consensus.cc:515] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.644686 5787 leader_election.cc:290] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.620879 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet e56df07d0a524e5184bdc7fc8d95857c with delete_type TABLET_DATA_DELETED (replaced by tablet 03917a40b5884401a6bc09c7925fd1ae) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:46.645691 5626 tablet_bootstrap.cc:654] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.640148 5916 raft_consensus.cc:493] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.646195 5916 raft_consensus.cc:515] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.646992 5916 leader_election.cc:290] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:46.650393 5319 leader_election.cc:343] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a61eedf06dab4096a397da8ce98a07da
W20260927 13:49:46.650640 5319 leader_election.cc:343] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: a61eedf06dab4096a397da8ce98a07da
I20260927 13:49:46.650743 5319 leader_election.cc:304] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:46.651834 5916 raft_consensus.cc:2749] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:46.650624 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bdd64d67d94276b20ab862dec0d2ee" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:46.653573 5249 raft_consensus.cc:2468] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:46.654397 5319 leader_election.cc:304] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:49:46.654659 5319 leader_election.cc:343] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b4bdd64d67d94276b20ab862dec0d2ee
I20260927 13:49:46.654945 5916 raft_consensus.cc:2804] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:46.655021 5916 raft_consensus.cc:493] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:46.655119 5916 raft_consensus.cc:3060] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.660131 5916 raft_consensus.cc:515] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.660864 5916 leader_election.cc:290] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:46.661650 5045 consensus_peers.cc:597] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 -> Peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Couldn't send request to peer bb28c54312c94d7dafb1c2abf7870735. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:46.661691 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bdd64d67d94276b20ab862dec0d2ee" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:46.661875 5249 raft_consensus.cc:3060] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:46.662544 5319 leader_election.cc:343] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b4bdd64d67d94276b20ab862dec0d2ee
I20260927 13:49:46.662798 5606 rpcz_store.cc:276] 0927 13:49:44.191081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.191168 (+ 87us) service_pool.cc:224] Handling call
0927 13:49:46.575326 (+2384158us) ts_tablet_manager.cc:1151] Deleting tablet 991d0dcb68964df99b1bf5b43c890e28
0927 13:49:46.575335 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.594106 (+ 18771us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.597463 (+ 3357us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.606871 (+ 9408us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2367458}
I20260927 13:49:46.663903 5606 tablet_replica.cc:333] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:46.664091 5606 raft_consensus.cc:2243] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:46.664327 5623 ts_tablet_manager.cc:1929] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.664433 5606 pending_rounds.cc:70] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:46.664453 5623 log.cc:1199] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/169e64b6e20544e6ad1bc31c7ec29cf2
I20260927 13:49:46.664489 5606 pending_rounds.cc:77] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957576802971648 op_type: NO_OP noop_request { }
I20260927 13:49:46.664594 5606 raft_consensus.cc:2889] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:46.664685 5606 raft_consensus.cc:2272] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.664791 5623 ts_tablet_manager.cc:1950] T 169e64b6e20544e6ad1bc31c7ec29cf2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.665246 5249 raft_consensus.cc:2468] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:46.665485 5606 ts_tablet_manager.cc:1916] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.665545 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 65) took 2452 ms. Trace:
I20260927 13:49:46.665637 5623 rpcz_store.cc:276] 0927 13:49:44.213418 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.213472 (+ 54us) service_pool.cc:224] Handling call
0927 13:49:46.636947 (+2423475us) ts_tablet_manager.cc:1151] Deleting tablet 169e64b6e20544e6ad1bc31c7ec29cf2
0927 13:49:46.636956 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.647695 (+ 10739us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.664252 (+ 16557us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.665489 (+ 1237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87,"tablet-delete.queue_time_us":2414886}
I20260927 13:49:46.666000 5623 tablet_replica.cc:333] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.666198 5623 raft_consensus.cc:2243] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:46.666428 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 169e64b6e20544e6ad1bc31c7ec29cf2 (table default.Table_a23fe407dd1047ca98d605e2cee52fdc [id=4f5c882c6f8449cf9daacd66a354bc9f]) successfully deleted
I20260927 13:49:46.666527 5623 pending_rounds.cc:70] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:46.666594 5623 pending_rounds.cc:77] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957572398002176 op_type: NO_OP noop_request { }
I20260927 13:49:46.666721 5623 raft_consensus.cc:2889] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:46.666826 5623 raft_consensus.cc:2272] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.667098 5319 leader_election.cc:304] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:46.667471 5623 ts_tablet_manager.cc:1916] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.667582 5916 raft_consensus.cc:2804] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:46.667969 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:46.668941 5619 tablet_bootstrap.cc:492] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.669078 5619 ts_tablet_manager.cc:1403] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.078s user 0.003s sys 0.002s
I20260927 13:49:46.669950 5619 raft_consensus.cc:359] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.670156 5619 raft_consensus.cc:385] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.670260 5619 raft_consensus.cc:740] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.670459 5619 consensus_queue.cc:260] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.667824 5916 raft_consensus.cc:697] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:46.670976 5916 consensus_queue.cc:237] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.671265 5619 ts_tablet_manager.cc:1434] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260927 13:49:46.671579 5619 tablet_bootstrap.cc:492] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.673888 5619 tablet_bootstrap.cc:654] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.674401 5623 ts_tablet_manager.cc:1929] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:46.674587 5623 log.cc:1199] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b0dfe23bef144e438ae762e401f02e8f
I20260927 13:49:46.675078 5623 ts_tablet_manager.cc:1950] T b0dfe23bef144e438ae762e401f02e8f P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.675985 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 48) took 2569 ms. Trace:
I20260927 13:49:46.676136 5623 rpcz_store.cc:276] 0927 13:49:44.106917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.109107 (+ 2190us) service_pool.cc:224] Handling call
0927 13:49:46.665929 (+2556822us) ts_tablet_manager.cc:1151] Deleting tablet b0dfe23bef144e438ae762e401f02e8f
0927 13:49:46.665939 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.671110 (+ 5171us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.674316 (+ 3206us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.675916 (+ 1600us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2440158}
I20260927 13:49:46.676591 5623 tablet_replica.cc:333] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.676812 5623 raft_consensus.cc:2243] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:46.677157 5623 raft_consensus.cc:2272] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.677696 5623 ts_tablet_manager.cc:1916] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.677850 5625 raft_consensus.cc:2243] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:46.678377 5625 raft_consensus.cc:2272] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.679067 5628 tablet_bootstrap.cc:492] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:46.679217 5625 ts_tablet_manager.cc:1916] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.679312 5628 ts_tablet_manager.cc:1403] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.000s
I20260927 13:49:46.680312 5628 raft_consensus.cc:359] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.680542 5628 raft_consensus.cc:385] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.680644 5628 raft_consensus.cc:740] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.680895 5628 consensus_queue.cc:260] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.686657 5623 ts_tablet_manager.cc:1929] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:46.686872 5623 log.cc:1199] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/991d0dcb68964df99b1bf5b43c890e28
I20260927 13:49:46.688005 5623 ts_tablet_manager.cc:1950] T 991d0dcb68964df99b1bf5b43c890e28 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.688841 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 63) took 2489 ms. Trace:
I20260927 13:49:46.689015 5623 rpcz_store.cc:276] 0927 13:49:44.198941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.199004 (+ 63us) service_pool.cc:224] Handling call
0927 13:49:46.676495 (+2477491us) ts_tablet_manager.cc:1151] Deleting tablet 991d0dcb68964df99b1bf5b43c890e28
0927 13:49:46.676508 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.682737 (+ 6229us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.686578 (+ 3841us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.688805 (+ 2227us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2411055}
I20260927 13:49:46.689790 5623 tablet_replica.cc:333] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.690062 5623 raft_consensus.cc:2243] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.690292 5623 raft_consensus.cc:2272] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.691093 5623 ts_tablet_manager.cc:1916] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.693945 5750 raft_consensus.cc:493] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.694139 5750 raft_consensus.cc:515] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.694829 5750 leader_election.cc:290] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.695725 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_69a87aa5933f49eaaa3085e0b505f5ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:46.695994 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b783ffbf2a05453fa43797ce495f8e7a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:46.696298 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69a87aa5933f49eaaa3085e0b505f5ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.697412 5619 tablet_bootstrap.cc:492] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.697568 5619 ts_tablet_manager.cc:1403] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.002s
I20260927 13:49:46.698531 5623 ts_tablet_manager.cc:1929] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:49:46.698698 5045 leader_election.cc:343] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.699173 5623 log.cc:1199] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/399d6411d8ad4354b3c0f8f4d78779a9
I20260927 13:49:46.699451 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:46.699448 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b783ffbf2a05453fa43797ce495f8e7a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:46.699781 5623 ts_tablet_manager.cc:1950] T 399d6411d8ad4354b3c0f8f4d78779a9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
W20260927 13:49:46.700016 5044 leader_election.cc:343] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.700145 5044 leader_election.cc:304] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:46.700776 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 72) took 2234 ms. Trace:
I20260927 13:49:46.700925 5623 rpcz_store.cc:276] 0927 13:49:44.465995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.468028 (+ 2033us) service_pool.cc:224] Handling call
0927 13:49:46.689730 (+2221702us) ts_tablet_manager.cc:1151] Deleting tablet 399d6411d8ad4354b3c0f8f4d78779a9
0927 13:49:46.689740 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.694389 (+ 4649us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.698471 (+ 4082us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.700725 (+ 2254us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2221492}
I20260927 13:49:46.701494 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 399d6411d8ad4354b3c0f8f4d78779a9 (table default.Table_ba82da1367c447beadfb286a237a81de [id=3557e871819045648d0e38a96c9d6b52]) successfully deleted
I20260927 13:49:46.701982 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 74) took 2218 ms. Trace:
I20260927 13:49:46.702140 5623 rpcz_store.cc:276] 0927 13:49:44.483272 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.483341 (+ 69us) service_pool.cc:224] Handling call
0927 13:49:46.701813 (+2218472us) ts_tablet_manager.cc:1151] Deleting tablet 7dc612cbcd5d4755a188408f2a036f34
0927 13:49:46.701824 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.701929 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2218236}
I20260927 13:49:46.702242 5750 raft_consensus.cc:2749] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:46.702848 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 7dc612cbcd5d4755a188408f2a036f34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dc612cbcd5d4755a188408f2a036f34 already in progress: creating tablet
I20260927 13:49:46.703205 5623 tablet_replica.cc:333] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.703480 5623 raft_consensus.cc:2243] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:46.704208 5623 raft_consensus.cc:2272] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.705090 5623 ts_tablet_manager.cc:1916] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.705163 5619 raft_consensus.cc:359] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.705403 5619 raft_consensus.cc:385] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.705497 5619 raft_consensus.cc:740] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.705742 5619 consensus_queue.cc:260] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.707582 5619 ts_tablet_manager.cc:1434] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 13:49:46.707857 5628 ts_tablet_manager.cc:1434] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260927 13:49:46.708204 5628 tablet_bootstrap.cc:492] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:46.708554 5619 tablet_bootstrap.cc:492] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.711496 5623 ts_tablet_manager.cc:1929] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:46.711683 5623 log.cc:1199] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/a1489f766164444b9aaa7b58e81a72d9
I20260927 13:49:46.712168 5623 ts_tablet_manager.cc:1950] T a1489f766164444b9aaa7b58e81a72d9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.714534 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 75) took 2229 ms. Trace:
I20260927 13:49:46.714699 5623 rpcz_store.cc:276] 0927 13:49:44.483458 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.483508 (+ 50us) service_pool.cc:224] Handling call
0927 13:49:46.703131 (+2219623us) ts_tablet_manager.cc:1151] Deleting tablet a1489f766164444b9aaa7b58e81a72d9
0927 13:49:46.703139 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.708457 (+ 5318us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.711417 (+ 2960us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.712912 (+ 1495us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2219420}
I20260927 13:49:46.715255 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet a1489f766164444b9aaa7b58e81a72d9 (table default.Table_055f1a3f79864929982c584ed6dec1e9 [id=2a104f24fe5e4ad8bfb52eb2dbdf9a8a]) successfully deleted
I20260927 13:49:46.715597 5623 tablet_replica.cc:333] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.715582 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_aca59e0ffb234d4c96a55c95d3e0967e" } new_table_name: "default.Table_2e56407bf2244b24860c913e16e71016" modify_external_catalogs: true
I20260927 13:49:46.715739 5619 tablet_bootstrap.cc:654] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.715952 5623 raft_consensus.cc:2243] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.716224 5623 raft_consensus.cc:2272] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.716804 5623 ts_tablet_manager.cc:1916] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.722039 5619 tablet_bootstrap.cc:492] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.722843 5619 ts_tablet_manager.cc:1403] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20260927 13:49:46.723533 5623 ts_tablet_manager.cc:1929] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 13:49:46.723714 5623 log.cc:1199] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/fbb2e0a01a9147d597693eab481ca73b
I20260927 13:49:46.724153 5431 heartbeater.cc:499] Master 127.4.163.126:42985 was elected leader, sending a full tablet report...
I20260927 13:49:46.724223 5623 ts_tablet_manager.cc:1950] T fbb2e0a01a9147d597693eab481ca73b P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.724159 5619 raft_consensus.cc:359] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.724468 5619 raft_consensus.cc:385] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.724617 5619 raft_consensus.cc:740] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.725088 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 73) took 2242 ms. Trace:
I20260927 13:49:46.725051 5619 consensus_queue.cc:260] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.725255 5623 rpcz_store.cc:276] 0927 13:49:44.482780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.482933 (+ 153us) service_pool.cc:224] Handling call
0927 13:49:46.715537 (+2232604us) ts_tablet_manager.cc:1151] Deleting tablet fbb2e0a01a9147d597693eab481ca73b
0927 13:49:46.715547 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.720466 (+ 4919us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.723476 (+ 3010us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.725036 (+ 1560us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2231631}
I20260927 13:49:46.726016 5623 tablet_replica.cc:333] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.726434 5623 raft_consensus.cc:2243] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.726712 5623 raft_consensus.cc:2272] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.727283 5623 ts_tablet_manager.cc:1916] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.729511 5619 ts_tablet_manager.cc:1434] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260927 13:49:46.729882 5619 tablet_bootstrap.cc:492] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:46.731472 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd4c568b96084baeb7438a4857adadc1 consensus state has no leader
I20260927 13:49:46.731899 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5e272c5ede1d42d1931b0872ff6f89c5" } new_table_name: "default.Table_2c9769bf8a394c8385b21e36bd7afe18" modify_external_catalogs: true
I20260927 13:49:46.733855 5619 tablet_bootstrap.cc:654] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.736128 5623 ts_tablet_manager.cc:1929] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 13:49:46.736303 5623 log.cc:1199] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/c6d69f70750d4b418f850b2cec3ad721
I20260927 13:49:46.736779 5623 ts_tablet_manager.cc:1950] T c6d69f70750d4b418f850b2cec3ad721 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.737406 5911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 802b83f09d3445359cfac825cd87c9de. Latest consensus state: current_term: 3 leader_uuid: "802b83f09d3445359cfac825cd87c9de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:46.737712 5911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:46.738152 5938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "802b83f09d3445359cfac825cd87c9de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:46.738397 5938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:46.739063 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 76) took 2129 ms. Trace:
I20260927 13:49:46.739249 5623 rpcz_store.cc:276] 0927 13:49:44.609994 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.610122 (+ 128us) service_pool.cc:224] Handling call
0927 13:49:46.725935 (+2115813us) ts_tablet_manager.cc:1151] Deleting tablet c6d69f70750d4b418f850b2cec3ad721
0927 13:49:46.725944 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.733023 (+ 7079us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.736051 (+ 3028us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.739027 (+ 2976us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2115143}
I20260927 13:49:46.739804 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet c6d69f70750d4b418f850b2cec3ad721 (table default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
I20260927 13:49:46.740444 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 82) took 2089 ms. Trace:
I20260927 13:49:46.740603 5623 rpcz_store.cc:276] 0927 13:49:44.651400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.651450 (+ 50us) service_pool.cc:224] Handling call
0927 13:49:46.740290 (+2088840us) ts_tablet_manager.cc:1151] Deleting tablet 3663033220094a4ea6df8e2982eb2188
0927 13:49:46.740301 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.740411 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2074527}
I20260927 13:49:46.740681 5782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "802b83f09d3445359cfac825cd87c9de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:46.740857 5782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: This master's current role is: LEADER
W20260927 13:49:46.741231 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 3663033220094a4ea6df8e2982eb2188 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3663033220094a4ea6df8e2982eb2188 already in progress: creating tablet
W20260927 13:49:46.741966 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c989f70385f64593a46f633c98267627 has no consensus state
I20260927 13:49:46.742503 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5cb92fa2ddb94ae6a51d811089638d7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:46.743054 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cb92fa2ddb94ae6a51d811089638d7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.748451 5385 raft_consensus.cc:3060] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.751332 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 81) took 2100 ms. Trace:
I20260927 13:49:46.752087 5623 rpcz_store.cc:276] 0927 13:49:44.651238 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.651292 (+ 54us) service_pool.cc:224] Handling call
0927 13:49:46.751150 (+2099858us) ts_tablet_manager.cc:1151] Deleting tablet 587471d2b7e647388e7bb1e7f8e06b40
0927 13:49:46.751165 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.751292 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2075657}
W20260927 13:49:46.752751 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 587471d2b7e647388e7bb1e7f8e06b40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 587471d2b7e647388e7bb1e7f8e06b40 already in progress: creating tablet
I20260927 13:49:46.752964 5916 raft_consensus.cc:493] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.753144 5916 raft_consensus.cc:515] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.754068 5916 leader_election.cc:290] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.753249 5623 tablet_replica.cc:333] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.754474 5623 raft_consensus.cc:2243] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.754717 5623 raft_consensus.cc:2272] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.754666 4926 catalog_manager.cc:5838] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:46.754937 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d1197bee2d477ab77d15cbd4907595" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:46.754948 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d1197bee2d477ab77d15cbd4907595" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:46.755059 4926 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet c79b1f2962f44a23916bbfe4cf55a4bc (table default.Table_847c101270804f9f856b7e564cc9fbbe [id=d140ef61df2143d8bd6f44d8f92153c9]). Expected version 1 got 0
I20260927 13:49:46.755152 5249 raft_consensus.cc:2468] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:46.755609 5319 leader_election.cc:304] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:46.756238 5623 ts_tablet_manager.cc:1916] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.756580 5750 consensus_queue.cc:1048] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:46.758068 5916 raft_consensus.cc:2804] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260927 13:49:46.758234 5916 raft_consensus.cc:493] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:46.758347 5916 raft_consensus.cc:3060] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:49:46.761157 5916 raft_consensus.cc:515] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.761626 5382 raft_consensus.cc:1240] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Rejecting Update request from peer 34fc5fe0a32d42ab83f4aa6d07341409 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260927 13:49:46.762363 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d1197bee2d477ab77d15cbd4907595" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:46.762910 5750 consensus_queue.cc:1059] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:46.764318 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d1197bee2d477ab77d15cbd4907595" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:46.764535 5249 raft_consensus.cc:3060] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:49:46.764614 5619 tablet_bootstrap.cc:492] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.764775 5619 ts_tablet_manager.cc:1403] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.002s
I20260927 13:49:46.765515 5619 raft_consensus.cc:359] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.765686 5619 raft_consensus.cc:385] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.765760 5619 raft_consensus.cc:740] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.766074 5619 consensus_queue.cc:260] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.767495 5249 raft_consensus.cc:2468] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 2.
I20260927 13:49:46.768900 5319 leader_election.cc:304] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:46.769770 5916 leader_election.cc:290] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.769937 5787 raft_consensus.cc:2804] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Leader election won for term 2
I20260927 13:49:46.770087 5787 raft_consensus.cc:697] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 2 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:46.770361 5787 consensus_queue.cc:237] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.771639 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 0018704e08254c2e8d30c7067df4420c
I20260927 13:49:46.772203 4929 catalog_manager.cc:6934] ReplaceTablet: tablet 0018704e08254c2e8d30c7067df4420c deleted and replaced by tablet 059afd48ac4a41569ed1d3556b7974f0
I20260927 13:49:46.772511 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 0018704e08254c2e8d30c7067df4420c with delete_type TABLET_DATA_DELETED (replaced by tablet 059afd48ac4a41569ed1d3556b7974f0) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:46.772637 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 0018704e08254c2e8d30c7067df4420c with delete_type TABLET_DATA_DELETED (replaced by tablet 059afd48ac4a41569ed1d3556b7974f0) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:46.772754 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 7681d137476040788e40dd787ce74ccd
I20260927 13:49:46.773414 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:46.773522 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 7681d137476040788e40dd787ce74ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:46.774076 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 7681d137476040788e40dd787ce74ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:46.776204 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 0c72e1a5dced499a932bdc302e006f29 (DEFAULT_TABLE table=default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.777173 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 0c72e1a5dced499a932bdc302e006f29 (DEFAULT_TABLE table=default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.777570 5619 ts_tablet_manager.cc:1434] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260927 13:49:46.777691 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c72e1a5dced499a932bdc302e006f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.778192 5619 tablet_bootstrap.cc:492] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.779071 5916 raft_consensus.cc:493] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.779309 5916 raft_consensus.cc:515] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.780262 5916 leader_election.cc:290] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:46.781438 5319 leader_election.cc:343] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f443c863d087483493baa4c80bb64670
I20260927 13:49:46.781781 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f443c863d087483493baa4c80bb64670" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:46.782068 5249 raft_consensus.cc:2468] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:46.782431 5619 tablet_bootstrap.cc:654] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.782714 5319 leader_election.cc:304] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:46.783193 5916 raft_consensus.cc:2804] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:46.783358 5916 raft_consensus.cc:493] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:46.783531 5916 raft_consensus.cc:3060] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.786950 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 0018704e08254c2e8d30c7067df4420c with delete_type TABLET_DATA_DELETED (replaced by tablet 059afd48ac4a41569ed1d3556b7974f0) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.787454 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 7681d137476040788e40dd787ce74ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.786803 5959 raft_consensus.cc:493] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.788205 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 0c72e1a5dced499a932bdc302e006f29 (DEFAULT_TABLE table=default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.788741 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c72e1a5dced499a932bdc302e006f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.788384 5959 raft_consensus.cc:515] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.790356 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4c568b96084baeb7438a4857adadc1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:46.791385 5045 leader_election.cc:343] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.791683 5625 ts_tablet_manager.cc:1929] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:46.791852 5625 log.cc:1199] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/e56df07d0a524e5184bdc7fc8d95857c
I20260927 13:49:46.792284 5625 ts_tablet_manager.cc:1950] T e56df07d0a524e5184bdc7fc8d95857c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:46.792845 5959 leader_election.cc:290] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.793684 5625 tablet_replica.cc:333] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:46.793888 5625 raft_consensus.cc:2243] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.794088 5625 raft_consensus.cc:2272] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.794754 5625 ts_tablet_manager.cc:1916] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.798341 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4c568b96084baeb7438a4857adadc1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:46.799022 5044 leader_election.cc:343] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.799166 5044 leader_election.cc:304] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:46.799463 5959 raft_consensus.cc:2749] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:46.799976 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet e56df07d0a524e5184bdc7fc8d95857c (table default.Table_5e60c258bac24c7cabc2b7e1e6052193 [id=a160103a454d421c8be6a88afa7c1419]) successfully deleted
I20260927 13:49:46.800464 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 9a35fefc73c54d6c9b1907f55add7b92 (DEFAULT_TABLE table=default.Table_2aebae054f8449988cd389e188502781 [id=d1ef529f97514e258f430548ed8ed1b3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:46.800532 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 0018704e08254c2e8d30c7067df4420c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0018704e08254c2e8d30c7067df4420c already in progress: creating tablet
I20260927 13:49:46.801234 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 9a35fefc73c54d6c9b1907f55add7b92 (DEFAULT_TABLE table=default.Table_2aebae054f8449988cd389e188502781 [id=d1ef529f97514e258f430548ed8ed1b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.801599 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a35fefc73c54d6c9b1907f55add7b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.802978 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 7011125c78084deca83b1570d1c2d704 (DEFAULT_TABLE table=default.Table_2f1b1efb4dbd43b8b3a3008a37acb490 [id=c073a79da0b440698186e6856c8c8c68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.804217 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 7011125c78084deca83b1570d1c2d704 (DEFAULT_TABLE table=default.Table_2f1b1efb4dbd43b8b3a3008a37acb490 [id=c073a79da0b440698186e6856c8c8c68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.804626 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7011125c78084deca83b1570d1c2d704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.804577 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 7011125c78084deca83b1570d1c2d704 (DEFAULT_TABLE table=default.Table_2f1b1efb4dbd43b8b3a3008a37acb490 [id=c073a79da0b440698186e6856c8c8c68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.804926 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7011125c78084deca83b1570d1c2d704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.805436 5351 tablet_service.cc:1511] Processing CreateTablet for tablet a49834518ff34b1981d44f3824c131f3 (DEFAULT_TABLE table=default.Table_db71c9d8deb14250b83d10519ab3af81 [id=9eee52296f51408c907b10227c9bd49d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.806731 5916 raft_consensus.cc:515] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.807395 5916 leader_election.cc:290] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.807518 5894 raft_consensus.cc:493] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.807679 5894 raft_consensus.cc:515] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.808451 5894 leader_election.cc:290] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:46.808938 5089 tablet_service.cc:1511] Processing CreateTablet for tablet a49834518ff34b1981d44f3824c131f3 (DEFAULT_TABLE table=default.Table_db71c9d8deb14250b83d10519ab3af81 [id=9eee52296f51408c907b10227c9bd49d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.809309 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a49834518ff34b1981d44f3824c131f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.810583 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b73420c2074d10ab2e78c6f15df93c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:46.810801 5107 raft_consensus.cc:2468] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:46.811347 5184 leader_election.cc:304] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:46.811664 5894 raft_consensus.cc:2804] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:46.811779 5894 raft_consensus.cc:493] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:46.811884 5894 raft_consensus.cc:3060] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.813601 5217 tablet_service.cc:1511] Processing CreateTablet for tablet a49834518ff34b1981d44f3824c131f3 (DEFAULT_TABLE table=default.Table_db71c9d8deb14250b83d10519ab3af81 [id=9eee52296f51408c907b10227c9bd49d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.813979 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a49834518ff34b1981d44f3824c131f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.814314 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 9a35fefc73c54d6c9b1907f55add7b92 (DEFAULT_TABLE table=default.Table_2aebae054f8449988cd389e188502781 [id=d1ef529f97514e258f430548ed8ed1b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.814538 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b73420c2074d10ab2e78c6f15df93c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:46.814751 5382 raft_consensus.cc:2468] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:46.814927 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a35fefc73c54d6c9b1907f55add7b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.815232 5894 raft_consensus.cc:515] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.818200 5894 leader_election.cc:290] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:46.818682 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b73420c2074d10ab2e78c6f15df93c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:46.818882 5382 raft_consensus.cc:3060] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.822338 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b73420c2074d10ab2e78c6f15df93c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:46.822501 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a35fefc73c54d6c9b1907f55add7b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.822552 5107 raft_consensus.cc:3060] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.822737 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c72e1a5dced499a932bdc302e006f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.823122 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7011125c78084deca83b1570d1c2d704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.823536 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a49834518ff34b1981d44f3824c131f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.824164 5628 tablet_bootstrap.cc:654] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.825428 5107 raft_consensus.cc:2468] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:46.825965 5184 leader_election.cc:304] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
W20260927 13:49:46.826027 5319 leader_election.cc:343] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f443c863d087483493baa4c80bb64670
I20260927 13:49:46.826264 5894 raft_consensus.cc:2804] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:46.826378 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f443c863d087483493baa4c80bb64670" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:46.826402 5894 raft_consensus.cc:697] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:46.827296 5894 consensus_queue.cc:237] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.830193 5382 raft_consensus.cc:2468] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:46.826582 5249 raft_consensus.cc:3060] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:46.833405 5626 tablet_bootstrap.cc:492] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:46.833592 5626 ts_tablet_manager.cc:1403] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.196s user 0.003s sys 0.002s
I20260927 13:49:46.834434 5626 raft_consensus.cc:359] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.834628 5626 raft_consensus.cc:385] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.834710 5626 raft_consensus.cc:740] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.835064 5626 consensus_queue.cc:260] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.835172 5249 raft_consensus.cc:2468] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:46.835708 5626 ts_tablet_manager.cc:1434] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:49:46.835712 5319 leader_election.cc:304] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:46.836017 5626 tablet_bootstrap.cc:492] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:46.836294 5787 raft_consensus.cc:2804] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:46.836782 5928 raft_consensus.cc:3055] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Stepping down as leader of term 1
I20260927 13:49:46.836963 5928 raft_consensus.cc:740] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:46.837387 5928 consensus_queue.cc:260] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.837714 5626 tablet_bootstrap.cc:654] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.837896 5928 raft_consensus.cc:3060] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:49:46.854411 5295 heartbeater.cc:344] Connected to a master server at 127.4.163.126:42985
I20260927 13:49:46.856559 5787 raft_consensus.cc:697] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:46.857088 5787 consensus_queue.cc:237] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.861795 5619 tablet_bootstrap.cc:492] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.862004 5619 ts_tablet_manager.cc:1403] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.084s user 0.016s sys 0.003s
I20260927 13:49:46.862862 5619 raft_consensus.cc:359] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.863108 5619 raft_consensus.cc:385] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.863021 5769 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" instance_seqno: 1790516980574773) as {username='slave'} at 127.4.163.66:35881; Asking this server to re-register.
I20260927 13:49:46.863268 5619 raft_consensus.cc:740] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.863662 5619 consensus_queue.cc:260] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.863992 5295 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:46.864347 5619 ts_tablet_manager.cc:1434] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:46.864673 5619 tablet_bootstrap.cc:492] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.865509 5628 tablet_bootstrap.cc:492] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:46.865725 5628 ts_tablet_manager.cc:1403] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.158s user 0.002s sys 0.001s
I20260927 13:49:46.866271 5769 ts_manager.cc:194] Registered new tserver with Master: 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.866940 5628 raft_consensus.cc:359] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.867137 5628 raft_consensus.cc:385] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.867219 5628 raft_consensus.cc:740] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.867527 5628 consensus_queue.cc:260] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.867975 5619 tablet_bootstrap.cc:654] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.868208 5628 ts_tablet_manager.cc:1434] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:46.870031 5628 tablet_bootstrap.cc:492] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:46.872162 5953 catalog_manager.cc:1308] Loaded cluster ID: 020f38d03ca7495283eb7628b4a1a71b
I20260927 13:49:46.872254 5953 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: loading cluster ID for follower catalog manager: success
I20260927 13:49:46.872356 5628 tablet_bootstrap.cc:654] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.873220 5928 raft_consensus.cc:493] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.873369 5928 raft_consensus.cc:515] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.874675 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e0b4c217ca41b98013155b8d952fe6" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:46.875396 5045 leader_election.cc:343] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.876030 5928 leader_election.cc:290] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:46.876585 5623 ts_tablet_manager.cc:1929] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.877980 5769 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" instance_seqno: 1790516980068287) as {username='slave'} at 127.4.163.65:50611; Asking this server to re-register.
I20260927 13:49:46.880172 5619 tablet_bootstrap.cc:492] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.880149 5769 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" instance_seqno: 1790516981114403) as {username='slave'} at 127.4.163.67:36411; Asking this server to re-register.
I20260927 13:49:46.880930 5619 ts_tablet_manager.cc:1403] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.007s
I20260927 13:49:46.881389 5156 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:46.882319 5619 raft_consensus.cc:359] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.883517 5769 ts_manager.cc:194] Registered new tserver with Master: 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:46.878850 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e0b4c217ca41b98013155b8d952fe6" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:46.884927 5044 leader_election.cc:343] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:46.885143 5619 raft_consensus.cc:385] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.885118 5044 leader_election.cc:304] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:46.885249 5619 raft_consensus.cc:740] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.885831 5928 raft_consensus.cc:2749] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:46.885798 5619 consensus_queue.cc:260] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.886804 5619 ts_tablet_manager.cc:1434] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:49:46.887451 5619 tablet_bootstrap.cc:492] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.887823 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f3b7b12a18cd41dc98240136b5611848" } modify_external_catalogs: true
I20260927 13:49:46.888036 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f3b7b12a18cd41dc98240136b5611848" } modify_external_catalogs: true
I20260927 13:49:46.886286 5623 log.cc:1199] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/60fae0c413e7439c9ab18b01628d8b28
I20260927 13:49:46.888732 5623 ts_tablet_manager.cc:1950] T 60fae0c413e7439c9ab18b01628d8b28 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:46.890625 5619 tablet_bootstrap.cc:654] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.892119 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 84) took 2225 ms. Trace:
I20260927 13:49:46.894309 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 24bf9abe277040078eb765728e3c52ef (DEFAULT_TABLE table=default.Table_f3b7b12a18cd41dc98240136b5611848 [id=9e5e2ee15095486b815cf581c218a75c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.895036 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bf9abe277040078eb765728e3c52ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.895010 5623 rpcz_store.cc:276] 0927 13:49:44.666600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.666651 (+ 51us) service_pool.cc:224] Handling call
0927 13:49:46.753181 (+2086530us) ts_tablet_manager.cc:1151] Deleting tablet 60fae0c413e7439c9ab18b01628d8b28
0927 13:49:46.753192 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.803916 (+ 50724us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.876180 (+ 72264us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.892027 (+ 15847us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2086297}
I20260927 13:49:46.898777 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 88) took 1842 ms. Trace:
I20260927 13:49:46.899010 5626 tablet_bootstrap.cc:492] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:46.899442 5626 ts_tablet_manager.cc:1403] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.063s user 0.010s sys 0.010s
I20260927 13:49:46.900769 5626 raft_consensus.cc:359] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.900971 5626 raft_consensus.cc:385] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.901070 5626 raft_consensus.cc:740] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.901430 5626 consensus_queue.cc:260] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.901963 5626 ts_tablet_manager.cc:1434] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:46.902634 5626 tablet_bootstrap.cc:492] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:46.904539 5626 tablet_bootstrap.cc:654] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.910523 5953 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: acquiring CA information for follower catalog manager: success
I20260927 13:49:46.899438 5623 rpcz_store.cc:276] 0927 13:49:45.056488 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.057305 (+ 817us) service_pool.cc:224] Handling call
0927 13:49:46.898588 (+1841283us) ts_tablet_manager.cc:1151] Deleting tablet b95399b042654100a609427597d6fe72
0927 13:49:46.898598 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.898720 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1841046}
W20260927 13:49:46.911764 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b95399b042654100a609427597d6fe72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b95399b042654100a609427597d6fe72 already in progress: creating tablet
I20260927 13:49:46.912550 5623 tablet_replica.cc:333] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:46.918321 5623 raft_consensus.cc:2243] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:46.918659 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 24bf9abe277040078eb765728e3c52ef (DEFAULT_TABLE table=default.Table_f3b7b12a18cd41dc98240136b5611848 [id=9e5e2ee15095486b815cf581c218a75c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.919063 5623 raft_consensus.cc:2272] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:46.919181 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bf9abe277040078eb765728e3c52ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.919574 5894 raft_consensus.cc:493] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:46.919750 5894 raft_consensus.cc:515] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.920394 5626 tablet_bootstrap.cc:492] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:46.920493 5894 leader_election.cc:290] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:46.920559 5626 ts_tablet_manager.cc:1403] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
I20260927 13:49:46.921365 5626 raft_consensus.cc:359] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.921520 5628 tablet_bootstrap.cc:492] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:46.921545 5626 raft_consensus.cc:385] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.921610 5626 raft_consensus.cc:740] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.921672 5628 ts_tablet_manager.cc:1403] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.000s
I20260927 13:49:46.921913 5626 consensus_queue.cc:260] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.884543 5431 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:46.922535 5626 ts_tablet_manager.cc:1434] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:46.922459 5628 raft_consensus.cc:359] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.922638 5628 raft_consensus.cc:385] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.922739 5628 raft_consensus.cc:740] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.922982 5628 consensus_queue.cc:260] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.923506 5619 tablet_bootstrap.cc:492] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.923506 5628 ts_tablet_manager.cc:1434] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:46.923638 5619 ts_tablet_manager.cc:1403] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.001s
I20260927 13:49:46.923830 5628 tablet_bootstrap.cc:492] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:46.924394 5619 raft_consensus.cc:359] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.924571 5619 raft_consensus.cc:385] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.924659 5619 raft_consensus.cc:740] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.924885 5619 consensus_queue.cc:260] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.925408 5619 ts_tablet_manager.cc:1434] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:46.925673 5619 tablet_bootstrap.cc:492] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.921118 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b019bbec5d40609dbf1c556cc26a63" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:46.926597 5185 leader_election.cc:343] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:46.929224 5184 leader_election.cc:343] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f9b019bbec5d40609dbf1c556cc26a63
I20260927 13:49:46.929363 5184 leader_election.cc:304] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:46.929752 5891 raft_consensus.cc:2749] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:46.930570 5628 tablet_bootstrap.cc:654] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.931547 5626 tablet_bootstrap.cc:492] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:46.933600 5623 ts_tablet_manager.cc:1916] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:46.934427 5619 tablet_bootstrap.cc:654] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.936839 5626 tablet_bootstrap.cc:654] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.938086 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 8e959f8c6fa74a1bbaf06d91c3e484bc
I20260927 13:49:46.938884 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_97bdee39a93e4f98ae6382e7ab44eda7" } modify_external_catalogs: true
I20260927 13:49:46.939067 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_97bdee39a93e4f98ae6382e7ab44eda7" } modify_external_catalogs: true
I20260927 13:49:46.939544 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:46.941313 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.942322 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:46.943681 5899 tablet.cc:1751] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:46.944177 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a3b1d54e4af0432f9d1ef9879d2ec4e9
I20260927 13:49:46.944976 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a3789979cff14454ae09dd578f449218" } new_table_name: "default.Table_9fd82aceaf6d491facc37c309420e9ed" modify_external_catalogs: true
I20260927 13:49:46.945356 5217 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:46.945578 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:46.947578 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ba2e6accc13649da9059299c5108fdb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:46.948119 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba2e6accc13649da9059299c5108fdb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:46.948228 5903 tablet.cc:1751] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:46.951758 5626 tablet_bootstrap.cc:492] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:46.951894 5626 ts_tablet_manager.cc:1403] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.001s
I20260927 13:49:46.952080 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:46.952592 5626 raft_consensus.cc:359] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.952759 5626 raft_consensus.cc:385] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.952839 5626 raft_consensus.cc:740] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.953064 5626 consensus_queue.cc:260] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.953572 5626 ts_tablet_manager.cc:1434] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:46.954757 5619 tablet_bootstrap.cc:492] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.954977 5619 ts_tablet_manager.cc:1403] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.006s
I20260927 13:49:46.956001 5619 raft_consensus.cc:359] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.956277 5619 raft_consensus.cc:385] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.956403 5619 raft_consensus.cc:740] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.956482 5768 ts_manager.cc:194] Registered new tserver with Master: bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:46.956794 5619 consensus_queue.cc:260] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:46.957288 5619 ts_tablet_manager.cc:1434] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:46.957639 5619 tablet_bootstrap.cc:492] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.957947 5626 tablet_bootstrap.cc:492] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:46.959782 5619 tablet_bootstrap.cc:654] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.961988 5626 tablet_bootstrap.cc:654] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.963629 5953 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260927 13:49:46.963922 4914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.126:42985, user_credentials={real_user=slave}} blocked reactor thread for 115986us
W20260927 13:49:46.968896 5319 consensus_peers.cc:597] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbb2e0a01a9147d597693eab481ca73b. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:46.971484 5628 tablet_bootstrap.cc:492] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:46.971750 5628 ts_tablet_manager.cc:1403] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.000s
I20260927 13:49:46.972149 5623 ts_tablet_manager.cc:1929] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:46.972568 5623 log.cc:1199] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/66524dd4f62f4da4be845d5efefe8db1
I20260927 13:49:46.973254 5628 raft_consensus.cc:359] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.973506 5628 raft_consensus.cc:385] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.973578 5628 raft_consensus.cc:740] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.973862 5628 consensus_queue.cc:260] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.974433 5628 ts_tablet_manager.cc:1434] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:46.976204 5628 tablet_bootstrap.cc:492] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:46.976467 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 129c2f99d5b143b3bd25731cfeb0009e (DEFAULT_TABLE table=default.Table_178d88a5d7a44720b4c553f38d8fd9d7 [id=f78659fb9203483aa74b05e453e1fa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.976876 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 129c2f99d5b143b3bd25731cfeb0009e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.976987 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 24bf9abe277040078eb765728e3c52ef (DEFAULT_TABLE table=default.Table_f3b7b12a18cd41dc98240136b5611848 [id=9e5e2ee15095486b815cf581c218a75c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:46.977386 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bf9abe277040078eb765728e3c52ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:46.979534 5626 tablet_bootstrap.cc:492] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:46.979723 5626 ts_tablet_manager.cc:1403] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.005s
I20260927 13:49:46.980455 5626 raft_consensus.cc:359] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.980638 5626 raft_consensus.cc:385] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.980705 5626 raft_consensus.cc:740] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.981631 5619 tablet_bootstrap.cc:492] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:46.981824 5619 ts_tablet_manager.cc:1403] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.000s
I20260927 13:49:46.982627 5619 raft_consensus.cc:359] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.982884 5619 raft_consensus.cc:385] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:46.983018 5619 raft_consensus.cc:740] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:46.983319 5619 consensus_queue.cc:260] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.987243 5619 ts_tablet_manager.cc:1434] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260927 13:49:46.989351 5619 tablet_bootstrap.cc:492] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:46.989602 5626 consensus_queue.cc:260] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.991591 5619 tablet_bootstrap.cc:654] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.992120 5626 ts_tablet_manager.cc:1434] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260927 13:49:46.993407 5626 tablet_bootstrap.cc:492] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:46.994872 5628 tablet_bootstrap.cc:654] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.995910 5626 tablet_bootstrap.cc:654] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:46.996724 5623 ts_tablet_manager.cc:1950] T 66524dd4f62f4da4be845d5efefe8db1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:47.003938 5619 tablet_bootstrap.cc:492] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:47.004232 5619 ts_tablet_manager.cc:1403] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20260927 13:49:47.005262 5619 raft_consensus.cc:359] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.005403 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet c7670d5f54df49f4a074588ab9269145
I20260927 13:49:47.005553 5619 raft_consensus.cc:385] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.002359 5626 tablet_bootstrap.cc:492] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:47.005932 4924 catalog_manager.cc:6934] ReplaceTablet: tablet c7670d5f54df49f4a074588ab9269145 deleted and replaced by tablet 1245334728994a60ad641c2e90f8d2df
I20260927 13:49:47.005960 5626 ts_tablet_manager.cc:1403] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.006s
I20260927 13:49:47.006626 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 89) took 1832 ms. Trace:
I20260927 13:49:47.006816 5626 raft_consensus.cc:359] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.006778 5623 rpcz_store.cc:276] 0927 13:49:45.174000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.174160 (+ 160us) service_pool.cc:224] Handling call
0927 13:49:46.912461 (+1738301us) ts_tablet_manager.cc:1151] Deleting tablet 66524dd4f62f4da4be845d5efefe8db1
0927 13:49:46.912470 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.940028 (+ 27558us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.972060 (+ 32032us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.006579 (+ 34519us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13613,"tablet-delete.queue_time_us":1738074}
I20260927 13:49:47.007026 5626 raft_consensus.cc:385] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.007124 5626 raft_consensus.cc:740] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.007233 5623 tablet_replica.cc:333] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:47.005630 5619 raft_consensus.cc:740] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.007455 5623 raft_consensus.cc:2243] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.007619 5623 raft_consensus.cc:2272] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.007611 5619 consensus_queue.cc:260] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.007999 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 66524dd4f62f4da4be845d5efefe8db1 (table default.Table_87280d4336274cfe980ae3cd3148a0f6 [id=5b0f9f411500412ca8745dfe54c6cfe5]) successfully deleted
I20260927 13:49:47.008054 5217 tablet_service.cc:1558] Processing DeleteTablet for tablet c7670d5f54df49f4a074588ab9269145 with delete_type TABLET_DATA_DELETED (replaced by tablet 1245334728994a60ad641c2e90f8d2df) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.008296 5619 ts_tablet_manager.cc:1434] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 13:49:47.008667 5619 tablet_bootstrap.cc:492] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:47.008658 5623 ts_tablet_manager.cc:1916] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.009898 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet c7670d5f54df49f4a074588ab9269145 with delete_type TABLET_DATA_DELETED (replaced by tablet 1245334728994a60ad641c2e90f8d2df) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.010653 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet c7670d5f54df49f4a074588ab9269145 with delete_type TABLET_DATA_DELETED (replaced by tablet 1245334728994a60ad641c2e90f8d2df) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.010892 5619 tablet_bootstrap.cc:654] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.011130 5626 consensus_queue.cc:260] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.011813 5626 ts_tablet_manager.cc:1434] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260927 13:49:47.012995 5626 tablet_bootstrap.cc:492] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:47.013957 5628 tablet_bootstrap.cc:492] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:47.014182 5628 ts_tablet_manager.cc:1403] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.002s
I20260927 13:49:47.015049 5628 raft_consensus.cc:359] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.015304 5628 raft_consensus.cc:385] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.015419 5628 raft_consensus.cc:740] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.015673 5628 consensus_queue.cc:260] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:46.992206 5606 ts_tablet_manager.cc:1929] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:47.016253 5628 ts_tablet_manager.cc:1434] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:47.016395 5606 log.cc:1199] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/169e64b6e20544e6ad1bc31c7ec29cf2
I20260927 13:49:47.016593 5628 tablet_bootstrap.cc:492] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:47.017004 5606 ts_tablet_manager.cc:1950] T 169e64b6e20544e6ad1bc31c7ec29cf2 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.018293 5626 tablet_bootstrap.cc:654] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.018553 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 129c2f99d5b143b3bd25731cfeb0009e (DEFAULT_TABLE table=default.Table_178d88a5d7a44720b4c553f38d8fd9d7 [id=f78659fb9203483aa74b05e453e1fa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.020848 5628 tablet_bootstrap.cc:654] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.024442 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_444ab715a6674d1d9088f289fbb20fb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:47.025048 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_444ab715a6674d1d9088f289fbb20fb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:47.025740 4914 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 0018704e08254c2e8d30c7067df4420c (table default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194], current schema version=5) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0018704e08254c2e8d30c7067df4420c consensus state has no leader
I20260927 13:49:47.031837 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 129c2f99d5b143b3bd25731cfeb0009e (DEFAULT_TABLE table=default.Table_178d88a5d7a44720b4c553f38d8fd9d7 [id=f78659fb9203483aa74b05e453e1fa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.032248 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 129c2f99d5b143b3bd25731cfeb0009e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.036082 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 129c2f99d5b143b3bd25731cfeb0009e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.037222 5619 tablet_bootstrap.cc:492] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:47.037431 5628 tablet_bootstrap.cc:492] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:47.037477 5619 ts_tablet_manager.cc:1403] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.004s
I20260927 13:49:47.037606 5628 ts_tablet_manager.cc:1403] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.006s
I20260927 13:49:47.038419 5628 raft_consensus.cc:359] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.038444 5619 raft_consensus.cc:359] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.038638 5628 raft_consensus.cc:385] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.038728 5628 raft_consensus.cc:740] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.038764 5619 raft_consensus.cc:385] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.038952 5619 raft_consensus.cc:740] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.039006 5628 consensus_queue.cc:260] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.039390 5619 consensus_queue.cc:260] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.039564 5628 ts_tablet_manager.cc:1434] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:49:47.042788 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 72) took 2835 ms. Trace:
I20260927 13:49:47.042966 5787 raft_consensus.cc:493] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.043107 5787 raft_consensus.cc:515] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.043793 5787 leader_election.cc:290] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.044883 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7681d137476040788e40dd787ce74ccd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:47.045097 5249 raft_consensus.cc:2468] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:47.045861 5319 leader_election.cc:304] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:47.046470 5628 tablet_bootstrap.cc:492] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:47.046701 5787 raft_consensus.cc:2804] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:47.046820 5787 raft_consensus.cc:493] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:47.046905 5787 raft_consensus.cc:3060] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.048331 5628 tablet_bootstrap.cc:654] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.048686 5623 ts_tablet_manager.cc:1929] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.048811 5623 log.cc:1199] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b4bdd64d67d94276b20ab862dec0d2ee
I20260927 13:49:47.049105 5623 ts_tablet_manager.cc:1950] T b4bdd64d67d94276b20ab862dec0d2ee P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:47.049872 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 90) took 1860 ms. Trace:
I20260927 13:49:47.049963 5623 rpcz_store.cc:276] 0927 13:49:45.189029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.189087 (+ 58us) service_pool.cc:224] Handling call
0927 13:49:47.007143 (+1818056us) ts_tablet_manager.cc:1151] Deleting tablet b4bdd64d67d94276b20ab862dec0d2ee
0927 13:49:47.007155 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.039068 (+ 31913us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.048611 (+ 9543us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.049820 (+ 1209us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1817845}
I20260927 13:49:47.050414 5619 ts_tablet_manager.cc:1434] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260927 13:49:47.050453 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 91) took 1817 ms. Trace:
I20260927 13:49:47.050715 5619 tablet_bootstrap.cc:492] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:47.051002 5626 tablet_bootstrap.cc:492] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:47.050949 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b4bdd64d67d94276b20ab862dec0d2ee (table default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e]) successfully deleted
I20260927 13:49:47.051147 5626 ts_tablet_manager.cc:1403] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.008s
I20260927 13:49:47.051843 5626 raft_consensus.cc:359] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.052054 5626 raft_consensus.cc:385] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.052114 5626 raft_consensus.cc:740] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.052390 5626 consensus_queue.cc:260] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.052884 5626 ts_tablet_manager.cc:1434] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:49:47.053660 5626 tablet_bootstrap.cc:492] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:47.054513 5787 raft_consensus.cc:515] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.055295 5626 tablet_bootstrap.cc:654] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.058651 5787 leader_election.cc:290] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.059772 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7681d137476040788e40dd787ce74ccd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:47.059970 5249 raft_consensus.cc:3060] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.060153 5619 tablet_bootstrap.cc:654] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.067065 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 79514522a9d142438fd6aecc91f0463e (table default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 4 got 0
I20260927 13:49:47.067364 4925 catalog_manager.cc:5838] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65). New cstate: current_term: 1 leader_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:47.071805 5076 tablet_service.cc:1511] Processing CreateTablet for tablet dae5f63f709f455b8eceb44771845a3f (DEFAULT_TABLE table=default.Table_f0f1b6b8e509487daa886cd3ad6645f7 [id=76f4e4598d75471f806ae3f3efa2f104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.072271 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae5f63f709f455b8eceb44771845a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.072445 5249 raft_consensus.cc:2468] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:47.073030 5319 leader_election.cc:304] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:47.073408 5787 raft_consensus.cc:2804] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:47.073686 5787 raft_consensus.cc:697] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:47.073988 5787 consensus_queue.cc:237] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.078951 5916 raft_consensus.cc:493] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.079100 5916 raft_consensus.cc:515] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.079741 5916 leader_election.cc:290] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:47.081300 5319 leader_election.cc:343] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 9b6ff9ddb6664a5a867ac0f64ac1e9a2
I20260927 13:49:47.081544 5626 tablet_bootstrap.cc:492] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:47.081612 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6ff9ddb6664a5a867ac0f64ac1e9a2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:47.081964 5249 raft_consensus.cc:2468] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:47.082428 5319 leader_election.cc:304] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:47.082865 5916 raft_consensus.cc:2804] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:47.082974 5916 raft_consensus.cc:493] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:47.083062 5916 raft_consensus.cc:3060] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.084972 5382 raft_consensus.cc:3060] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.086786 5916 raft_consensus.cc:515] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.087029 5109 raft_consensus.cc:1275] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Refusing update from remote peer 79c1646c9659434b9a659382d2eb1d8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:47.087687 5727 consensus_queue.cc:1048] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:49:47.090356 5319 leader_election.cc:343] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 9b6ff9ddb6664a5a867ac0f64ac1e9a2
I20260927 13:49:47.090377 5382 raft_consensus.cc:1275] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Refusing update from remote peer 79c1646c9659434b9a659382d2eb1d8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:47.091049 5727 consensus_queue.cc:1048] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:47.092468 5916 leader_election.cc:290] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.093129 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6ff9ddb6664a5a867ac0f64ac1e9a2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:47.093382 5249 raft_consensus.cc:3060] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.096657 5249 raft_consensus.cc:2468] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:47.097572 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7681d137476040788e40dd787ce74ccd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:47.098268 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7681d137476040788e40dd787ce74ccd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
W20260927 13:49:47.098322 5319 leader_election.cc:343] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: Tablet not RUNNING: STOPPED
W20260927 13:49:47.098839 5319 leader_election.cc:343] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: Tablet not RUNNING: STOPPED
I20260927 13:49:47.101341 5319 leader_election.cc:304] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:47.101684 5916 raft_consensus.cc:2804] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:47.101963 5916 raft_consensus.cc:697] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:47.102387 5916 consensus_queue.cc:237] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.102849 5352 tablet_service.cc:1511] Processing CreateTablet for tablet dae5f63f709f455b8eceb44771845a3f (DEFAULT_TABLE table=default.Table_f0f1b6b8e509487daa886cd3ad6645f7 [id=76f4e4598d75471f806ae3f3efa2f104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.081755 5626 ts_tablet_manager.cc:1403] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.001s
I20260927 13:49:47.103330 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae5f63f709f455b8eceb44771845a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.103976 5626 raft_consensus.cc:359] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.104151 5626 raft_consensus.cc:385] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.104241 5626 raft_consensus.cc:740] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.050549 5623 rpcz_store.cc:276] 0927 13:49:45.232908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.232959 (+ 51us) service_pool.cc:224] Handling call
0927 13:49:47.050280 (+1817321us) ts_tablet_manager.cc:1151] Deleting tablet 2801473216a3475384d1494892b8df7b
0927 13:49:47.050291 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.050389 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1817109}
W20260927 13:49:47.105365 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2801473216a3475384d1494892b8df7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2801473216a3475384d1494892b8df7b already in progress: creating tablet
I20260927 13:49:47.105885 5623 tablet_replica.cc:333] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:47.106091 5623 raft_consensus.cc:2243] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:47.106446 5623 raft_consensus.cc:2272] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.107007 5623 ts_tablet_manager.cc:1916] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.110750 5626 consensus_queue.cc:260] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.111292 5626 ts_tablet_manager.cc:1434] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260927 13:49:47.111565 5626 tablet_bootstrap.cc:492] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:47.112234 5901 raft_consensus.cc:493] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.112409 5901 raft_consensus.cc:515] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.113235 5901 leader_election.cc:290] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.042966 5606 rpcz_store.cc:276] 0927 13:49:44.207232 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.207625 (+ 393us) service_pool.cc:224] Handling call
0927 13:49:46.663820 (+2456195us) ts_tablet_manager.cc:1151] Deleting tablet 169e64b6e20544e6ad1bc31c7ec29cf2
0927 13:49:46.663832 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:46.822441 (+158609us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:46.992142 (+169701us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.042741 (+ 50599us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2441629}
I20260927 13:49:47.114656 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 169e64b6e20544e6ad1bc31c7ec29cf2 (table default.Table_a23fe407dd1047ca98d605e2cee52fdc [id=4f5c882c6f8449cf9daacd66a354bc9f]) successfully deleted
I20260927 13:49:47.115042 5606 tablet_replica.cc:333] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.115242 5606 raft_consensus.cc:2243] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.115435 5606 raft_consensus.cc:2272] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:47.120085 5319 leader_election.cc:343] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 399d6411d8ad4354b3c0f8f4d78779a9
I20260927 13:49:47.120270 5606 ts_tablet_manager.cc:1916] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:47.120730 5319 leader_election.cc:343] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 399d6411d8ad4354b3c0f8f4d78779a9
I20260927 13:49:47.121728 5319 leader_election.cc:304] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:47.122318 5899 tablet.cc:1751] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:47.122195 5916 raft_consensus.cc:2749] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.131165 5089 tablet_service.cc:1511] Processing CreateTablet for tablet b64d3aa052bf4c48b3802f6006cce9c9 (DEFAULT_TABLE table=default.Table_393b924b35284f7ab739c7df3b388bf3 [id=ded13e9c993046cd891db043b1ff6a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.131829 5087 tablet_service.cc:1511] Processing CreateTablet for tablet b3a305ad4c704bbd8d522515786100c0 (DEFAULT_TABLE table=default.Table_53d78eb35ded40078e11e532d5ed0d25 [id=33df36c4049b4b0a97fc6541b66a362b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.131940 5352 tablet_service.cc:1511] Processing CreateTablet for tablet b64d3aa052bf4c48b3802f6006cce9c9 (DEFAULT_TABLE table=default.Table_393b924b35284f7ab739c7df3b388bf3 [id=ded13e9c993046cd891db043b1ff6a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.132011 5229 tablet_service.cc:1511] Processing CreateTablet for tablet b64d3aa052bf4c48b3802f6006cce9c9 (DEFAULT_TABLE table=default.Table_393b924b35284f7ab739c7df3b388bf3 [id=ded13e9c993046cd891db043b1ff6a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.132360 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64d3aa052bf4c48b3802f6006cce9c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.132354 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64d3aa052bf4c48b3802f6006cce9c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.138863 5217 tablet_service.cc:1511] Processing CreateTablet for tablet dae5f63f709f455b8eceb44771845a3f (DEFAULT_TABLE table=default.Table_f0f1b6b8e509487daa886cd3ad6645f7 [id=76f4e4598d75471f806ae3f3efa2f104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.139314 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae5f63f709f455b8eceb44771845a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.142375 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_fc8409c9830e42a48adddfcc3ca09d5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:47.142994 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc8409c9830e42a48adddfcc3ca09d5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.160641 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 24bf9abe277040078eb765728e3c52ef
I20260927 13:49:47.162036 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bf9abe277040078eb765728e3c52ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.163686 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bf9abe277040078eb765728e3c52ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.164412 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bf9abe277040078eb765728e3c52ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.167373 5994 tablet.cc:1751] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:47.169374 5894 raft_consensus.cc:493] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.169534 5894 raft_consensus.cc:515] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.170226 5894 leader_election.cc:290] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:47.171006 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb5fdbfebd5401e92186997f9a30d36" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:47.171209 5382 raft_consensus.cc:2468] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
W20260927 13:49:47.171460 5184 leader_election.cc:343] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 6bb5fdbfebd5401e92186997f9a30d36
I20260927 13:49:47.172169 5185 leader_election.cc:304] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:47.172621 5894 raft_consensus.cc:2804] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:47.172734 5894 raft_consensus.cc:493] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:47.172808 5894 raft_consensus.cc:3060] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.177475 5894 raft_consensus.cc:515] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.178268 5606 ts_tablet_manager.cc:1929] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.179487 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb5fdbfebd5401e92186997f9a30d36" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:47.179749 5903 tablet.cc:1751] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:47.180024 5606 log.cc:1199] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/8b8b80eb00244f7cbcc260af06c16a52
I20260927 13:49:47.180395 5894 leader_election.cc:290] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:47.180521 5184 leader_election.cc:343] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 6bb5fdbfebd5401e92186997f9a30d36
I20260927 13:49:47.180034 5382 raft_consensus.cc:3060] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.182009 5606 ts_tablet_manager.cc:1950] T 8b8b80eb00244f7cbcc260af06c16a52 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.188077 5351 tablet_service.cc:1511] Processing CreateTablet for tablet b3a305ad4c704bbd8d522515786100c0 (DEFAULT_TABLE table=default.Table_53d78eb35ded40078e11e532d5ed0d25 [id=33df36c4049b4b0a97fc6541b66a362b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.188583 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a305ad4c704bbd8d522515786100c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.190233 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 71) took 2993 ms. Trace:
I20260927 13:49:47.190768 5626 tablet_bootstrap.cc:654] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.190536 5606 rpcz_store.cc:276] 0927 13:49:44.197213 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.198400 (+ 1187us) service_pool.cc:224] Handling call
0927 13:49:47.114945 (+2916545us) ts_tablet_manager.cc:1151] Deleting tablet 8b8b80eb00244f7cbcc260af06c16a52
0927 13:49:47.114958 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.150466 (+ 35508us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.178179 (+ 27713us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.190186 (+ 12007us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2892140}
I20260927 13:49:47.190707 5217 tablet_service.cc:1511] Processing CreateTablet for tablet b3a305ad4c704bbd8d522515786100c0 (DEFAULT_TABLE table=default.Table_53d78eb35ded40078e11e532d5ed0d25 [id=33df36c4049b4b0a97fc6541b66a362b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.191103 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a305ad4c704bbd8d522515786100c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.191430 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 8b8b80eb00244f7cbcc260af06c16a52 (table default.Table_c06fd2ea93254d09a8daffb63dd4a4e5 [id=5562b818949449e8ab5c21843d710d6d]) successfully deleted
I20260927 13:49:47.193401 5619 tablet_bootstrap.cc:492] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:47.193601 5619 ts_tablet_manager.cc:1403] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.143s user 0.008s sys 0.007s
I20260927 13:49:47.194774 5619 raft_consensus.cc:359] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.195108 5619 raft_consensus.cc:385] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.195266 5619 raft_consensus.cc:740] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.195706 5619 consensus_queue.cc:260] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.196044 5382 raft_consensus.cc:2468] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:47.196440 5619 ts_tablet_manager.cc:1434] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:47.196557 5606 tablet_replica.cc:333] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.196689 5185 leader_election.cc:304] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:47.197623 5894 raft_consensus.cc:2804] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:47.197818 5894 raft_consensus.cc:697] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:47.198149 5894 consensus_queue.cc:237] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.198909 5619 tablet_bootstrap.cc:492] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:47.200412 5619 tablet_bootstrap.cc:654] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.201424 5606 raft_consensus.cc:2243] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.201584 5606 raft_consensus.cc:2272] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.206494 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 80b1970a344045389709260c850adc07 (DEFAULT_TABLE table=default.Table_00fb64d2378d4fecbcc59cd9c70072aa [id=5900f338a23b46e8a487ec9cfa08b8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.206928 5606 ts_tablet_manager.cc:1916] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.207237 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 80b1970a344045389709260c850adc07 (DEFAULT_TABLE table=default.Table_00fb64d2378d4fecbcc59cd9c70072aa [id=5900f338a23b46e8a487ec9cfa08b8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.207681 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b1970a344045389709260c850adc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.207955 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 74226753751a49fa8ce98eafb2ca1250 (DEFAULT_TABLE table=default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.208329 5078 tablet_service.cc:1511] Processing CreateTablet for tablet 74226753751a49fa8ce98eafb2ca1250 (DEFAULT_TABLE table=default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.209365 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc (DEFAULT_TABLE table=default.Table_3ab0995080774a95967ee1d1ce7c9fdf [id=4dfd5d250a6f4ccd87ae40d6b0061394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.209508 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc (DEFAULT_TABLE table=default.Table_3ab0995080774a95967ee1d1ce7c9fdf [id=4dfd5d250a6f4ccd87ae40d6b0061394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.209996 5365 tablet_service.cc:1511] Processing CreateTablet for tablet cc6af9b33f0c464683e40adc28037bc8 (DEFAULT_TABLE table=default.Table_5344269f62464fe7b79f4ec748b4abe7 [id=3900fb9af5fa424389f9826c320224ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.210596 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 80b1970a344045389709260c850adc07 (DEFAULT_TABLE table=default.Table_00fb64d2378d4fecbcc59cd9c70072aa [id=5900f338a23b46e8a487ec9cfa08b8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.210744 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 74226753751a49fa8ce98eafb2ca1250 (DEFAULT_TABLE table=default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.211118 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74226753751a49fa8ce98eafb2ca1250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.214495 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc (DEFAULT_TABLE table=default.Table_3ab0995080774a95967ee1d1ce7c9fdf [id=4dfd5d250a6f4ccd87ae40d6b0061394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.214933 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.215023 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.215235 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74226753751a49fa8ce98eafb2ca1250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.215560 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6af9b33f0c464683e40adc28037bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.219579 5083 tablet_service.cc:1511] Processing CreateTablet for tablet cc6af9b33f0c464683e40adc28037bc8 (DEFAULT_TABLE table=default.Table_5344269f62464fe7b79f4ec748b4abe7 [id=3900fb9af5fa424389f9826c320224ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.239081 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b1970a344045389709260c850adc07. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:47.249713 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72711f14f26a479c9699b172b41b1db0 consensus state has no leader
I20260927 13:49:47.250496 5606 ts_tablet_manager.cc:1929] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.250634 5606 log.cc:1199] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/11d303db711543e5ac23bfcd2279c993
I20260927 13:49:47.256870 5606 ts_tablet_manager.cc:1950] T 11d303db711543e5ac23bfcd2279c993 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.257854 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64d3aa052bf4c48b3802f6006cce9c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.258198 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.258469 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b1970a344045389709260c850adc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.258733 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6af9b33f0c464683e40adc28037bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.261324 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 69) took 3079 ms. Trace:
I20260927 13:49:47.261449 5606 rpcz_store.cc:276] 0927 13:49:44.178401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.210383 (+ 31982us) service_pool.cc:224] Handling call
0927 13:49:47.192145 (+2981762us) ts_tablet_manager.cc:1151] Deleting tablet 11d303db711543e5ac23bfcd2279c993
0927 13:49:47.192160 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.218943 (+ 26783us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.250417 (+ 31474us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.257892 (+ 7475us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2890105}
I20260927 13:49:47.262426 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74226753751a49fa8ce98eafb2ca1250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.262671 5606 tablet_replica.cc:333] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.262881 5606 raft_consensus.cc:2243] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.263051 5606 raft_consensus.cc:2272] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.266333 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a305ad4c704bbd8d522515786100c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.267652 5891 raft_consensus.cc:493] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.267858 5891 raft_consensus.cc:515] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.268651 5891 leader_election.cc:290] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:47.269469 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c46d0e50a44232a82d00c88d9f63b5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:47.270082 5185 leader_election.cc:343] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.271476 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c46d0e50a44232a82d00c88d9f63b5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:47.271723 5109 raft_consensus.cc:2468] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:47.272212 5184 leader_election.cc:304] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.272564 5891 raft_consensus.cc:2804] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:47.272670 5891 raft_consensus.cc:493] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:47.272780 5891 raft_consensus.cc:3060] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.273326 5928 raft_consensus.cc:493] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.273470 5928 raft_consensus.cc:515] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.274199 5928 leader_election.cc:290] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.274789 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff5992b27f049f5890e65d5a8dcc3cf" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:47.275328 5044 leader_election.cc:343] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.275426 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff5992b27f049f5890e65d5a8dcc3cf" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:47.275946 5045 leader_election.cc:343] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.276068 5045 leader_election.cc:304] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.276525 5928 raft_consensus.cc:2749] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.277771 5891 raft_consensus.cc:515] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.278985 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c46d0e50a44232a82d00c88d9f63b5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:47.279017 5913 mvcc.cc:204] Tried to move back new op lower bound from 7333957573070663680 to 7333957560766758912. Current Snapshot: MvccSnapshot[applied={T|T < 7333957573070663680 or (T in {7333957573070663680})}]
I20260927 13:49:47.279179 5109 raft_consensus.cc:3060] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.279624 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c46d0e50a44232a82d00c88d9f63b5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
W20260927 13:49:47.280184 5185 leader_election.cc:343] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.282143 5625 ts_tablet_manager.cc:1929] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.282207 5891 leader_election.cc:290] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:47.282308 5625 log.cc:1199] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/7681d137476040788e40dd787ce74ccd
I20260927 13:49:47.282739 5625 ts_tablet_manager.cc:1950] T 7681d137476040788e40dd787ce74ccd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:47.283821 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 7681d137476040788e40dd787ce74ccd (table default.Table_f91dab3c58974becbe03c7d55f1a01d4 [id=a22a9a93ae2543e583d24dd648813233]) successfully deleted
W20260927 13:49:47.284591 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc because the tablet was not found. No further retry: Not found: Tablet not found: 8e959f8c6fa74a1bbaf06d91c3e484bc
I20260927 13:49:47.285027 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (table default.Table_183e16824f194b1caa9327d0973f607b [id=c16d7a8a2339458b8c973cedf99c32bf]). Expected version 3 got 2
W20260927 13:49:47.285239 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 already in progress: creating tablet
W20260927 13:49:47.285882 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet c7670d5f54df49f4a074588ab9269145 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7670d5f54df49f4a074588ab9269145 already in progress: creating tablet
W20260927 13:49:47.286650 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 24bf9abe277040078eb765728e3c52ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24bf9abe277040078eb765728e3c52ef already in progress: creating tablet
I20260927 13:49:47.288337 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_060df9c137224b90b29c16e43fce88ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:47.288882 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_060df9c137224b90b29c16e43fce88ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.290324 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_20d4690ba5644595ab69e0049b196531" } new_table_name: "default.Table_86f890e6a07c4dbda356960e42168324" modify_external_catalogs: true
I20260927 13:49:47.290740 5916 raft_consensus.cc:493] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.290908 5916 raft_consensus.cc:515] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.291121 5606 ts_tablet_manager.cc:1916] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.291553 5916 leader_election.cc:290] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.291713 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_10932d72525a4a12a6543c89e1a3b19d" } new_table_name: "default.Table_62cceedd20a943deabde3440a6a59adb" modify_external_catalogs: true
W20260927 13:49:47.293547 5319 leader_election.cc:343] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: e56df07d0a524e5184bdc7fc8d95857c
I20260927 13:49:47.293893 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56df07d0a524e5184bdc7fc8d95857c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:47.294512 5319 leader_election.cc:304] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:47.294901 5916 raft_consensus.cc:2749] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.297497 5623 ts_tablet_manager.cc:1929] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:47.297533 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e680c915b7b546a7927c1795fa7f3ef4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:47.297683 5623 log.cc:1199] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/32fa23c312544fac8ef485a35e5ab972
I20260927 13:49:47.297814 5619 tablet_bootstrap.cc:492] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:47.297966 5619 ts_tablet_manager.cc:1403] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.099s user 0.004s sys 0.015s
W20260927 13:49:47.298081 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e680c915b7b546a7927c1795fa7f3ef4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.298157 5623 ts_tablet_manager.cc:1950] T 32fa23c312544fac8ef485a35e5ab972 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:47.298718 5619 raft_consensus.cc:359] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.298883 5619 raft_consensus.cc:385] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.298929 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 92) took 2061 ms. Trace:
I20260927 13:49:47.298959 5619 raft_consensus.cc:740] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.299036 5623 rpcz_store.cc:276] 0927 13:49:45.236990 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.237249 (+ 259us) service_pool.cc:224] Handling call
0927 13:49:47.105803 (+1868554us) ts_tablet_manager.cc:1151] Deleting tablet 32fa23c312544fac8ef485a35e5ab972
0927 13:49:47.105815 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.193975 (+ 88160us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.297388 (+103413us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.298894 (+ 1506us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1868338}
I20260927 13:49:47.299542 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 32fa23c312544fac8ef485a35e5ab972 (table default.Table_ae1f534af970471bac44446c873faddb [id=a51ccdf3dce04c65b40dd44a1f8c16f1]) successfully deleted
I20260927 13:49:47.299953 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 96) took 1993 ms. Trace:
I20260927 13:49:47.300550 5619 consensus_queue.cc:260] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.307011 5619 ts_tablet_manager.cc:1434] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260927 13:49:47.307055 5606 ts_tablet_manager.cc:1929] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.309863 5606 log.cc:1199] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/399d6411d8ad4354b3c0f8f4d78779a9
I20260927 13:49:47.310453 5606 ts_tablet_manager.cc:1950] T 399d6411d8ad4354b3c0f8f4d78779a9 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.311260 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 80) took 2848 ms. Trace:
I20260927 13:49:47.311444 5606 rpcz_store.cc:276] 0927 13:49:44.462475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.472770 (+ 10295us) service_pool.cc:224] Handling call
0927 13:49:47.262581 (+2789811us) ts_tablet_manager.cc:1151] Deleting tablet 399d6411d8ad4354b3c0f8f4d78779a9
0927 13:49:47.262593 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.300641 (+ 38048us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.306962 (+ 6321us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.311227 (+ 4265us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2789429}
I20260927 13:49:47.311978 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 399d6411d8ad4354b3c0f8f4d78779a9 (table default.Table_ba82da1367c447beadfb286a237a81de [id=3557e871819045648d0e38a96c9d6b52]) successfully deleted
I20260927 13:49:47.312441 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 82) took 2834 ms. Trace:
I20260927 13:49:47.312619 5606 rpcz_store.cc:276] 0927 13:49:44.478445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.491290 (+ 12845us) service_pool.cc:224] Handling call
0927 13:49:47.312291 (+2821001us) ts_tablet_manager.cc:1151] Deleting tablet 7dc612cbcd5d4755a188408f2a036f34
0927 13:49:47.312299 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.312402 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2810200}
I20260927 13:49:47.313871 5619 tablet_bootstrap.cc:492] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:47.317354 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 7dc612cbcd5d4755a188408f2a036f34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dc612cbcd5d4755a188408f2a036f34 already in progress: creating tablet
I20260927 13:49:47.317768 5606 tablet_replica.cc:333] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.318079 5606 raft_consensus.cc:2243] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.318397 5606 raft_consensus.cc:2272] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.319308 5619 tablet_bootstrap.cc:654] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.321316 5109 raft_consensus.cc:2468] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:47.319533 5606 ts_tablet_manager.cc:1916] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.323894 5928 raft_consensus.cc:493] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.324045 5928 raft_consensus.cc:515] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.324750 5928 leader_election.cc:290] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.326257 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c1b74943b9479e8b37969b2933c5a4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:47.326912 5045 leader_election.cc:343] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.329303 5628 tablet_bootstrap.cc:492] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:47.329535 5628 ts_tablet_manager.cc:1403] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.283s user 0.053s sys 0.078s
I20260927 13:49:47.330410 5628 raft_consensus.cc:359] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.330549 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 4d35148d80b44fca9b39a4625d3e61c1 (DEFAULT_TABLE table=default.Table_7dacecf959774572955f40d737467ebd [id=2ac4a43bb18f4487b18fd38762bee4d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.330672 5628 raft_consensus.cc:385] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.330778 5628 raft_consensus.cc:740] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.330950 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d35148d80b44fca9b39a4625d3e61c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.330981 5078 tablet_service.cc:1511] Processing CreateTablet for tablet 4d35148d80b44fca9b39a4625d3e61c1 (DEFAULT_TABLE table=default.Table_7dacecf959774572955f40d737467ebd [id=2ac4a43bb18f4487b18fd38762bee4d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.331074 5628 consensus_queue.cc:260] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.331327 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d35148d80b44fca9b39a4625d3e61c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.332845 5628 ts_tablet_manager.cc:1434] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:47.333127 5628 tablet_bootstrap.cc:492] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:47.336225 5628 tablet_bootstrap.cc:654] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.321997 5184 leader_election.cc:304] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.337637 5894 raft_consensus.cc:2804] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:47.337818 5894 raft_consensus.cc:697] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:47.338079 5894 consensus_queue.cc:237] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.325489 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c1b74943b9479e8b37969b2933c5a4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:47.329715 5213 tablet_service.cc:1511] Processing CreateTablet for tablet cc6af9b33f0c464683e40adc28037bc8 (DEFAULT_TABLE table=default.Table_5344269f62464fe7b79f4ec748b4abe7 [id=3900fb9af5fa424389f9826c320224ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.332463 5626 tablet_bootstrap.cc:492] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:47.339630 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6af9b33f0c464683e40adc28037bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.339771 5626 ts_tablet_manager.cc:1403] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.228s user 0.006s sys 0.000s
I20260927 13:49:47.340675 5626 raft_consensus.cc:359] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.340875 5626 raft_consensus.cc:385] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.340957 5626 raft_consensus.cc:740] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.341228 5626 consensus_queue.cc:260] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.341727 5626 ts_tablet_manager.cc:1434] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:47.342032 5626 tablet_bootstrap.cc:492] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:47.344534 5623 rpcz_store.cc:276] 0927 13:49:45.306620 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.306839 (+ 219us) service_pool.cc:224] Handling call
0927 13:49:47.299805 (+1992966us) ts_tablet_manager.cc:1151] Deleting tablet dce1bbbe9dbb443c9f0c001107ffebdf
0927 13:49:47.299816 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.299919 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1992340}
W20260927 13:49:47.345185 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet dce1bbbe9dbb443c9f0c001107ffebdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dce1bbbe9dbb443c9f0c001107ffebdf already in progress: creating tablet
I20260927 13:49:47.345690 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 108) took 1509 ms. Trace:
I20260927 13:49:47.345921 5623 rpcz_store.cc:276] 0927 13:49:45.836306 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.836373 (+ 67us) service_pool.cc:224] Handling call
0927 13:49:47.345531 (+1509158us) ts_tablet_manager.cc:1151] Deleting tablet 77f549f487ea4dbb8c7fceee6f8a6db0
0927 13:49:47.345541 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.345656 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1508925}
W20260927 13:49:47.346513 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77f549f487ea4dbb8c7fceee6f8a6db0 already in progress: creating tablet
I20260927 13:49:47.346952 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 106) took 1596 ms. Trace:
I20260927 13:49:47.347100 5623 rpcz_store.cc:276] 0927 13:49:45.750156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.750318 (+ 162us) service_pool.cc:224] Handling call
0927 13:49:47.346817 (+1596499us) ts_tablet_manager.cc:1151] Deleting tablet df271399b2c84653ac4a5b74efdc0197
0927 13:49:47.346827 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.346922 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1488384}
I20260927 13:49:47.347689 5606 ts_tablet_manager.cc:1929] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:47.348166 5606 log.cc:1199] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/a1489f766164444b9aaa7b58e81a72d9
I20260927 13:49:47.348691 5606 ts_tablet_manager.cc:1950] T a1489f766164444b9aaa7b58e81a72d9 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.349686 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 83) took 2868 ms. Trace:
I20260927 13:49:47.349857 5606 rpcz_store.cc:276] 0927 13:49:44.481597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.495242 (+ 13645us) service_pool.cc:224] Handling call
0927 13:49:47.317698 (+2822456us) ts_tablet_manager.cc:1151] Deleting tablet a1489f766164444b9aaa7b58e81a72d9
0927 13:49:47.317709 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.325300 (+ 7591us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.347600 (+ 22300us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.349631 (+ 2031us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2815470}
I20260927 13:49:47.350330 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 70d1197bee2d477ab77d15cbd4907595
I20260927 13:49:47.350508 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet a1489f766164444b9aaa7b58e81a72d9 (table default.Table_055f1a3f79864929982c584ed6dec1e9 [id=2a104f24fe5e4ad8bfb52eb2dbdf9a8a]) successfully deleted
I20260927 13:49:47.350821 4930 catalog_manager.cc:6934] ReplaceTablet: tablet 70d1197bee2d477ab77d15cbd4907595 deleted and replaced by tablet 931a48792f4c4525bd563a4dd1062e35
I20260927 13:49:47.351498 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 70d1197bee2d477ab77d15cbd4907595 with delete_type TABLET_DATA_DELETED (replaced by tablet 931a48792f4c4525bd563a4dd1062e35) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.352313 5352 tablet_service.cc:1511] Processing CreateTablet for tablet a6af740383384609a354d7f0fae2cd70 (DEFAULT_TABLE table=default.Table_de419f4cfd244caeaa7707f22194c5bd [id=1cceb2a28eac4398a1e8d1ddb8afd21b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.352878 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6af740383384609a354d7f0fae2cd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.353380 4929 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c79b1f2962f44a23916bbfe4cf55a4bc (table default.Table_847c101270804f9f856b7e564cc9fbbe [id=d140ef61df2143d8bd6f44d8f92153c9]). Expected version 1 got 0
I20260927 13:49:47.354281 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 4295710c33714360b3691f48f47f4293
I20260927 13:49:47.354307 5606 tablet_replica.cc:333] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.354591 5606 raft_consensus.cc:2243] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:47.354918 4928 master_service.cc:960] ReplaceTablet: received request to replace tablet dff5992b27f049f5890e65d5a8dcc3cf from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:47.355005 5606 raft_consensus.cc:2272] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.355232 4926 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_d1cf0c8faaa24af2b046a519baa60406 [id=59df0a1ee3ea43e8ac991b38717c1549] alter complete (version 4)
I20260927 13:49:47.355626 5606 ts_tablet_manager.cc:1916] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:47.357003 4926 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.66:59195 (request call id 44) took 807 ms (client timeout 1000 ms). Trace:
I20260927 13:49:47.361900 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 4295710c33714360b3691f48f47f4293 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.362269 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet a61eedf06dab4096a397da8ce98a07da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.349176 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 4d35148d80b44fca9b39a4625d3e61c1 (DEFAULT_TABLE table=default.Table_7dacecf959774572955f40d737467ebd [id=2ac4a43bb18f4487b18fd38762bee4d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.362643 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d35148d80b44fca9b39a4625d3e61c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.363503 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet a1489f766164444b9aaa7b58e81a72d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.363607 5619 tablet_bootstrap.cc:492] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:47.351070 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 70d1197bee2d477ab77d15cbd4907595 with delete_type TABLET_DATA_DELETED (replaced by tablet 931a48792f4c4525bd563a4dd1062e35) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.351976 5225 tablet_service.cc:1511] Processing CreateTablet for tablet a6af740383384609a354d7f0fae2cd70 (DEFAULT_TABLE table=default.Table_de419f4cfd244caeaa7707f22194c5bd [id=1cceb2a28eac4398a1e8d1ddb8afd21b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.367100 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6af740383384609a354d7f0fae2cd70. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:47.369801 4921 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.67:52291 (request call id 53) took 849 ms (client timeout 1000 ms). Trace:
I20260927 13:49:47.357745 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 66524dd4f62f4da4be845d5efefe8db1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.358127 5220 tablet_service.cc:1558] Processing DeleteTablet for tablet 4295710c33714360b3691f48f47f4293 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.358321 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e6721aa2fa0437eae7ca052c19f0f2e with delete_type TABLET_DATA_DELETED (replaced by tablet 7dc612cbcd5d4755a188408f2a036f34) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.358462 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 399d6411d8ad4354b3c0f8f4d78779a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.358647 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b8b80eb00244f7cbcc260af06c16a52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.358812 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 32fa23c312544fac8ef485a35e5ab972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:47.372539 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f5dfa3e80454463908df19a49454764 consensus state has no leader
W20260927 13:49:47.369910 4921 rpcz_store.cc:269] 0927 13:49:46.510572 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.540598 (+ 30026us) service_pool.cc:224] Handling call
0927 13:49:47.359507 (+818909us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":8}
W20260927 13:49:47.375452 4925 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.65:47495 (request call id 51) took 1166 ms (client timeout 1000 ms). Trace:
W20260927 13:49:47.375552 4925 rpcz_store.cc:269] 0927 13:49:46.199364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.338481 (+139117us) service_pool.cc:224] Handling call
0927 13:49:47.365513 (+1027032us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:49:47.237753 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:47.237857 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:47.237861 (+ 4us) write_op.cc:435] Acquired schema lock
0927 13:49:47.237863 (+ 2us) tablet.cc:662] Decoding operations
0927 13:49:47.237933 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:47.237941 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:47.237945 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:49:47.237991 (+ 46us) tablet.cc:701] Row locks acquired
0927 13:49:47.237993 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:49:47.238017 (+ 24us) write_op.cc:270] Start()
0927 13:49:47.238040 (+ 23us) write_op.cc:276] Timestamp: P: 1790516987237996 usec, L: 0
0927 13:49:47.238043 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:49:47.238235 (+ 192us) log.cc:844] Serialized 530 byte log entry
0927 13:49:47.283021 (+ 44786us) op_driver.cc:464] REPLICATION: finished
0927 13:49:47.283552 (+ 531us) write_op.cc:301] APPLY: starting
0927 13:49:47.283565 (+ 13us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:47.283596 (+ 31us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:47.283636 (+ 40us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:47.283676 (+ 40us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:47.283706 (+ 30us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:47.283712 (+ 6us) write_op.cc:312] APPLY: finished
0927 13:49:47.283766 (+ 54us) log.cc:844] Serialized 23 byte log entry
0927 13:49:47.283811 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:47.283823 (+ 12us) write_op.cc:454] Released schema lock
0927 13:49:47.283827 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":6587,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":499,"apply.run_cpu_time_us":330,"apply.run_wall_time_us":331,"num_ops":1,"prepare.queue_time_us":169544,"prepare.run_cpu_time_us":562,"prepare.run_wall_time_us":562,"raft.queue_time_us":668,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":44961}]]}
W20260927 13:49:47.357167 4926 rpcz_store.cc:269] 0927 13:49:46.549332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.550188 (+ 856us) service_pool.cc:224] Handling call
0927 13:49:47.356957 (+806769us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:49:47.023067 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:47.023182 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:47.023188 (+ 6us) write_op.cc:435] Acquired schema lock
0927 13:49:47.023189 (+ 1us) tablet.cc:662] Decoding operations
0927 13:49:47.023489 (+ 300us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:47.023502 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:47.023507 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:49:47.023569 (+ 62us) tablet.cc:701] Row locks acquired
0927 13:49:47.023571 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:49:47.023612 (+ 41us) write_op.cc:270] Start()
0927 13:49:47.023645 (+ 33us) write_op.cc:276] Timestamp: P: 1790516987023558 usec, L: 0
0927 13:49:47.023648 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:49:47.058458 (+ 34810us) log.cc:844] Serialized 530 byte log entry
0927 13:49:47.059475 (+ 1017us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x616000051a54. stack: 00007fa4fa3bd5c6 00007fa4fa3bd380 00007fa4f93c534d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fa5064871b2 00007fa5078a4fa5 00007fa5078a3ac9 00007fa5078abef0 00007fa5078abcfd 0000000000aaef9c 00007fa4fa403aef 00007fa4fa406deb 00007fa4fa406c68 0000000000aaef9c
0927 13:49:47.065349 (+ 5874us) op_driver.cc:464] REPLICATION: finished
0927 13:49:47.065438 (+ 89us) write_op.cc:301] APPLY: starting
0927 13:49:47.065454 (+ 16us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:47.065487 (+ 33us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:47.065490 (+ 3us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:47.065539 (+ 49us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:47.065575 (+ 36us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:47.065587 (+ 12us) write_op.cc:312] APPLY: finished
0927 13:49:47.065655 (+ 68us) log.cc:844] Serialized 23 byte log entry
0927 13:49:47.065714 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:47.065731 (+ 17us) write_op.cc:454] Released schema lock
0927 13:49:47.065737 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:47.118395 (+ 52658us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:47.118404 (+ 9us) write_op.cc:454] Released schema lock
Related trace 'op':
0927 13:49:47.237238 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:47.237322 (+ 84us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:47.237326 (+ 4us) write_op.cc:435] Acquired schema lock
0927 13:49:47.237328 (+ 2us) tablet.cc:662] Decoding operations
0927 13:49:47.237405 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:47.237412 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:47.237416 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:49:47.237458 (+ 42us) tablet.cc:701] Row locks acquired
0927 13:49:47.237460 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:49:47.237486 (+ 26us) write_op.cc:270] Start()
0927 13:49:47.237508 (+ 22us) write_op.cc:276] Timestamp: P: 1790516987237464 usec, L: 0
0927 13:49:47.237511 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:49:47.237670 (+ 159us) log.cc:844] Serialized 356 byte log entry
0927 13:49:47.282936 (+ 45266us) op_driver.cc:464] REPLICATION: finished
0927 13:49:47.283090 (+ 154us) write_op.cc:301] APPLY: starting
0927 13:49:47.283104 (+ 14us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:47.283137 (+ 33us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:47.283173 (+ 36us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:47.283222 (+ 49us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:47.283251 (+ 29us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:47.283258 (+ 7us) write_op.cc:312] APPLY: finished
0927 13:49:47.283346 (+ 88us) log.cc:844] Serialized 23 byte log entry
0927 13:49:47.283405 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:47.283419 (+ 14us) write_op.cc:454] Released schema lock
0927 13:49:47.283425 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:47.283488 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:47.283492 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":75904,"child_traces":[["op",{"apply.queue_time_us":39,"apply.run_cpu_time_us":360,"apply.run_wall_time_us":360,"num_ops":1,"prepare.queue_time_us":267485,"prepare.run_cpu_time_us":1299,"prepare.run_wall_time_us":95312,"raft.queue_time_us":732,"raft.run_cpu_time_us":710,"raft.run_wall_time_us":3465,"replication_time_us":41666,"spinlock_wait_cycles":79529728}],["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":392,"apply.run_wall_time_us":392,"num_ops":1,"prepare.queue_time_us":170534,"prepare.run_cpu_time_us":485,"prepare.run_wall_time_us":483,"replication_time_us":45385,"spinlock_wait_cycles":4352}]]}
W20260927 13:49:47.381024 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet df271399b2c84653ac4a5b74efdc0197 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df271399b2c84653ac4a5b74efdc0197 already in progress: creating tablet
I20260927 13:49:47.381373 5619 ts_tablet_manager.cc:1403] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.007s
I20260927 13:49:47.381408 5916 raft_consensus.cc:493] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.381470 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 109) took 1545 ms. Trace:
I20260927 13:49:47.381572 5916 raft_consensus.cc:515] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.381577 5623 rpcz_store.cc:276] 0927 13:49:45.836455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.837192 (+ 737us) service_pool.cc:224] Handling call
0927 13:49:47.381317 (+1544125us) ts_tablet_manager.cc:1151] Deleting tablet 7cb2864ea38b4a538884a2c728f08313
0927 13:49:47.381326 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.381434 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1521488}
I20260927 13:49:47.361873 5626 tablet_bootstrap.cc:654] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.382334 5916 leader_election.cc:290] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.382464 5619 raft_consensus.cc:359] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.382682 5619 raft_consensus.cc:385] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.382762 5619 raft_consensus.cc:740] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.383037 5619 consensus_queue.cc:260] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.383446 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d3a3282d684415858dc971cb02eec1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:47.383569 5619 ts_tablet_manager.cc:1434] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:47.383669 5249 raft_consensus.cc:2468] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:47.384047 5225 tablet_service.cc:1511] Processing CreateTablet for tablet c989f70385f64593a46f633c98267627 (DEFAULT_TABLE table=default.Table_2c9769bf8a394c8385b21e36bd7afe18 [id=3653a6192dca4f8b9df5f4862eb512a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.384547 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c989f70385f64593a46f633c98267627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.385560 5319 leader_election.cc:304] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:47.385912 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e6721aa2fa0437eae7ca052c19f0f2e with delete_type TABLET_DATA_DELETED (replaced by tablet 7dc612cbcd5d4755a188408f2a036f34) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.386941 5916 raft_consensus.cc:2804] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:47.387233 5916 raft_consensus.cc:493] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:47.387354 5916 raft_consensus.cc:3060] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.389246 5619 tablet_bootstrap.cc:492] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:47.389247 5044 leader_election.cc:343] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.390667 5044 leader_election.cc:304] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.390926 5928 raft_consensus.cc:493] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.391419 5619 tablet_bootstrap.cc:654] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:47.392227 5319 leader_election.cc:343] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 14d3a3282d684415858dc971cb02eec1
I20260927 13:49:47.398288 5606 ts_tablet_manager.cc:1929] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 13:49:47.398430 5606 log.cc:1199] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/fbb2e0a01a9147d597693eab481ca73b
I20260927 13:49:47.398836 5606 ts_tablet_manager.cc:1950] T fbb2e0a01a9147d597693eab481ca73b P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.400141 5928 raft_consensus.cc:515] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.400977 5928 leader_election.cc:290] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.401855 5928 raft_consensus.cc:2749] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.402522 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b04383cb494f65be7ba507a0f0b441" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:47.402576 5083 tablet_service.cc:1511] Processing CreateTablet for tablet c989f70385f64593a46f633c98267627 (DEFAULT_TABLE table=default.Table_2c9769bf8a394c8385b21e36bd7afe18 [id=3653a6192dca4f8b9df5f4862eb512a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.403923 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c989f70385f64593a46f633c98267627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.404008 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 81) took 2925 ms. Trace:
I20260927 13:49:47.404289 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 4295710c33714360b3691f48f47f4293 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.404717 5916 raft_consensus.cc:515] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.405097 5351 tablet_service.cc:1511] Processing CreateTablet for tablet c989f70385f64593a46f633c98267627 (DEFAULT_TABLE table=default.Table_2c9769bf8a394c8385b21e36bd7afe18 [id=3653a6192dca4f8b9df5f4862eb512a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.404120 5606 rpcz_store.cc:276] 0927 13:49:44.478286 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.490916 (+ 12630us) service_pool.cc:224] Handling call
0927 13:49:47.354213 (+2863297us) ts_tablet_manager.cc:1151] Deleting tablet fbb2e0a01a9147d597693eab481ca73b
0927 13:49:47.354224 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.361533 (+ 7309us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.398200 (+ 36667us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.403967 (+ 5767us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2851912}
I20260927 13:49:47.405457 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c989f70385f64593a46f633c98267627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.405771 5606 tablet_replica.cc:333] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.405974 5606 raft_consensus.cc:2243] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.405987 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 6817fb4caf6a445b899830c6702bf911 (DEFAULT_TABLE table=default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b [id=48d90d1ed51f4b18b9ad5a1b7fc3cde4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.406195 5606 raft_consensus.cc:2272] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.406385 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6817fb4caf6a445b899830c6702bf911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.407996 5916 leader_election.cc:290] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.406807 5606 ts_tablet_manager.cc:1916] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.408103 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d3a3282d684415858dc971cb02eec1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:47.408339 5249 raft_consensus.cc:3060] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.410902 5625 tablet_replica.cc:333] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:47.411127 5625 raft_consensus.cc:2243] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.411327 5625 raft_consensus.cc:2272] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.411332 5249 raft_consensus.cc:2468] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:49:47.411706 5045 leader_election.cc:343] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.412431 5319 leader_election.cc:304] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:47.412701 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 107) took 1662 ms. Trace:
I20260927 13:49:47.412842 5623 rpcz_store.cc:276] 0927 13:49:45.750297 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.750365 (+ 68us) service_pool.cc:224] Handling call
0927 13:49:47.412569 (+1662204us) ts_tablet_manager.cc:1151] Deleting tablet 2a2ba67436a544e98788e9c1b00a1c33
0927 13:49:47.412580 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.412670 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1552249}
W20260927 13:49:47.413316 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2a2ba67436a544e98788e9c1b00a1c33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a2ba67436a544e98788e9c1b00a1c33 already in progress: creating tablet
W20260927 13:49:47.413995 5319 leader_election.cc:343] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 14d3a3282d684415858dc971cb02eec1
I20260927 13:49:47.415171 5089 tablet_service.cc:1511] Processing CreateTablet for tablet a6af740383384609a354d7f0fae2cd70 (DEFAULT_TABLE table=default.Table_de419f4cfd244caeaa7707f22194c5bd [id=1cceb2a28eac4398a1e8d1ddb8afd21b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.416530 5916 raft_consensus.cc:2804] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:47.416882 5916 raft_consensus.cc:697] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:47.414901 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 70d1197bee2d477ab77d15cbd4907595 with delete_type TABLET_DATA_DELETED (replaced by tablet 931a48792f4c4525bd563a4dd1062e35) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.421219 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6af740383384609a354d7f0fae2cd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.421160 5916 consensus_queue.cc:237] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.422183 5628 tablet_bootstrap.cc:492] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:47.422358 5628 ts_tablet_manager.cc:1403] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.089s user 0.005s sys 0.000s
I20260927 13:49:47.423197 5628 raft_consensus.cc:359] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.423394 5628 raft_consensus.cc:385] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.423475 5628 raft_consensus.cc:740] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.423940 5628 consensus_queue.cc:260] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.424466 5628 ts_tablet_manager.cc:1434] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:47.426153 5625 ts_tablet_manager.cc:1916] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.432401 5628 tablet_bootstrap.cc:492] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:47.433848 5623 tablet_replica.cc:333] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:47.434157 5623 raft_consensus.cc:2243] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.434430 5623 raft_consensus.cc:2272] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.432456 5606 ts_tablet_manager.cc:1929] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 13:49:47.435000 5606 log.cc:1199] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/c6d69f70750d4b418f850b2cec3ad721
I20260927 13:49:47.435528 5606 ts_tablet_manager.cc:1950] T c6d69f70750d4b418f850b2cec3ad721 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.436081 5623 ts_tablet_manager.cc:1916] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.436369 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 84) took 2849 ms. Trace:
I20260927 13:49:47.436722 5628 tablet_bootstrap.cc:654] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:47.437588 5044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 98526us
I20260927 13:49:47.438488 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b04383cb494f65be7ba507a0f0b441" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:47.439378 5625 ts_tablet_manager.cc:1929] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:47.439548 5606 rpcz_store.cc:276] 0927 13:49:44.587140 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.587447 (+ 307us) service_pool.cc:224] Handling call
0927 13:49:47.405706 (+2818259us) ts_tablet_manager.cc:1151] Deleting tablet c6d69f70750d4b418f850b2cec3ad721
0927 13:49:47.405714 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.412256 (+ 6542us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.432372 (+ 20116us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.436303 (+ 3931us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2818008}
I20260927 13:49:47.440116 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet c6d69f70750d4b418f850b2cec3ad721 (table default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
I20260927 13:49:47.440543 5606 tablet_replica.cc:333] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.440804 5606 raft_consensus.cc:2243] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.441066 5606 raft_consensus.cc:2272] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.441877 5606 ts_tablet_manager.cc:1916] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.443023 5628 tablet_bootstrap.cc:492] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:47.443435 5628 ts_tablet_manager.cc:1403] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260927 13:49:47.444176 5628 raft_consensus.cc:359] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.444423 5628 raft_consensus.cc:385] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.444547 5628 raft_consensus.cc:740] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.444823 5628 consensus_queue.cc:260] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.445425 5628 ts_tablet_manager.cc:1434] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:47.445618 5625 log.cc:1199] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/4295710c33714360b3691f48f47f4293
I20260927 13:49:47.446166 5625 ts_tablet_manager.cc:1950] T 4295710c33714360b3691f48f47f4293 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:47.446627 5628 tablet_bootstrap.cc:492] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:47.454011 5619 tablet_bootstrap.cc:492] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:47.454305 5619 ts_tablet_manager.cc:1403] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.070s user 0.008s sys 0.001s
I20260927 13:49:47.454510 5628 tablet_bootstrap.cc:654] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:47.443089 5044 leader_election.cc:343] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.455302 5619 raft_consensus.cc:359] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.455463 5044 leader_election.cc:304] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.455633 5619 raft_consensus.cc:385] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.455757 6005 raft_consensus.cc:2749] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.455785 5619 raft_consensus.cc:740] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.455924 5928 raft_consensus.cc:493] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.456056 5619 consensus_queue.cc:260] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.456102 5928 raft_consensus.cc:515] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.456677 5619 ts_tablet_manager.cc:1434] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:47.456737 5928 leader_election.cc:290] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.456911 5625 tablet_replica.cc:333] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:47.457100 5625 raft_consensus.cc:2243] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.457263 5625 pending_rounds.cc:70] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: Trying to abort 1 pending ops.
I20260927 13:49:47.457342 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 4295710c33714360b3691f48f47f4293 (table default.Table_97bdee39a93e4f98ae6382e7ab44eda7 [id=2fe2768ea9264c38973e4ed5206c77f2]) successfully deleted
I20260927 13:49:47.457753 5625 pending_rounds.cc:77] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957574355898368 op_type: NO_OP noop_request { }
I20260927 13:49:47.457894 5625 raft_consensus.cc:2889] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:47.457998 5625 raft_consensus.cc:2272] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.458243 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 6817fb4caf6a445b899830c6702bf911 (DEFAULT_TABLE table=default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b [id=48d90d1ed51f4b18b9ad5a1b7fc3cde4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.458648 5625 ts_tablet_manager.cc:1916] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.460325 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 825a73d47bff4246965be82eb482f7aa (DEFAULT_TABLE table=default.Table_74f9ae67b4d74b60b0b23b5597426bf9 [id=119de2adb4d24563b76c6099dec2d9a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.460927 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 6817fb4caf6a445b899830c6702bf911 (DEFAULT_TABLE table=default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b [id=48d90d1ed51f4b18b9ad5a1b7fc3cde4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.461814 5626 tablet_bootstrap.cc:492] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:47.462004 5626 ts_tablet_manager.cc:1403] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.120s user 0.002s sys 0.002s
I20260927 13:49:47.462877 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce1bbbe9dbb443c9f0c001107ffebdf" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:47.463419 5626 raft_consensus.cc:359] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.463477 5928 raft_consensus.cc:493] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.463581 5626 raft_consensus.cc:385] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.463661 5626 raft_consensus.cc:740] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.463653 5928 raft_consensus.cc:515] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.463940 5626 consensus_queue.cc:260] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.464432 5626 ts_tablet_manager.cc:1434] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:47.464550 5928 leader_election.cc:290] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:47.465507 5606 ts_tablet_manager.cc:1929] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.465482 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4b7500f05e4b63b4d79fabde88ebe6" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:47.466215 5044 leader_election.cc:343] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.466388 5606 log.cc:1199] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/587471d2b7e647388e7bb1e7f8e06b40
W20260927 13:49:47.466574 5044 leader_election.cc:343] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.466778 5606 ts_tablet_manager.cc:1950] T 587471d2b7e647388e7bb1e7f8e06b40 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.468936 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce1bbbe9dbb443c9f0c001107ffebdf" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:47.469287 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4b7500f05e4b63b4d79fabde88ebe6" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:47.469842 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6817fb4caf6a445b899830c6702bf911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.470564 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 90) took 2839 ms. Trace:
I20260927 13:49:47.470717 5606 rpcz_store.cc:276] 0927 13:49:44.631455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.631509 (+ 54us) service_pool.cc:224] Handling call
0927 13:49:47.440464 (+2808955us) ts_tablet_manager.cc:1151] Deleting tablet 587471d2b7e647388e7bb1e7f8e06b40
0927 13:49:47.440473 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.448804 (+ 8331us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.465417 (+ 16613us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.470516 (+ 5099us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2808734}
I20260927 13:49:47.471243 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 587471d2b7e647388e7bb1e7f8e06b40 (table default.Table_f7b0ebc78f334f75b9104777be4c6c68 [id=f44e5332ddd545c3b7e52da7a624181a]) successfully deleted
I20260927 13:49:47.471619 5619 tablet_bootstrap.cc:492] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:47.474404 5045 leader_election.cc:343] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.474547 5045 leader_election.cc:304] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.471817 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 91) took 2839 ms. Trace:
I20260927 13:49:47.474828 5928 raft_consensus.cc:2749] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:47.475064 5045 leader_election.cc:343] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.475179 5045 leader_election.cc:304] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.475539 5928 raft_consensus.cc:2749] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.475121 5606 rpcz_store.cc:276] 0927 13:49:44.632788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.632835 (+ 47us) service_pool.cc:224] Handling call
0927 13:49:47.471673 (+2838838us) ts_tablet_manager.cc:1151] Deleting tablet 3663033220094a4ea6df8e2982eb2188
0927 13:49:47.471682 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.471771 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2838664}
I20260927 13:49:47.477280 5625 ts_tablet_manager.cc:1929] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:47.477458 5625 log.cc:1199] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/70d1197bee2d477ab77d15cbd4907595
I20260927 13:49:47.477811 5625 ts_tablet_manager.cc:1950] T 70d1197bee2d477ab77d15cbd4907595 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:47.478214 5606 tablet_replica.cc:333] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.478497 5606 raft_consensus.cc:2243] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.478704 5606 raft_consensus.cc:2272] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:47.478925 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 3663033220094a4ea6df8e2982eb2188 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3663033220094a4ea6df8e2982eb2188 already in progress: creating tablet
I20260927 13:49:47.479314 5628 tablet_bootstrap.cc:492] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:47.479373 5606 ts_tablet_manager.cc:1916] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.479489 5628 ts_tablet_manager.cc:1403] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.006s
I20260927 13:49:47.480073 5628 raft_consensus.cc:359] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.480263 5628 raft_consensus.cc:385] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.480358 5628 raft_consensus.cc:740] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.480604 5628 consensus_queue.cc:260] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.481659 5628 ts_tablet_manager.cc:1434] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:49:47.481983 5628 tablet_bootstrap.cc:492] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:47.483608 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 825a73d47bff4246965be82eb482f7aa (DEFAULT_TABLE table=default.Table_74f9ae67b4d74b60b0b23b5597426bf9 [id=119de2adb4d24563b76c6099dec2d9a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.484059 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825a73d47bff4246965be82eb482f7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.477958 5619 tablet_bootstrap.cc:654] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.486042 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 70d1197bee2d477ab77d15cbd4907595 (table default.Table_dfa3b09930634e67ba11591b71147d46 [id=bed97aef149a417bb3807414f58ba52a]) successfully deleted
I20260927 13:49:47.487459 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 825a73d47bff4246965be82eb482f7aa (DEFAULT_TABLE table=default.Table_74f9ae67b4d74b60b0b23b5597426bf9 [id=119de2adb4d24563b76c6099dec2d9a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.490166 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825a73d47bff4246965be82eb482f7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.484066 5628 tablet_bootstrap.cc:654] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.493407 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5dfa3e80454463908df19a49454764 (DEFAULT_TABLE table=default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.493398 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5dfa3e80454463908df19a49454764 (DEFAULT_TABLE table=default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.493788 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5dfa3e80454463908df19a49454764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.494144 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5dfa3e80454463908df19a49454764 (DEFAULT_TABLE table=default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.494527 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5dfa3e80454463908df19a49454764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.494815 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2d7d460396774c7982b3391c3ad1827f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:47.495381 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d7d460396774c7982b3391c3ad1827f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.495980 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5344269f62464fe7b79f4ec748b4abe7" } new_table_name: "default.Table_9a5417c1ab5f43d6992184dd6aa999c5" modify_external_catalogs: true
I20260927 13:49:47.495977 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3e9c701f47c14f53a3e9d39d0ec63a7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:47.496491 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e9c701f47c14f53a3e9d39d0ec63a7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.496717 5089 tablet_service.cc:1511] Processing CreateTablet for tablet b5cc71e06eb743d2b63e056e88a6498f (DEFAULT_TABLE table=default.Table_d47e75198129467fb676323164970dc6 [id=935f2e2df32c46e58760dba62709c181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.496810 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_15df8518ff4f446cadb3f1c389a17954"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:47.497073 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5cc71e06eb743d2b63e056e88a6498f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:47.497270 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15df8518ff4f446cadb3f1c389a17954 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.502382 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ee4b85ee72994fe596598538d6755252"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:47.502879 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee4b85ee72994fe596598538d6755252 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:47.507274 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b0fd6fb92eb64e948e67f70c512376e2 consensus state has no leader
I20260927 13:49:47.507330 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2aebae054f8449988cd389e188502781" } new_table_name: "default.Table_cae391ea25ba4087b408c0792f9fac13" modify_external_catalogs: true
I20260927 13:49:47.511318 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2c9769bf8a394c8385b21e36bd7afe18" } modify_external_catalogs: true
I20260927 13:49:47.511523 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2c9769bf8a394c8385b21e36bd7afe18" } modify_external_catalogs: true
I20260927 13:49:47.512190 5626 tablet_bootstrap.cc:492] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:49:47.514798 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc6af9b33f0c464683e40adc28037bc8 consensus state has no leader
I20260927 13:49:47.515084 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet b783ffbf2a05453fa43797ce495f8e7a from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:47.521966 5229 tablet_service.cc:1511] Processing CreateTablet for tablet b5cc71e06eb743d2b63e056e88a6498f (DEFAULT_TABLE table=default.Table_d47e75198129467fb676323164970dc6 [id=935f2e2df32c46e58760dba62709c181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.522524 5352 tablet_service.cc:1511] Processing CreateTablet for tablet b5cc71e06eb743d2b63e056e88a6498f (DEFAULT_TABLE table=default.Table_d47e75198129467fb676323164970dc6 [id=935f2e2df32c46e58760dba62709c181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.522957 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5cc71e06eb743d2b63e056e88a6498f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.524359 5227 tablet_service.cc:1511] Processing CreateTablet for tablet d9ff32095a554784b91e74012ad8e020 (DEFAULT_TABLE table=default.Table_4acaf9798ba44467a19273723178f257 [id=112cd821498b427fb3b0d517cd0d55f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.525645 5628 tablet_bootstrap.cc:492] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:47.525806 5628 ts_tablet_manager.cc:1403] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20260927 13:49:47.526834 5628 raft_consensus.cc:359] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.526947 5606 ts_tablet_manager.cc:1929] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.526973 5365 tablet_service.cc:1511] Processing CreateTablet for tablet d9ff32095a554784b91e74012ad8e020 (DEFAULT_TABLE table=default.Table_4acaf9798ba44467a19273723178f257 [id=112cd821498b427fb3b0d517cd0d55f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.527118 5628 raft_consensus.cc:385] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.527135 5606 log.cc:1199] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/60fae0c413e7439c9ab18b01628d8b28
I20260927 13:49:47.527212 5628 raft_consensus.cc:740] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.527396 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ff32095a554784b91e74012ad8e020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.527602 5606 ts_tablet_manager.cc:1950] T 60fae0c413e7439c9ab18b01628d8b28 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.528414 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 93) took 2867 ms. Trace:
I20260927 13:49:47.528510 5606 rpcz_store.cc:276] 0927 13:49:44.660697 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:44.660748 (+ 51us) service_pool.cc:224] Handling call
0927 13:49:47.478147 (+2817399us) ts_tablet_manager.cc:1151] Deleting tablet 60fae0c413e7439c9ab18b01628d8b28
0927 13:49:47.478159 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.492867 (+ 14708us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.526866 (+ 33999us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.528345 (+ 1479us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2817159}
I20260927 13:49:47.529346 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 96) took 2475 ms. Trace:
I20260927 13:49:47.529441 5606 rpcz_store.cc:276] 0927 13:49:45.053605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.055366 (+ 1761us) service_pool.cc:224] Handling call
0927 13:49:47.529116 (+2473750us) ts_tablet_manager.cc:1151] Deleting tablet b95399b042654100a609427597d6fe72
0927 13:49:47.529129 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.529269 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2473515}
W20260927 13:49:47.529915 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b95399b042654100a609427597d6fe72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b95399b042654100a609427597d6fe72 already in progress: creating tablet
I20260927 13:49:47.530339 5385 raft_consensus.cc:3060] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.530670 5606 tablet_replica.cc:333] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.530886 5606 raft_consensus.cc:2243] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.531068 5606 raft_consensus.cc:2272] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.531839 4922 catalog_manager.cc:5838] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:47.532390 4922 catalog_manager.cc:5838] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } }
I20260927 13:49:47.532740 4922 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d6c46d0e50a44232a82d00c88d9f63b5 (table default.Table_abad46e19bc54aac8cf5415b2752c808 [id=e65860898b9041118d5fbb8b5aef2df4]). Expected version 1 got 0
I20260927 13:49:47.533452 4929 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_183e16824f194b1caa9327d0973f607b [id=c16d7a8a2339458b8c973cedf99c32bf] alter complete (version 3)
I20260927 13:49:47.533651 5606 ts_tablet_manager.cc:1916] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.537004 5628 consensus_queue.cc:260] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.540781 5894 raft_consensus.cc:493] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.540851 5628 ts_tablet_manager.cc:1434] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260927 13:49:47.541150 5628 tablet_bootstrap.cc:492] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:47.541036 5894 raft_consensus.cc:515] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.542244 5894 leader_election.cc:290] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:47.542680 5184 leader_election.cc:343] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 587471d2b7e647388e7bb1e7f8e06b40
W20260927 13:49:47.542898 5185 leader_election.cc:343] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 587471d2b7e647388e7bb1e7f8e06b40
I20260927 13:49:47.543004 5185 leader_election.cc:304] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.544032 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825a73d47bff4246965be82eb482f7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.544550 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5cc71e06eb743d2b63e056e88a6498f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.545042 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ff32095a554784b91e74012ad8e020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.545531 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5dfa3e80454463908df19a49454764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.545974 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6817fb4caf6a445b899830c6702bf911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.546880 5089 tablet_service.cc:1511] Processing CreateTablet for tablet d9ff32095a554784b91e74012ad8e020 (DEFAULT_TABLE table=default.Table_4acaf9798ba44467a19273723178f257 [id=112cd821498b427fb3b0d517cd0d55f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:47.547983 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ff32095a554784b91e74012ad8e020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:47.552117 5619 tablet_bootstrap.cc:492] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:47.552307 5619 ts_tablet_manager.cc:1403] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.081s user 0.003s sys 0.001s
I20260927 13:49:47.553088 5619 raft_consensus.cc:359] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.553304 5619 raft_consensus.cc:385] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.553388 5619 raft_consensus.cc:740] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.553649 5619 consensus_queue.cc:260] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.554549 5619 ts_tablet_manager.cc:1434] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:49:47.554857 5619 tablet_bootstrap.cc:492] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:47.556615 5619 tablet_bootstrap.cc:654] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.562731 5606 ts_tablet_manager.cc:1929] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.562880 5606 log.cc:1199] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/66524dd4f62f4da4be845d5efefe8db1
I20260927 13:49:47.563268 5606 ts_tablet_manager.cc:1950] T 66524dd4f62f4da4be845d5efefe8db1 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.564078 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 97) took 2390 ms. Trace:
I20260927 13:49:47.564203 5606 rpcz_store.cc:276] 0927 13:49:45.173110 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.173179 (+ 69us) service_pool.cc:224] Handling call
0927 13:49:47.530585 (+2357406us) ts_tablet_manager.cc:1151] Deleting tablet 66524dd4f62f4da4be845d5efefe8db1
0927 13:49:47.530596 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.544134 (+ 13538us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.562631 (+ 18497us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.564035 (+ 1404us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2357168}
I20260927 13:49:47.564726 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 66524dd4f62f4da4be845d5efefe8db1 (table default.Table_87280d4336274cfe980ae3cd3148a0f6 [id=5b0f9f411500412ca8745dfe54c6cfe5]) successfully deleted
I20260927 13:49:47.570325 5606 tablet_replica.cc:333] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.570617 5606 raft_consensus.cc:2243] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:47.576587 5606 pending_rounds.cc:70] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:47.576777 5606 pending_rounds.cc:77] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957577407078400 op_type: NO_OP noop_request { }
I20260927 13:49:47.577124 5606 raft_consensus.cc:2889] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:47.577318 5606 raft_consensus.cc:2272] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.578259 5606 ts_tablet_manager.cc:1916] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.585793 5606 ts_tablet_manager.cc:1929] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:47.548087 5894 raft_consensus.cc:2749] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.578612 5249 raft_consensus.cc:1275] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Refusing update from remote peer bb28c54312c94d7dafb1c2abf7870735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260927 13:49:47.587743 5916 consensus_queue.cc:1048] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:47.589694 5606 log.cc:1199] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b4bdd64d67d94276b20ab862dec0d2ee
I20260927 13:49:47.590175 5606 ts_tablet_manager.cc:1950] T b4bdd64d67d94276b20ab862dec0d2ee P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.590974 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 98) took 2406 ms. Trace:
I20260927 13:49:47.591099 5606 rpcz_store.cc:276] 0927 13:49:45.184294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.184361 (+ 67us) service_pool.cc:224] Handling call
0927 13:49:47.570250 (+2385889us) ts_tablet_manager.cc:1151] Deleting tablet b4bdd64d67d94276b20ab862dec0d2ee
0927 13:49:47.570261 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.582428 (+ 12167us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.585694 (+ 3266us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.590925 (+ 5231us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2385597}
I20260927 13:49:47.595757 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 99) took 2364 ms. Trace:
I20260927 13:49:47.595754 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b4bdd64d67d94276b20ab862dec0d2ee (table default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e]) successfully deleted
I20260927 13:49:47.595878 5606 rpcz_store.cc:276] 0927 13:49:45.231660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.232112 (+ 452us) service_pool.cc:224] Handling call
0927 13:49:47.595582 (+2363470us) ts_tablet_manager.cc:1151] Deleting tablet 2801473216a3475384d1494892b8df7b
0927 13:49:47.595593 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.595722 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2363191}
I20260927 13:49:47.596194 5606 tablet_replica.cc:333] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.596400 5606 raft_consensus.cc:2243] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:47.596382 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2801473216a3475384d1494892b8df7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2801473216a3475384d1494892b8df7b already in progress: creating tablet
I20260927 13:49:47.596581 5606 raft_consensus.cc:2272] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.597132 5606 ts_tablet_manager.cc:1916] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:47.601780 5319 consensus_peers.cc:597] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70d1197bee2d477ab77d15cbd4907595. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:47.607146 5994 tablet.cc:1751] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:47.612282 5606 ts_tablet_manager.cc:1929] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:47.612449 5606 log.cc:1199] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/32fa23c312544fac8ef485a35e5ab972
I20260927 13:49:47.613289 5606 ts_tablet_manager.cc:1950] T 32fa23c312544fac8ef485a35e5ab972 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.614197 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 100) took 2376 ms. Trace:
I20260927 13:49:47.614336 5606 rpcz_store.cc:276] 0927 13:49:45.237164 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.237500 (+ 336us) service_pool.cc:224] Handling call
0927 13:49:47.596134 (+2358634us) ts_tablet_manager.cc:1151] Deleting tablet 32fa23c312544fac8ef485a35e5ab972
0927 13:49:47.596141 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.601029 (+ 4888us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.612199 (+ 11170us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.614091 (+ 1892us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2358455}
I20260927 13:49:47.614756 5894 consensus_queue.cc:1048] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:47.614886 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 104) took 2309 ms. Trace:
I20260927 13:49:47.614892 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 32fa23c312544fac8ef485a35e5ab972 (table default.Table_ae1f534af970471bac44446c873faddb [id=a51ccdf3dce04c65b40dd44a1f8c16f1]) successfully deleted
I20260927 13:49:47.614975 5606 rpcz_store.cc:276] 0927 13:49:45.305290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.316933 (+ 11643us) service_pool.cc:224] Handling call
0927 13:49:47.614689 (+2297756us) ts_tablet_manager.cc:1151] Deleting tablet dce1bbbe9dbb443c9f0c001107ffebdf
0927 13:49:47.614710 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.614823 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2297414}
I20260927 13:49:47.615377 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 114) took 2088 ms. Trace:
I20260927 13:49:47.615495 5606 rpcz_store.cc:276] 0927 13:49:45.527238 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.527744 (+ 506us) service_pool.cc:224] Handling call
0927 13:49:47.615207 (+2087463us) ts_tablet_manager.cc:1151] Deleting tablet 2a2ba67436a544e98788e9c1b00a1c33
0927 13:49:47.615216 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.615307 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2080069}
I20260927 13:49:47.615917 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 113) took 2088 ms. Trace:
I20260927 13:49:47.616041 5606 rpcz_store.cc:276] 0927 13:49:45.527149 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.527715 (+ 566us) service_pool.cc:224] Handling call
0927 13:49:47.615756 (+2088041us) ts_tablet_manager.cc:1151] Deleting tablet df271399b2c84653ac4a5b74efdc0197
0927 13:49:47.615764 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.615858 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2078780}
I20260927 13:49:47.616375 5606 tablet_replica.cc:333] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.616602 5606 raft_consensus.cc:2243] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.616811 5606 raft_consensus.cc:2272] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:47.617640 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet dce1bbbe9dbb443c9f0c001107ffebdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dce1bbbe9dbb443c9f0c001107ffebdf already in progress: creating tablet
W20260927 13:49:47.617879 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2a2ba67436a544e98788e9c1b00a1c33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a2ba67436a544e98788e9c1b00a1c33 already in progress: creating tablet
W20260927 13:49:47.618100 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet df271399b2c84653ac4a5b74efdc0197 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df271399b2c84653ac4a5b74efdc0197 already in progress: creating tablet
I20260927 13:49:47.623159 5606 ts_tablet_manager.cc:1916] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.623734 5928 raft_consensus.cc:493] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.623914 5928 raft_consensus.cc:515] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.624589 5928 leader_election.cc:290] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:47.624595 5995 consensus_queue.cc:1048] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:47.625051 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0018704e08254c2e8d30c7067df4420c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:47.625480 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0018704e08254c2e8d30c7067df4420c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:47.625777 5044 leader_election.cc:343] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.626067 5928 raft_consensus.cc:493] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.626251 5928 raft_consensus.cc:515] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.626955 5928 leader_election.cc:290] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.627758 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fd6fb92eb64e948e67f70c512376e2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:47.628011 5045 leader_election.cc:343] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.628147 5045 leader_election.cc:304] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:47.628386 5044 leader_election.cc:343] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.628657 6005 raft_consensus.cc:2749] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.630049 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fd6fb92eb64e948e67f70c512376e2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:47.630841 5045 leader_election.cc:343] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.630964 5045 leader_election.cc:304] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.631440 5928 raft_consensus.cc:2749] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.645736 5606 ts_tablet_manager.cc:1929] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.645895 5606 log.cc:1199] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/7cb2864ea38b4a538884a2c728f08313
I20260927 13:49:47.646313 5606 ts_tablet_manager.cc:1950] T 7cb2864ea38b4a538884a2c728f08313 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.647107 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 116) took 2030 ms. Trace:
I20260927 13:49:47.647241 5606 rpcz_store.cc:276] 0927 13:49:45.616814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.616868 (+ 54us) service_pool.cc:224] Handling call
0927 13:49:47.616288 (+1999420us) ts_tablet_manager.cc:1151] Deleting tablet 7cb2864ea38b4a538884a2c728f08313
0927 13:49:47.616297 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.630997 (+ 14700us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.645618 (+ 14621us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.647064 (+ 1446us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1999175}
I20260927 13:49:47.647686 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 115) took 2033 ms. Trace:
I20260927 13:49:47.647814 5606 rpcz_store.cc:276] 0927 13:49:45.614614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.625969 (+ 11355us) service_pool.cc:224] Handling call
0927 13:49:47.647537 (+2021568us) ts_tablet_manager.cc:1151] Deleting tablet 77f549f487ea4dbb8c7fceee6f8a6db0
0927 13:49:47.647548 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.647655 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2021354}
I20260927 13:49:47.648138 5606 tablet_replica.cc:333] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
W20260927 13:49:47.648332 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77f549f487ea4dbb8c7fceee6f8a6db0 already in progress: creating tablet
I20260927 13:49:47.648823 5606 raft_consensus.cc:2243] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.648993 5606 raft_consensus.cc:2272] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.649542 5606 ts_tablet_manager.cc:1916] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.651528 5626 tablet_bootstrap.cc:700] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: Time spent opening tablet: real 0.138s user 0.001s sys 0.001s
I20260927 13:49:47.651927 5626 tablet_bootstrap.cc:654] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.656802 5628 tablet_bootstrap.cc:654] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.665750 5928 raft_consensus.cc:493] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.665937 5928 raft_consensus.cc:515] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.667078 5928 leader_election.cc:290] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.667639 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b1d54e4af0432f9d1ef9879d2ec4e9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:47.668296 5044 leader_election.cc:343] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.668731 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b1d54e4af0432f9d1ef9879d2ec4e9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:47.669411 5045 leader_election.cc:343] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.669530 5045 leader_election.cc:304] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.669792 5928 raft_consensus.cc:2749] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.670737 5606 ts_tablet_manager.cc:1929] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.670892 5606 log.cc:1199] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/6bb5fdbfebd5401e92186997f9a30d36
I20260927 13:49:47.671280 5606 ts_tablet_manager.cc:1950] T 6bb5fdbfebd5401e92186997f9a30d36 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.671919 5623 ts_tablet_manager.cc:1929] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.672104 5623 log.cc:1199] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f443c863d087483493baa4c80bb64670
I20260927 13:49:47.672096 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 117) took 2034 ms. Trace:
I20260927 13:49:47.672199 5606 rpcz_store.cc:276] 0927 13:49:45.638089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.645952 (+ 7863us) service_pool.cc:224] Handling call
0927 13:49:47.648075 (+2002123us) ts_tablet_manager.cc:1151] Deleting tablet 6bb5fdbfebd5401e92186997f9a30d36
0927 13:49:47.648084 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.653200 (+ 5116us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.670654 (+ 17454us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.672040 (+ 1386us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1999629}
I20260927 13:49:47.672601 5606 tablet_replica.cc:333] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.672804 5606 raft_consensus.cc:2243] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:47.672821 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 6bb5fdbfebd5401e92186997f9a30d36 (table default.Table_74f9ae67b4d74b60b0b23b5597426bf9 [id=119de2adb4d24563b76c6099dec2d9a9]) successfully deleted
I20260927 13:49:47.673085 5606 pending_rounds.cc:70] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:47.673153 5606 pending_rounds.cc:77] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957578169585664 op_type: NO_OP noop_request { }
I20260927 13:49:47.673276 5606 raft_consensus.cc:2889] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:47.673395 5606 raft_consensus.cc:2272] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.675491 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 7681d137476040788e40dd787ce74ccd from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:47.676012 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet 0004ef0b2dd841ac860798d804374dc1 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:47.677958 5623 ts_tablet_manager.cc:1950] T f443c863d087483493baa4c80bb64670 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:47.678871 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 112) took 1819 ms. Trace:
I20260927 13:49:47.678999 5623 rpcz_store.cc:276] 0927 13:49:45.858930 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.859830 (+ 900us) service_pool.cc:224] Handling call
0927 13:49:47.433768 (+1573938us) ts_tablet_manager.cc:1151] Deleting tablet f443c863d087483493baa4c80bb64670
0927 13:49:47.433778 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.650685 (+216907us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.671807 (+ 21122us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.678814 (+ 7007us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1570636}
I20260927 13:49:47.679579 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 111) took 1820 ms. Trace:
I20260927 13:49:47.679574 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f443c863d087483493baa4c80bb64670 (table default.Table_2c9769bf8a394c8385b21e36bd7afe18 [id=3653a6192dca4f8b9df5f4862eb512a8]) successfully deleted
I20260927 13:49:47.679672 5623 rpcz_store.cc:276] 0927 13:49:45.858786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.860072 (+ 1286us) service_pool.cc:224] Handling call
0927 13:49:47.679361 (+1819289us) ts_tablet_manager.cc:1151] Deleting tablet d9b04383cb494f65be7ba507a0f0b441
0927 13:49:47.679370 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.679514 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1812646}
I20260927 13:49:47.680148 5623 tablet_replica.cc:333] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
W20260927 13:49:47.680286 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet d9b04383cb494f65be7ba507a0f0b441 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9b04383cb494f65be7ba507a0f0b441 already in progress: creating tablet
I20260927 13:49:47.680378 5623 raft_consensus.cc:2243] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:47.680632 5623 pending_rounds.cc:70] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:47.680699 5623 pending_rounds.cc:77] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957579566223360 op_type: NO_OP noop_request { }
I20260927 13:49:47.680836 5623 raft_consensus.cc:2889] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:47.680939 5623 raft_consensus.cc:2272] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.683872 5626 tablet_bootstrap.cc:492] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:47.683899 5619 tablet_bootstrap.cc:492] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:47.684046 5626 ts_tablet_manager.cc:1403] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.172s user 0.002s sys 0.002s
I20260927 13:49:47.684046 5619 ts_tablet_manager.cc:1403] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.129s user 0.018s sys 0.021s
I20260927 13:49:47.685114 5606 ts_tablet_manager.cc:1916] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.685225 5626 raft_consensus.cc:359] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.685408 5626 raft_consensus.cc:385] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.685493 5626 raft_consensus.cc:740] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.686268 5787 raft_consensus.cc:493] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.686460 5787 raft_consensus.cc:515] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.687053 5787 leader_election.cc:290] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.688194 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe6a7394da94edf87166a184a9a04ba" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:47.688426 5249 raft_consensus.cc:2393] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:49:47.685992 5619 raft_consensus.cc:359] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.688864 5619 raft_consensus.cc:385] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.688984 5623 ts_tablet_manager.cc:1916] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.689102 5619 raft_consensus.cc:740] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.689553 5619 consensus_queue.cc:260] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:47.689688 5319 leader_election.cc:343] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 4fe6a7394da94edf87166a184a9a04ba
I20260927 13:49:47.689828 5319 leader_election.cc:304] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:47.690373 5787 raft_consensus.cc:3060] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.694448 5787 raft_consensus.cc:2749] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.695104 5619 ts_tablet_manager.cc:1434] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260927 13:49:47.695549 5619 tablet_bootstrap.cc:492] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:47.696313 5623 ts_tablet_manager.cc:1929] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:47.696676 5623 log.cc:1199] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/6bb5fdbfebd5401e92186997f9a30d36
I20260927 13:49:47.697121 5623 ts_tablet_manager.cc:1950] T 6bb5fdbfebd5401e92186997f9a30d36 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:47.700891 5619 tablet_bootstrap.cc:654] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.712329 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 110) took 1859 ms. Trace:
I20260927 13:49:47.712458 5623 rpcz_store.cc:276] 0927 13:49:45.852551 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.853798 (+ 1247us) service_pool.cc:224] Handling call
0927 13:49:47.680059 (+1826261us) ts_tablet_manager.cc:1151] Deleting tablet 6bb5fdbfebd5401e92186997f9a30d36
0927 13:49:47.680069 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.692355 (+ 12286us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.696238 (+ 3883us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.712266 (+ 16028us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1803820}
I20260927 13:49:47.712879 5623 tablet_replica.cc:333] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:47.713068 5623 raft_consensus.cc:2243] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.713112 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 6bb5fdbfebd5401e92186997f9a30d36 (table default.Table_74f9ae67b4d74b60b0b23b5597426bf9 [id=119de2adb4d24563b76c6099dec2d9a9]) successfully deleted
I20260927 13:49:47.713258 5623 raft_consensus.cc:2272] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.713790 5623 ts_tablet_manager.cc:1916] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.720608 5606 ts_tablet_manager.cc:1929] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:47.721081 5626 consensus_queue.cc:260] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.721995 5606 log.cc:1199] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/f443c863d087483493baa4c80bb64670
I20260927 13:49:47.722549 5606 ts_tablet_manager.cc:1950] T f443c863d087483493baa4c80bb64670 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.722939 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_de419f4cfd244caeaa7707f22194c5bd" } modify_external_catalogs: true
I20260927 13:49:47.723146 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_de419f4cfd244caeaa7707f22194c5bd" } modify_external_catalogs: true
I20260927 13:49:47.724519 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_71b0f958b1ec49bf9f334180403b5e3f" } modify_external_catalogs: true
I20260927 13:49:47.724731 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_71b0f958b1ec49bf9f334180403b5e3f" } modify_external_catalogs: true
I20260927 13:49:47.730355 5626 ts_tablet_manager.cc:1434] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.046s user 0.002s sys 0.002s
I20260927 13:49:47.730751 5626 tablet_bootstrap.cc:492] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:49:47.733211 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a35fefc73c54d6c9b1907f55add7b92 consensus state has no leader
I20260927 13:49:47.733634 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c614391e114f4a7889ab500228e6318a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:47.734460 5626 tablet_bootstrap.cc:654] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:47.734648 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c614391e114f4a7889ab500228e6318a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.736377 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet c989f70385f64593a46f633c98267627
I20260927 13:49:47.737445 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet c989f70385f64593a46f633c98267627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.742580 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a6af740383384609a354d7f0fae2cd70
I20260927 13:49:47.742966 4928 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_847c101270804f9f856b7e564cc9fbbe [id=d140ef61df2143d8bd6f44d8f92153c9] alter complete (version 1)
I20260927 13:49:47.743479 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7cef271e951d46f38d090f892f8e54c0" } modify_external_catalogs: true
I20260927 13:49:47.743654 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7cef271e951d46f38d090f892f8e54c0" } modify_external_catalogs: true
I20260927 13:49:47.745636 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_74f9ae67b4d74b60b0b23b5597426bf9" } new_table_name: "default.Table_de911651b6ff4188876ef1d412e041b7" modify_external_catalogs: true
I20260927 13:49:47.745751 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet a6af740383384609a354d7f0fae2cd70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:47.746289 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet c989f70385f64593a46f633c98267627 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c989f70385f64593a46f633c98267627 already in progress: creating tablet
I20260927 13:49:47.746451 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb5fdbfebd5401e92186997f9a30d36 with delete_type TABLET_DATA_DELETED (replaced by tablet 825a73d47bff4246965be82eb482f7aa) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.746639 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet b4bdd64d67d94276b20ab862dec0d2ee with delete_type TABLET_DATA_DELETED (replaced by tablet c2fc2734e88e431facdf72e9ef136106) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.746824 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d3a3282d684415858dc971cb02eec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.747028 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 587471d2b7e647388e7bb1e7f8e06b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.747051 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet a6af740383384609a354d7f0fae2cd70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.742043 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b783ffbf2a05453fa43797ce495f8e7a
I20260927 13:49:47.747555 4926 catalog_manager.cc:6934] ReplaceTablet: tablet b783ffbf2a05453fa43797ce495f8e7a deleted and replaced by tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0
I20260927 13:49:47.747975 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4a75f85041ad48c1bb68bc4f505b6ccd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:47.748291 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c42b0575837344b49224e6f62cb664e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:47.748451 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c343af7db0904049b004a47d2ae605b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:47.748558 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a75f85041ad48c1bb68bc4f505b6ccd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:47.748696 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c42b0575837344b49224e6f62cb664e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:47.748968 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c343af7db0904049b004a47d2ae605b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.750483 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 66524dd4f62f4da4be845d5efefe8db1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.750731 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet c989f70385f64593a46f633c98267627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.750936 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet b783ffbf2a05453fa43797ce495f8e7a with delete_type TABLET_DATA_DELETED (replaced by tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.752389 4921 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e802abef0baa46cfb73fb666fc0772be" } modify_external_catalogs: true
I20260927 13:49:47.752568 4921 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e802abef0baa46cfb73fb666fc0772be" } modify_external_catalogs: true
I20260927 13:49:47.755766 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 70d1197bee2d477ab77d15cbd4907595 with delete_type TABLET_DATA_DELETED (replaced by tablet 931a48792f4c4525bd563a4dd1062e35) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:47.757102 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a6af740383384609a354d7f0fae2cd70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6af740383384609a354d7f0fae2cd70 already in progress: creating tablet
W20260927 13:49:47.757375 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 70d1197bee2d477ab77d15cbd4907595 because the tablet was not found. No further retry: Not found: Tablet not found: 70d1197bee2d477ab77d15cbd4907595
I20260927 13:49:47.758024 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet b783ffbf2a05453fa43797ce495f8e7a with delete_type TABLET_DATA_DELETED (replaced by tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.758667 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 0004ef0b2dd841ac860798d804374dc1
I20260927 13:49:47.759195 4923 catalog_manager.cc:6934] ReplaceTablet: tablet 0004ef0b2dd841ac860798d804374dc1 deleted and replaced by tablet bbb4f42522e84964aeb19358ee02dfc2
I20260927 13:49:47.759266 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet dff5992b27f049f5890e65d5a8dcc3cf with delete_type TABLET_DATA_DELETED (replaced by tablet 1f5dfa3e80454463908df19a49454764) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.759536 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet b783ffbf2a05453fa43797ce495f8e7a with delete_type TABLET_DATA_DELETED (replaced by tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.759653 5623 ts_tablet_manager.cc:1929] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.759591 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6654f7ea3c6c4d07806b732f11f5d352"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:47.759740 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.759793 5623 log.cc:1199] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/4fe6a7394da94edf87166a184a9a04ba
I20260927 13:49:47.759956 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet dce1bbbe9dbb443c9f0c001107ffebdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.760165 5623 ts_tablet_manager.cc:1950] T 4fe6a7394da94edf87166a184a9a04ba P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
W20260927 13:49:47.760193 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6654f7ea3c6c4d07806b732f11f5d352 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.760185 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 0018704e08254c2e8d30c7067df4420c with delete_type TABLET_DATA_DELETED (replaced by tablet 059afd48ac4a41569ed1d3556b7974f0) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.760429 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b04383cb494f65be7ba507a0f0b441 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.760718 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.760942 5625 tablet_replica.cc:333] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:47.761020 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 115) took 1851 ms. Trace:
I20260927 13:49:47.761154 5625 raft_consensus.cc:2243] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.761112 5623 rpcz_store.cc:276] 0927 13:49:45.909171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.912133 (+ 2962us) service_pool.cc:224] Handling call
0927 13:49:47.712779 (+1800646us) ts_tablet_manager.cc:1151] Deleting tablet 4fe6a7394da94edf87166a184a9a04ba
0927 13:49:47.712790 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.717526 (+ 4736us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.759555 (+ 42029us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.760984 (+ 1429us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1800431}
I20260927 13:49:47.761337 5625 raft_consensus.cc:2272] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.761545 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 117) took 1845 ms. Trace:
I20260927 13:49:47.761650 5623 rpcz_store.cc:276] 0927 13:49:45.916573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.916669 (+ 96us) service_pool.cc:224] Handling call
0927 13:49:47.761396 (+1844727us) ts_tablet_manager.cc:1151] Deleting tablet 7a4b7500f05e4b63b4d79fabde88ebe6
0927 13:49:47.761406 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.761513 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1839094}
I20260927 13:49:47.761888 5625 ts_tablet_manager.cc:1916] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.761962 5623 tablet_replica.cc:333] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:47.762060 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 0004ef0b2dd841ac860798d804374dc1 with delete_type TABLET_DATA_DELETED (replaced by tablet bbb4f42522e84964aeb19358ee02dfc2) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.762161 5623 raft_consensus.cc:2243] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.762315 5623 raft_consensus.cc:2272] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.762835 5623 ts_tablet_manager.cc:1916] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.763262 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet f5bf9ba5d857421ebc783d4c567f411c
I20260927 13:49:47.760895 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 4295710c33714360b3691f48f47f4293 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.766309 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet f5bf9ba5d857421ebc783d4c567f411c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.775259 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 2801473216a3475384d1494892b8df7b with delete_type TABLET_DATA_DELETED (replaced by tablet 72711f14f26a479c9699b172b41b1db0) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.776211 5623 ts_tablet_manager.cc:1929] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.776211 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc612cbcd5d4755a188408f2a036f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.776350 5623 log.cc:1199] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f9b019bbec5d40609dbf1c556cc26a63
I20260927 13:49:47.776721 5623 ts_tablet_manager.cc:1950] T f9b019bbec5d40609dbf1c556cc26a63 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:47.777246 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 4fe6a7394da94edf87166a184a9a04ba (table default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]) successfully deleted
I20260927 13:49:47.777566 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 123) took 1748 ms. Trace:
W20260927 13:49:47.777554 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a4b7500f05e4b63b4d79fabde88ebe6 already in progress: creating tablet
I20260927 13:49:47.777665 5623 rpcz_store.cc:276] 0927 13:49:46.029490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.029548 (+ 58us) service_pool.cc:224] Handling call
0927 13:49:47.761905 (+1732357us) ts_tablet_manager.cc:1151] Deleting tablet f9b019bbec5d40609dbf1c556cc26a63
0927 13:49:47.761916 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.773041 (+ 11125us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.776141 (+ 3100us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.777512 (+ 1371us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1732048}
I20260927 13:49:47.778192 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 121) took 1768 ms. Trace:
I20260927 13:49:47.778326 5623 rpcz_store.cc:276] 0927 13:49:46.010152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.031827 (+ 21675us) service_pool.cc:224] Handling call
0927 13:49:47.777980 (+1746153us) ts_tablet_manager.cc:1151] Deleting tablet 910b73528ed949bc86badcc4cf6c74a3
0927 13:49:47.777991 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.778090 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1745893}
I20260927 13:49:47.778458 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 0004ef0b2dd841ac860798d804374dc1 with delete_type TABLET_DATA_DELETED (replaced by tablet bbb4f42522e84964aeb19358ee02dfc2) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.778335 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet f5bf9ba5d857421ebc783d4c567f411c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.778877 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 124) took 1745 ms. Trace:
I20260927 13:49:47.778978 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet a6af740383384609a354d7f0fae2cd70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.778981 5623 rpcz_store.cc:276] 0927 13:49:46.033280 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.034760 (+ 1480us) service_pool.cc:224] Handling call
0927 13:49:47.778725 (+1743965us) ts_tablet_manager.cc:1151] Deleting tablet dff5992b27f049f5890e65d5a8dcc3cf
0927 13:49:47.778735 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.778820 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1743722}
I20260927 13:49:47.779462 5623 tablet_replica.cc:333] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:47.779793 5623 raft_consensus.cc:2243] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.779783 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f9b019bbec5d40609dbf1c556cc26a63 (table default.Table_eae0be8d08ec43279ba35789c84b573c [id=599a7a50e2324466b865d11e66bc51bd]) successfully deleted
I20260927 13:49:47.779978 5623 raft_consensus.cc:2272] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:47.780056 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 910b73528ed949bc86badcc4cf6c74a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 910b73528ed949bc86badcc4cf6c74a3 already in progress: creating tablet
W20260927 13:49:47.780292 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet dff5992b27f049f5890e65d5a8dcc3cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff5992b27f049f5890e65d5a8dcc3cf already in progress: creating tablet
I20260927 13:49:47.780536 5623 ts_tablet_manager.cc:1916] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.781682 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 0004ef0b2dd841ac860798d804374dc1 with delete_type TABLET_DATA_DELETED (replaced by tablet bbb4f42522e84964aeb19358ee02dfc2) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.781893 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet f5bf9ba5d857421ebc783d4c567f411c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.782478 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d4e41f2afdee4a93ad03e1b7a65c5641" } new_table_name: "default.Table_dbe657f659e24156b29a259c4b995402" modify_external_catalogs: true
I20260927 13:49:47.784595 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 119) took 2127 ms. Trace:
I20260927 13:49:47.784766 5606 rpcz_store.cc:276] 0927 13:49:45.657122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.657174 (+ 52us) service_pool.cc:224] Handling call
0927 13:49:47.672510 (+2015336us) ts_tablet_manager.cc:1151] Deleting tablet f443c863d087483493baa4c80bb64670
0927 13:49:47.672520 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.708842 (+ 36322us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.720535 (+ 11693us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.784533 (+ 63998us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2015146}
I20260927 13:49:47.785360 5217 tablet_service.cc:1558] Processing DeleteTablet for tablet c989f70385f64593a46f633c98267627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.785570 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet c7670d5f54df49f4a074588ab9269145 with delete_type TABLET_DATA_DELETED (replaced by tablet 1245334728994a60ad641c2e90f8d2df) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.785815 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.786075 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 118) took 2134 ms. Trace:
I20260927 13:49:47.788455 5625 ts_tablet_manager.cc:1929] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.788589 5625 log.cc:1199] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/dff5992b27f049f5890e65d5a8dcc3cf
I20260927 13:49:47.788995 5625 ts_tablet_manager.cc:1950] T dff5992b27f049f5890e65d5a8dcc3cf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:47.790056 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet dff5992b27f049f5890e65d5a8dcc3cf (table default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]) successfully deleted
I20260927 13:49:47.800818 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2999bd61907847938975a6232e3899e4
I20260927 13:49:47.801131 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet 6817fb4caf6a445b899830c6702bf911 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:47.801580 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ba2e6accc13649da9059299c5108fdb2" } new_table_name: "default.Table_812430ef8c1c4462ae6a6663805f50b8" modify_external_catalogs: true
I20260927 13:49:47.802362 5928 raft_consensus.cc:493] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.802500 5928 raft_consensus.cc:515] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.803128 5928 leader_election.cc:290] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.803869 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7670d5f54df49f4a074588ab9269145" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:47.803958 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_44d960a4808c41b3857a9d76053fc16a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:47.804136 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 2999bd61907847938975a6232e3899e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:47.804472 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44d960a4808c41b3857a9d76053fc16a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.805217 5628 tablet_bootstrap.cc:492] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:47.805384 5628 ts_tablet_manager.cc:1403] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.264s user 0.006s sys 0.000s
W20260927 13:49:47.806932 5044 leader_election.cc:343] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.807592 5217 tablet_service.cc:1558] Processing DeleteTablet for tablet 2999bd61907847938975a6232e3899e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.808490 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_178d88a5d7a44720b4c553f38d8fd9d7" } new_table_name: "default.Table_22d5c80b2b5b4ee09361300740be2ab2" modify_external_catalogs: true
I20260927 13:49:47.809273 5625 tablet_replica.cc:333] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:47.809580 5727 raft_consensus.cc:493] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.809717 5727 raft_consensus.cc:515] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.809808 5625 raft_consensus.cc:2243] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.809954 5625 raft_consensus.cc:2272] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.803228 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 2999bd61907847938975a6232e3899e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.810439 5727 leader_election.cc:290] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:47.809523 5628 raft_consensus.cc:359] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.804364 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7670d5f54df49f4a074588ab9269145" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:47.810636 5628 raft_consensus.cc:385] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.810731 5628 raft_consensus.cc:740] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.786422 5606 rpcz_store.cc:276] 0927 13:49:45.651882 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.683544 (+ 31662us) service_pool.cc:224] Handling call
0927 13:49:47.785597 (+2102053us) ts_tablet_manager.cc:1151] Deleting tablet d9b04383cb494f65be7ba507a0f0b441
0927 13:49:47.785609 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.786024 (+ 415us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2101801}
I20260927 13:49:47.811018 5628 consensus_queue.cc:260] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.811301 5625 ts_tablet_manager.cc:1916] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:47.811277 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet d9b04383cb494f65be7ba507a0f0b441 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9b04383cb494f65be7ba507a0f0b441 already in progress: creating tablet
I20260927 13:49:47.811646 5606 tablet_replica.cc:333] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.811828 5606 raft_consensus.cc:2243] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:47.811931 5184 leader_election.cc:343] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7cb2864ea38b4a538884a2c728f08313
I20260927 13:49:47.811996 5606 raft_consensus.cc:2272] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:47.812350 5045 leader_election.cc:343] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.812471 5045 leader_election.cc:304] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.812523 5606 ts_tablet_manager.cc:1916] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:47.813493 5185 leader_election.cc:343] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 7cb2864ea38b4a538884a2c728f08313
I20260927 13:49:47.813603 5185 leader_election.cc:304] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.813972 5727 raft_consensus.cc:2749] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.814584 5928 raft_consensus.cc:2749] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.815894 5619 tablet_bootstrap.cc:492] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:47.816075 5619 ts_tablet_manager.cc:1403] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.121s user 0.004s sys 0.004s
I20260927 13:49:47.816634 5628 ts_tablet_manager.cc:1434] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260927 13:49:47.816946 5619 raft_consensus.cc:359] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.817119 5628 tablet_bootstrap.cc:492] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:47.817148 5619 raft_consensus.cc:385] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.817214 5619 raft_consensus.cc:740] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.817508 5619 consensus_queue.cc:260] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.821918 5619 ts_tablet_manager.cc:1434] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260927 13:49:47.822243 5619 tablet_bootstrap.cc:492] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:47.825271 5623 ts_tablet_manager.cc:1929] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.825398 5623 log.cc:1199] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/9b6ff9ddb6664a5a867ac0f64ac1e9a2
I20260927 13:49:47.825671 5619 tablet_bootstrap.cc:654] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.825757 5623 ts_tablet_manager.cc:1950] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:47.826704 5628 tablet_bootstrap.cc:654] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.835377 4921 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet d506e069a1224eb68de08be45a5d9fd9
I20260927 13:49:47.835464 5625 ts_tablet_manager.cc:1929] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.835597 5625 log.cc:1199] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b783ffbf2a05453fa43797ce495f8e7a
I20260927 13:49:47.836493 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 125) took 1798 ms. Trace:
I20260927 13:49:47.836627 5623 rpcz_store.cc:276] 0927 13:49:46.037649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.067956 (+ 30307us) service_pool.cc:224] Handling call
0927 13:49:47.779379 (+1711423us) ts_tablet_manager.cc:1151] Deleting tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2
0927 13:49:47.779387 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.808506 (+ 29119us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.825155 (+ 16649us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.836445 (+ 11290us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1706900}
I20260927 13:49:47.837494 5606 ts_tablet_manager.cc:1929] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.838532 5606 log.cc:1199] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/ab9ac0e6083343debabc043435c54d95
I20260927 13:49:47.839483 5787 raft_consensus.cc:493] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.839628 5787 raft_consensus.cc:515] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.840276 5787 leader_election.cc:290] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.840992 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3663033220094a4ea6df8e2982eb2188" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:47.841199 5249 raft_consensus.cc:2468] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:49:47.841415 5319 leader_election.cc:343] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3663033220094a4ea6df8e2982eb2188
I20260927 13:49:47.841670 5319 leader_election.cc:304] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:47.841789 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 140) took 1413 ms. Trace:
I20260927 13:49:47.841903 5623 rpcz_store.cc:276] 0927 13:49:46.428726 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.428774 (+ 48us) service_pool.cc:224] Handling call
0927 13:49:47.841631 (+1412857us) ts_tablet_manager.cc:1151] Deleting tablet bc8f6354c1034814af3cc20df25ddb47
0927 13:49:47.841642 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.841757 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1407081}
I20260927 13:49:47.842242 5787 raft_consensus.cc:2804] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:47.842360 5787 raft_consensus.cc:493] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:47.842442 5787 raft_consensus.cc:3060] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:47.842413 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet bc8f6354c1034814af3cc20df25ddb47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc8f6354c1034814af3cc20df25ddb47 already in progress: creating tablet
I20260927 13:49:47.842777 5623 tablet_replica.cc:333] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:47.843036 5623 raft_consensus.cc:2243] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.843217 5623 raft_consensus.cc:2272] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.843873 5623 ts_tablet_manager.cc:1916] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.845397 5787 raft_consensus.cc:515] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.846632 5625 ts_tablet_manager.cc:1950] T b783ffbf2a05453fa43797ce495f8e7a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:47.847836 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b783ffbf2a05453fa43797ce495f8e7a (table default.Table_4d67b784836e4d3b93bfc13e260f4761 [id=ee0789e9d1f34c3791d35794473e2246]) successfully deleted
I20260927 13:49:47.848963 5625 tablet_replica.cc:333] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:47.849416 5625 raft_consensus.cc:2243] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.849907 5625 raft_consensus.cc:2272] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.850518 5625 ts_tablet_manager.cc:1916] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.850594 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet d2e0b4c217ca41b98013155b8d952fe6 from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:47.851761 5319 leader_election.cc:343] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3663033220094a4ea6df8e2982eb2188
I20260927 13:49:47.854005 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 3663033220094a4ea6df8e2982eb2188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.853552 5628 tablet_bootstrap.cc:492] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:47.854926 5628 ts_tablet_manager.cc:1403] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.002s
I20260927 13:49:47.855731 5628 raft_consensus.cc:359] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.855976 5628 raft_consensus.cc:385] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.856091 5628 raft_consensus.cc:740] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.856755 5628 consensus_queue.cc:260] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.856863 5787 leader_election.cc:290] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.858026 5628 ts_tablet_manager.cc:1434] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 13:49:47.857677 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3663033220094a4ea6df8e2982eb2188" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:47.858333 5249 raft_consensus.cc:3060] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.860663 5626 tablet_bootstrap.cc:492] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:47.860834 5626 ts_tablet_manager.cc:1403] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.130s user 0.000s sys 0.003s
I20260927 13:49:47.861577 5626 raft_consensus.cc:359] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.861652 5249 raft_consensus.cc:2468] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:47.861765 5626 raft_consensus.cc:385] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.862207 5319 leader_election.cc:304] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:47.863792 5787 raft_consensus.cc:2804] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:47.864717 5787 raft_consensus.cc:697] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:47.865044 5787 consensus_queue.cc:237] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.866472 5628 tablet_bootstrap.cc:492] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:47.861842 5626 raft_consensus.cc:740] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.868003 5626 consensus_queue.cc:260] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.868577 5628 tablet_bootstrap.cc:654] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.873558 5626 ts_tablet_manager.cc:1434] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.013s user 0.001s sys 0.002s
I20260927 13:49:47.877851 5626 tablet_bootstrap.cc:492] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:47.881189 5626 tablet_bootstrap.cc:654] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.884737 5623 ts_tablet_manager.cc:1929] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:47.884886 5623 log.cc:1199] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/e56df07d0a524e5184bdc7fc8d95857c
I20260927 13:49:47.885272 5623 ts_tablet_manager.cc:1950] T e56df07d0a524e5184bdc7fc8d95857c P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:47.894407 5606 ts_tablet_manager.cc:1950] T ab9ac0e6083343debabc043435c54d95 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:47.895592 5626 tablet_bootstrap.cc:492] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:47.896752 5626 ts_tablet_manager.cc:1403] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260927 13:49:47.897483 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 120) took 2182 ms. Trace:
W20260927 13:49:47.898046 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 825a73d47bff4246965be82eb482f7aa consensus state has no leader
I20260927 13:49:47.900380 5217 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e959f8c6fa74a1bbaf06d91c3e484bc) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.900595 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc612cbcd5d4755a188408f2a036f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.900768 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d3a3282d684415858dc971cb02eec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:43 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.901168 5628 tablet_bootstrap.cc:492] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:47.901371 5628 ts_tablet_manager.cc:1403] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.006s
I20260927 13:49:47.902215 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet f9b019bbec5d40609dbf1c556cc26a63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.902329 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 587471d2b7e647388e7bb1e7f8e06b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.902509 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 3663033220094a4ea6df8e2982eb2188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.902719 5217 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb5fdbfebd5401e92186997f9a30d36 with delete_type TABLET_DATA_DELETED (replaced by tablet 825a73d47bff4246965be82eb482f7aa) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.902748 5626 raft_consensus.cc:359] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.886063 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 142) took 1265 ms. Trace:
I20260927 13:49:47.903065 5606 rpcz_store.cc:276] 0927 13:49:45.715500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.716745 (+ 1245us) service_pool.cc:224] Handling call
0927 13:49:47.811569 (+2094824us) ts_tablet_manager.cc:1151] Deleting tablet ab9ac0e6083343debabc043435c54d95
0927 13:49:47.811580 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.827412 (+ 15832us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.837398 (+ 9986us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.897440 (+ 60042us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2089529}
I20260927 13:49:47.903060 5623 rpcz_store.cc:276] 0927 13:49:46.620627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.620680 (+ 53us) service_pool.cc:224] Handling call
0927 13:49:47.842701 (+1222021us) ts_tablet_manager.cc:1151] Deleting tablet e56df07d0a524e5184bdc7fc8d95857c
0927 13:49:47.842713 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.881294 (+ 38581us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.884658 (+ 3364us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.886012 (+ 1354us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1221752}
I20260927 13:49:47.903522 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet e56df07d0a524e5184bdc7fc8d95857c (table default.Table_5e60c258bac24c7cabc2b7e1e6052193 [id=a160103a454d421c8be6a88afa7c1419]) successfully deleted
I20260927 13:49:47.903925 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 143) took 1131 ms. Trace:
I20260927 13:49:47.904006 5623 rpcz_store.cc:276] 0927 13:49:46.772355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.772412 (+ 57us) service_pool.cc:224] Handling call
0927 13:49:47.903769 (+1131357us) ts_tablet_manager.cc:1151] Deleting tablet 0018704e08254c2e8d30c7067df4420c
0927 13:49:47.903778 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.903875 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1131134}
I20260927 13:49:47.904156 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet ab9ac0e6083343debabc043435c54d95 (table default.Table_b0efcc41c04d48689f399cff85ac589f [id=63d6c603fa31486b9e3ec4dcc74e0e57]) successfully deleted
I20260927 13:49:47.904248 5628 raft_consensus.cc:359] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.904451 5628 raft_consensus.cc:385] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 13:49:47.904453 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 0018704e08254c2e8d30c7067df4420c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0018704e08254c2e8d30c7067df4420c already in progress: creating tablet
I20260927 13:49:47.904524 5628 raft_consensus.cc:740] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.904844 5628 consensus_queue.cc:260] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.905123 5606 tablet_replica.cc:333] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:47.905395 5606 raft_consensus.cc:2243] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.902958 5626 raft_consensus.cc:385] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.905601 5626 raft_consensus.cc:740] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.905915 5626 consensus_queue.cc:260] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.906240 5606 raft_consensus.cc:2272] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:47.907900 5628 ts_tablet_manager.cc:1434] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 13:49:47.907372 5619 tablet_bootstrap.cc:492] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:47.908149 5619 ts_tablet_manager.cc:1403] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.086s user 0.009s sys 0.000s
I20260927 13:49:47.908208 5628 tablet_bootstrap.cc:492] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:47.911105 5626 ts_tablet_manager.cc:1434] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260927 13:49:47.911247 5606 ts_tablet_manager.cc:1916] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.911790 5626 tablet_bootstrap.cc:492] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:47.913151 5628 tablet_bootstrap.cc:654] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.911387 5619 raft_consensus.cc:359] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.913371 5619 raft_consensus.cc:385] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.913514 5619 raft_consensus.cc:740] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.913838 5619 consensus_queue.cc:260] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.917917 5619 ts_tablet_manager.cc:1434] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260927 13:49:47.922019 5619 tablet_bootstrap.cc:492] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:47.922327 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_fdf2135656604c40956e676bc740ab08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:47.922956 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdf2135656604c40956e676bc740ab08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.925108 5625 ts_tablet_manager.cc:1929] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.926812 5623 tablet_replica.cc:333] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:47.927101 5623 raft_consensus.cc:2243] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.927440 5625 log.cc:1199] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/7a4b7500f05e4b63b4d79fabde88ebe6
I20260927 13:49:47.927419 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_213d3c2f351b4190be9c4ff62131b280"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:47.927629 5619 tablet_bootstrap.cc:654] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.927752 5623 raft_consensus.cc:2272] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:47.927975 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_213d3c2f351b4190be9c4ff62131b280 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.928448 5625 ts_tablet_manager.cc:1950] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:47.929700 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 7a4b7500f05e4b63b4d79fabde88ebe6 (table default.Table_88c5377676df4e3fb778d2781ed7a546 [id=36caa6d3649b47efb7e95cab54ca2608]) successfully deleted
I20260927 13:49:47.930269 5623 ts_tablet_manager.cc:1916] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.932722 5626 tablet_bootstrap.cc:654] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:47.939024 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet df271399b2c84653ac4a5b74efdc0197 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.939124 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cb2864ea38b4a538884a2c728f08313 with delete_type TABLET_DATA_DELETED (replaced by tablet 0caf934bc99c4ad38eea5fc812b60931) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.939033 5217 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ba67436a544e98788e9c1b00a1c33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.940276 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet b95399b042654100a609427597d6fe72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:47.942536 5217 tablet_service.cc:1558] Processing DeleteTablet for tablet 2801473216a3475384d1494892b8df7b with delete_type TABLET_DATA_DELETED (replaced by tablet 72711f14f26a479c9699b172b41b1db0) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.942471 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_500153cc90d14773ba7a9cfdbcde81af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:47.943253 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_500153cc90d14773ba7a9cfdbcde81af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.943856 5619 tablet_bootstrap.cc:492] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:47.944034 5619 ts_tablet_manager.cc:1403] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.001s
I20260927 13:49:47.944795 5619 raft_consensus.cc:359] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.944998 5619 raft_consensus.cc:385] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.945082 5619 raft_consensus.cc:740] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.948262 5619 consensus_queue.cc:260] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.948662 5625 tablet_replica.cc:333] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:47.948936 5625 raft_consensus.cc:2243] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:47.949162 5625 raft_consensus.cc:2272] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:47.949759 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 321b26c89f1a4c8d88f401c8ece448b0 has no consensus state
I20260927 13:49:47.952618 5619 ts_tablet_manager.cc:1434] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
I20260927 13:49:47.949806 5625 ts_tablet_manager.cc:1916] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:47.953992 5619 tablet_bootstrap.cc:492] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:47.954104 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_22a8a2d3c05d409480ef5c85b521fa0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:47.954689 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22a8a2d3c05d409480ef5c85b521fa0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:47.957782 5727 raft_consensus.cc:493] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.957937 5727 raft_consensus.cc:515] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.958626 5727 leader_election.cc:290] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:47.959283 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc612cbcd5d4755a188408f2a036f34" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:47.959494 5385 raft_consensus.cc:2468] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:47.962924 5787 raft_consensus.cc:493] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.963078 5787 raft_consensus.cc:515] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:47.963688 5787 leader_election.cc:290] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.964437 5185 leader_election.cc:304] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:49:47.964860 5319 leader_election.cc:343] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: f9b019bbec5d40609dbf1c556cc26a63
I20260927 13:49:47.965181 5928 raft_consensus.cc:493] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.965337 5928 raft_consensus.cc:515] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.965950 5928 leader_election.cc:290] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:47.966789 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efee56b495340baa6dd51f0f3e2aaa7" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:47.967376 5045 leader_election.cc:343] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:47.967728 5184 leader_election.cc:343] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7dc612cbcd5d4755a188408f2a036f34
I20260927 13:49:47.968623 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efee56b495340baa6dd51f0f3e2aaa7" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:47.969946 5044 leader_election.cc:343] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:47.970070 5044 leader_election.cc:304] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:47.970763 5928 raft_consensus.cc:2749] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:47.971226 5319 leader_election.cc:343] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f9b019bbec5d40609dbf1c556cc26a63
I20260927 13:49:47.971365 5319 leader_election.cc:304] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:47.971637 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 6817fb4caf6a445b899830c6702bf911
I20260927 13:49:47.971837 5787 raft_consensus.cc:2749] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:47.972091 5727 raft_consensus.cc:2804] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:47.972150 4926 catalog_manager.cc:6934] ReplaceTablet: tablet 6817fb4caf6a445b899830c6702bf911 deleted and replaced by tablet 9bd182d7cb414f07944072b0c00ee35c
I20260927 13:49:47.972193 5727 raft_consensus.cc:493] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:47.972281 5727 raft_consensus.cc:3060] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.975122 5217 tablet_service.cc:1558] Processing DeleteTablet for tablet 6817fb4caf6a445b899830c6702bf911 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bd182d7cb414f07944072b0c00ee35c) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:47.975314 5727 raft_consensus.cc:515] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.975883 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 6817fb4caf6a445b899830c6702bf911 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bd182d7cb414f07944072b0c00ee35c) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:47.976217 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 6817fb4caf6a445b899830c6702bf911 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bd182d7cb414f07944072b0c00ee35c) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:47.977048 5184 leader_election.cc:343] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7dc612cbcd5d4755a188408f2a036f34
I20260927 13:49:47.977936 4926 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d6c46d0e50a44232a82d00c88d9f63b5 (table default.Table_abad46e19bc54aac8cf5415b2752c808 [id=e65860898b9041118d5fbb8b5aef2df4]). Expected version 1 got 0
I20260927 13:49:47.978013 5727 leader_election.cc:290] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:47.978749 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f749329ec19643379f5f81a6b895d21b" } new_table_name: "default.Table_6f968553a801422ba747b1d4516c2074" modify_external_catalogs: true
I20260927 13:49:47.980741 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc612cbcd5d4755a188408f2a036f34" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:47.980947 5385 raft_consensus.cc:3060] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.982547 5606 ts_tablet_manager.cc:1929] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.982761 5606 log.cc:1199] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/4fe6a7394da94edf87166a184a9a04ba
I20260927 13:49:47.983673 5626 tablet_bootstrap.cc:492] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:47.984422 5727 raft_consensus.cc:493] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:47.984578 5626 ts_tablet_manager.cc:1403] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.072s user 0.002s sys 0.004s
I20260927 13:49:47.984630 5727 raft_consensus.cc:515] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.985431 5626 raft_consensus.cc:359] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.985615 5626 raft_consensus.cc:385] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:47.985682 5626 raft_consensus.cc:740] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:47.985991 5626 consensus_queue.cc:260] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:47.986565 5184 leader_election.cc:343] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2801473216a3475384d1494892b8df7b
I20260927 13:49:47.987344 5727 leader_election.cc:290] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:47.990928 5626 ts_tablet_manager.cc:1434] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260927 13:49:47.983927 5385 raft_consensus.cc:2468] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:47.991506 5185 leader_election.cc:304] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
W20260927 13:49:47.991570 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2329b988f5d9410d96eca321a7b8f3a6 has no consensus state
I20260927 13:49:47.987597 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2801473216a3475384d1494892b8df7b" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:47.992040 5384 raft_consensus.cc:2468] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:47.992322 5623 ts_tablet_manager.cc:1929] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.992447 5623 log.cc:1199] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/7681d137476040788e40dd787ce74ccd
I20260927 13:49:47.992626 5185 leader_election.cc:304] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:47.992851 5623 ts_tablet_manager.cc:1950] T 7681d137476040788e40dd787ce74ccd P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:47.993012 5894 raft_consensus.cc:2804] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:47.993171 5894 raft_consensus.cc:697] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:47.993440 5894 consensus_queue.cc:237] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.993661 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 144) took 1220 ms. Trace:
I20260927 13:49:47.993780 5623 rpcz_store.cc:276] 0927 13:49:46.773399 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.773448 (+ 49us) service_pool.cc:224] Handling call
0927 13:49:47.926724 (+1153276us) ts_tablet_manager.cc:1151] Deleting tablet 7681d137476040788e40dd787ce74ccd
0927 13:49:47.926733 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.951969 (+ 25236us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.992218 (+ 40249us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.993619 (+ 1401us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1153096}
I20260927 13:49:47.994225 5995 raft_consensus.cc:2804] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:47.994364 5995 raft_consensus.cc:493] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:47.994445 5995 raft_consensus.cc:3060] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:47.997468 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d6c46d0e50a44232a82d00c88d9f63b5 (table default.Table_abad46e19bc54aac8cf5415b2752c808 [id=e65860898b9041118d5fbb8b5aef2df4]). Expected version 1 got 0
I20260927 13:49:47.997814 5995 raft_consensus.cc:515] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:47.998477 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 7681d137476040788e40dd787ce74ccd (table default.Table_f91dab3c58974becbe03c7d55f1a01d4 [id=a22a9a93ae2543e583d24dd648813233]) successfully deleted
W20260927 13:49:48.000707 5184 leader_election.cc:343] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2801473216a3475384d1494892b8df7b
I20260927 13:49:48.001670 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2801473216a3475384d1494892b8df7b" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:48.001890 5384 raft_consensus.cc:3060] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.004985 5384 raft_consensus.cc:2468] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:48.005590 5185 leader_election.cc:304] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:48.006049 5995 leader_election.cc:290] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:48.006430 5995 raft_consensus.cc:2804] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:48.006778 5995 raft_consensus.cc:697] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:48.008009 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_34e3d06c06ed4b90b3444e8c803d2e07" } modify_external_catalogs: true
I20260927 13:49:48.008188 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_34e3d06c06ed4b90b3444e8c803d2e07" } modify_external_catalogs: true
I20260927 13:49:48.008431 5995 consensus_queue.cc:237] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.010857 5626 tablet_bootstrap.cc:492] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:48.010912 5625 ts_tablet_manager.cc:1929] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:47.994252 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 149) took 1055 ms. Trace:
I20260927 13:49:48.011277 5623 rpcz_store.cc:276] 0927 13:49:46.938764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.939444 (+ 680us) service_pool.cc:224] Handling call
0927 13:49:47.994050 (+1054606us) ts_tablet_manager.cc:1151] Deleting tablet 8e959f8c6fa74a1bbaf06d91c3e484bc
0927 13:49:47.994058 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.994216 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1054379}
I20260927 13:49:48.011773 5625 log.cc:1199] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/dce1bbbe9dbb443c9f0c001107ffebdf
I20260927 13:49:48.012140 5625 ts_tablet_manager.cc:1950] T dce1bbbe9dbb443c9f0c001107ffebdf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:48.012549 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e959f8c6fa74a1bbaf06d91c3e484bc already in progress: creating tablet
I20260927 13:49:48.012706 5626 tablet_bootstrap.cc:654] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.013053 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 151) took 1067 ms. Trace:
I20260927 13:49:48.014194 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet dce1bbbe9dbb443c9f0c001107ffebdf (table default.Table_62b8129916de4fdeaddae3de476de360 [id=f6be2f3e0bb749108e056578f8d3cd75]) successfully deleted
I20260927 13:49:48.014493 5623 rpcz_store.cc:276] 0927 13:49:46.945163 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.945263 (+ 100us) service_pool.cc:224] Handling call
0927 13:49:48.012897 (+1067634us) ts_tablet_manager.cc:1151] Deleting tablet a3b1d54e4af0432f9d1ef9879d2ec4e9
0927 13:49:48.012907 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.013013 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1067422}
W20260927 13:49:48.015012 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 already in progress: creating tablet
I20260927 13:49:48.015162 5619 tablet_bootstrap.cc:654] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.015461 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 153) took 1007 ms. Trace:
I20260927 13:49:48.015611 5623 rpcz_store.cc:276] 0927 13:49:47.007837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.007962 (+ 125us) service_pool.cc:224] Handling call
0927 13:49:48.015325 (+1007363us) ts_tablet_manager.cc:1151] Deleting tablet c7670d5f54df49f4a074588ab9269145
0927 13:49:48.015335 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.015431 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1007168}
W20260927 13:49:48.016016 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 129c2f99d5b143b3bd25731cfeb0009e consensus state has no leader
I20260927 13:49:48.016113 5606 ts_tablet_manager.cc:1950] T 4fe6a7394da94edf87166a184a9a04ba P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:49:48.016371 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet c7670d5f54df49f4a074588ab9269145 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7670d5f54df49f4a074588ab9269145 already in progress: creating tablet
I20260927 13:49:48.016865 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 124) took 2102 ms. Trace:
W20260927 13:49:48.017037 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 24bf9abe277040078eb765728e3c52ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24bf9abe277040078eb765728e3c52ef already in progress: creating tablet
I20260927 13:49:48.017266 5625 tablet_replica.cc:333] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.017282 5606 rpcz_store.cc:276] 0927 13:49:45.914330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.919849 (+ 5519us) service_pool.cc:224] Handling call
0927 13:49:47.905057 (+1985208us) ts_tablet_manager.cc:1151] Deleting tablet 4fe6a7394da94edf87166a184a9a04ba
0927 13:49:47.905070 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:47.937135 (+ 32065us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:47.982469 (+ 45334us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.016807 (+ 34338us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1984899}
I20260927 13:49:48.017645 5625 raft_consensus.cc:2243] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.017737 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 4fe6a7394da94edf87166a184a9a04ba (table default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]) successfully deleted
W20260927 13:49:48.018254 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 66524dd4f62f4da4be845d5efefe8db1 because the tablet was not found. No further retry: Not found: Tablet not found: 66524dd4f62f4da4be845d5efefe8db1
I20260927 13:49:48.018551 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 125) took 2103 ms. Trace:
I20260927 13:49:48.018603 5625 raft_consensus.cc:2272] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.018872 5623 tablet_replica.cc:333] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:48.019138 5623 raft_consensus.cc:2243] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:48.019134 5606 rpcz_store.cc:276] 0927 13:49:45.915089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:45.928458 (+ 13369us) service_pool.cc:224] Handling call
0927 13:49:48.018385 (+2089927us) ts_tablet_manager.cc:1151] Deleting tablet 7a4b7500f05e4b63b4d79fabde88ebe6
0927 13:49:48.018395 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.018500 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2089249}
W20260927 13:49:48.019613 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a4b7500f05e4b63b4d79fabde88ebe6 already in progress: creating tablet
I20260927 13:49:48.020056 5623 raft_consensus.cc:2272] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.020386 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 129) took 2000 ms. Trace:
I20260927 13:49:48.020475 5606 rpcz_store.cc:276] 0927 13:49:46.020409 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.020648 (+ 239us) service_pool.cc:224] Handling call
0927 13:49:48.020230 (+1999582us) ts_tablet_manager.cc:1151] Deleting tablet 910b73528ed949bc86badcc4cf6c74a3
0927 13:49:48.020239 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.020338 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1907378}
I20260927 13:49:48.020705 5625 ts_tablet_manager.cc:1916] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:48.020855 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 910b73528ed949bc86badcc4cf6c74a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 910b73528ed949bc86badcc4cf6c74a3 already in progress: creating tablet
I20260927 13:49:48.021418 5623 ts_tablet_manager.cc:1916] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.024629 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_dbe657f659e24156b29a259c4b995402" } modify_external_catalogs: true
I20260927 13:49:48.024845 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_dbe657f659e24156b29a259c4b995402" } modify_external_catalogs: true
I20260927 13:49:48.029701 5628 tablet_bootstrap.cc:492] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.029878 5628 ts_tablet_manager.cc:1403] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.122s user 0.002s sys 0.002s
W20260927 13:49:48.030243 4917 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2329b988f5d9410d96eca321a7b8f3a6 (table default.Table_812430ef8c1c4462ae6a6663805f50b8 [id=24cbb4b2dc904080a522c768da9ebe68], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2329b988f5d9410d96eca321a7b8f3a6 has no consensus state
I20260927 13:49:48.031083 5628 raft_consensus.cc:359] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.031363 5628 raft_consensus.cc:385] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.031359 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet d2e0b4c217ca41b98013155b8d952fe6
I20260927 13:49:48.031512 5628 raft_consensus.cc:740] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.031944 4923 catalog_manager.cc:6934] ReplaceTablet: tablet d2e0b4c217ca41b98013155b8d952fe6 deleted and replaced by tablet 0361e3b244a1437b8e402dd8602528fe
I20260927 13:49:48.031912 5628 consensus_queue.cc:260] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.032210 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet b64d3aa052bf4c48b3802f6006cce9c9 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.034757 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet d2e0b4c217ca41b98013155b8d952fe6 with delete_type TABLET_DATA_DELETED (replaced by tablet 0361e3b244a1437b8e402dd8602528fe) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.035279 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet d2e0b4c217ca41b98013155b8d952fe6 with delete_type TABLET_DATA_DELETED (replaced by tablet 0361e3b244a1437b8e402dd8602528fe) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.035502 5628 ts_tablet_manager.cc:1434] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 13:49:48.035562 5217 tablet_service.cc:1558] Processing DeleteTablet for tablet d2e0b4c217ca41b98013155b8d952fe6 with delete_type TABLET_DATA_DELETED (replaced by tablet 0361e3b244a1437b8e402dd8602528fe) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.035800 5628 tablet_bootstrap.cc:492] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.037616 5628 tablet_bootstrap.cc:654] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.042789 5606 tablet_replica.cc:333] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:48.043092 5606 raft_consensus.cc:2243] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.043395 5606 raft_consensus.cc:2272] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.044322 5606 ts_tablet_manager.cc:1916] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.051573 5619 tablet_bootstrap.cc:492] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:48.051645 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ee17c48a3ba7447594c552e6d7f13b1a" } modify_external_catalogs: true
I20260927 13:49:48.051800 5619 ts_tablet_manager.cc:1403] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.098s user 0.004s sys 0.000s
I20260927 13:49:48.051859 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ee17c48a3ba7447594c552e6d7f13b1a" } modify_external_catalogs: true
I20260927 13:49:48.052600 5619 raft_consensus.cc:359] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.052786 5619 raft_consensus.cc:385] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.052877 5619 raft_consensus.cc:740] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:49:48.055591 5319 consensus_peers.cc:597] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7681d137476040788e40dd787ce74ccd. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:48.056432 5626 tablet_bootstrap.cc:492] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:48.056787 5626 ts_tablet_manager.cc:1403] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.004s
I20260927 13:49:48.057063 5619 consensus_queue.cc:260] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.058635 5626 raft_consensus.cc:359] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.061226 4928 master_service.cc:960] ReplaceTablet: received request to replace tablet 2efee56b495340baa6dd51f0f3e2aaa7 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.065516 5619 ts_tablet_manager.cc:1434] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260927 13:49:48.066231 5619 tablet_bootstrap.cc:492] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:48.068471 5619 tablet_bootstrap.cc:654] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.069617 5628 tablet_bootstrap.cc:492] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.069851 5628 ts_tablet_manager.cc:1403] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20260927 13:49:48.071180 5628 raft_consensus.cc:359] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:48.071493 5628 raft_consensus.cc:385] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.071622 5628 raft_consensus.cc:740] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.071979 5628 consensus_queue.cc:260] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:48.076538 5628 ts_tablet_manager.cc:1434] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260927 13:49:48.080008 5628 tablet_bootstrap.cc:492] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.080935 5626 raft_consensus.cc:385] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.081175 5626 raft_consensus.cc:740] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.084033 5625 ts_tablet_manager.cc:1929] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.082511 5626 consensus_queue.cc:260] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.088152 5625 log.cc:1199] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/0018704e08254c2e8d30c7067df4420c
I20260927 13:49:48.088708 5625 ts_tablet_manager.cc:1950] T 0018704e08254c2e8d30c7067df4420c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:48.088876 5319 consensus_peers.cc:597] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b6ff9ddb6664a5a867ac0f64ac1e9a2. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:48.089952 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 0018704e08254c2e8d30c7067df4420c (table default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
I20260927 13:49:48.071269 5623 ts_tablet_manager.cc:1929] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:48.090402 5623 log.cc:1199] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/4295710c33714360b3691f48f47f4293
I20260927 13:49:48.090691 5625 tablet_replica.cc:333] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.092720 5625 raft_consensus.cc:2243] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.093168 5623 ts_tablet_manager.cc:1950] T 4295710c33714360b3691f48f47f4293 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:48.093423 5625 raft_consensus.cc:2272] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.094666 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 4295710c33714360b3691f48f47f4293 (table default.Table_97bdee39a93e4f98ae6382e7ab44eda7 [id=2fe2768ea9264c38973e4ed5206c77f2]) successfully deleted
I20260927 13:49:48.095021 5628 tablet_bootstrap.cc:654] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.095530 5625 ts_tablet_manager.cc:1916] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.095845 5626 ts_tablet_manager.cc:1434] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.038s user 0.004s sys 0.000s
I20260927 13:49:48.097333 5626 tablet_bootstrap.cc:492] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:48.099184 5626 tablet_bootstrap.cc:654] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:48.101277 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 7e6721aa2fa0437eae7ca052c19f0f2e because the tablet was not found. No further retry: Not found: Tablet not found: 7e6721aa2fa0437eae7ca052c19f0f2e
I20260927 13:49:48.101480 4927 master_service.cc:960] ReplaceTablet: received request to replace tablet c7670d5f54df49f4a074588ab9269145 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.102083 5606 ts_tablet_manager.cc:1929] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.102017 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_db70ad184fab4e5984d1777fecae5518"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.103392 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db70ad184fab4e5984d1777fecae5518 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:48.106633 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 399d6411d8ad4354b3c0f8f4d78779a9 because the tablet was not found. No further retry: Not found: Tablet not found: 399d6411d8ad4354b3c0f8f4d78779a9
W20260927 13:49:48.107234 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 8b8b80eb00244f7cbcc260af06c16a52 because the tablet was not found. No further retry: Not found: Tablet not found: 8b8b80eb00244f7cbcc260af06c16a52
W20260927 13:49:48.107776 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 32fa23c312544fac8ef485a35e5ab972 because the tablet was not found. No further retry: Not found: Tablet not found: 32fa23c312544fac8ef485a35e5ab972
I20260927 13:49:48.103132 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet df271399b2c84653ac4a5b74efdc0197 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.108074 5623 tablet_replica.cc:333] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:48.108274 5623 raft_consensus.cc:2243] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.108474 5623 raft_consensus.cc:2272] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.108299 5606 log.cc:1199] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/54fb19fb86ea43b0b81d6d42ce2d8a5f
I20260927 13:49:48.109362 5606 ts_tablet_manager.cc:1950] T 54fb19fb86ea43b0b81d6d42ce2d8a5f P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:48.109434 5623 ts_tablet_manager.cc:1916] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.111680 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 130) took 2091 ms. Trace:
I20260927 13:49:48.112452 5626 tablet_bootstrap.cc:492] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:48.113408 5628 tablet_bootstrap.cc:492] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.113652 5626 ts_tablet_manager.cc:1403] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.003s
I20260927 13:49:48.116240 5606 rpcz_store.cc:276] 0927 13:49:46.020581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.020871 (+ 290us) service_pool.cc:224] Handling call
0927 13:49:48.042689 (+2021818us) ts_tablet_manager.cc:1151] Deleting tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f
0927 13:49:48.042704 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.048634 (+ 5930us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.101984 (+ 53350us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.111641 (+ 9657us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1929765}
I20260927 13:49:48.116768 5628 ts_tablet_manager.cc:1403] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.003s
I20260927 13:49:48.117309 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 131) took 2086 ms. Trace:
I20260927 13:49:48.118474 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 54fb19fb86ea43b0b81d6d42ce2d8a5f (table default.Table_fafb083bcf954f6b91e326a7ca8ff4ee [id=0d47daf95d4b40e2862f1b897b210232]) successfully deleted
I20260927 13:49:48.118768 5623 ts_tablet_manager.cc:1929] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260927 13:49:48.118781 5628 raft_consensus.cc:359] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.118889 5623 log.cc:1199] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/70d1197bee2d477ab77d15cbd4907595
I20260927 13:49:48.118958 5628 raft_consensus.cc:385] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.119333 5623 ts_tablet_manager.cc:1950] T 70d1197bee2d477ab77d15cbd4907595 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:48.120342 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 70d1197bee2d477ab77d15cbd4907595 (table default.Table_dfa3b09930634e67ba11591b71147d46 [id=bed97aef149a417bb3807414f58ba52a]) successfully deleted
I20260927 13:49:48.116314 5625 ts_tablet_manager.cc:1929] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.120617 5625 log.cc:1199] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/d9b04383cb494f65be7ba507a0f0b441
I20260927 13:49:48.120983 5625 ts_tablet_manager.cc:1950] T d9b04383cb494f65be7ba507a0f0b441 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.121776 5606 rpcz_store.cc:276] 0927 13:49:46.031019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.031126 (+ 107us) service_pool.cc:224] Handling call
0927 13:49:48.117151 (+2086025us) ts_tablet_manager.cc:1151] Deleting tablet dff5992b27f049f5890e65d5a8dcc3cf
0927 13:49:48.117162 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.117276 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2004191}
I20260927 13:49:48.121984 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet d9b04383cb494f65be7ba507a0f0b441 (table default.Table_f2d64a3ffe674d5ebbab910acdf51b20 [id=d30e7ed235504af3a53544c14e35b456]) successfully deleted
I20260927 13:49:48.122349 5625 tablet_replica.cc:333] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.122547 5625 raft_consensus.cc:2243] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.122977 5625 raft_consensus.cc:2272] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.123020 5619 tablet_bootstrap.cc:492] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
W20260927 13:49:48.123083 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet dff5992b27f049f5890e65d5a8dcc3cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff5992b27f049f5890e65d5a8dcc3cf already in progress: creating tablet
I20260927 13:49:48.123188 5619 ts_tablet_manager.cc:1403] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.000s
I20260927 13:49:48.123519 5625 ts_tablet_manager.cc:1916] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.124025 5928 raft_consensus.cc:493] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.124186 5928 raft_consensus.cc:515] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.124924 5928 leader_election.cc:290] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.126044 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0004ef0b2dd841ac860798d804374dc1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:48.126549 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0004ef0b2dd841ac860798d804374dc1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:48.127318 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_15df8518ff4f446cadb3f1c389a17954" } modify_external_catalogs: true
I20260927 13:49:48.127512 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_15df8518ff4f446cadb3f1c389a17954" } modify_external_catalogs: true
W20260927 13:49:48.127763 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b783ffbf2a05453fa43797ce495f8e7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b783ffbf2a05453fa43797ce495f8e7a already in progress: creating tablet
W20260927 13:49:48.127789 5045 leader_election.cc:343] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:48.128223 5044 leader_election.cc:343] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.128345 5044 leader_election.cc:304] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:48.128430 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 0004ef0b2dd841ac860798d804374dc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0004ef0b2dd841ac860798d804374dc1 already in progress: creating tablet
I20260927 13:49:48.128862 5928 raft_consensus.cc:2749] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:48.128984 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet f5bf9ba5d857421ebc783d4c567f411c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5bf9ba5d857421ebc783d4c567f411c already in progress: creating tablet
W20260927 13:49:48.129592 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a6af740383384609a354d7f0fae2cd70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6af740383384609a354d7f0fae2cd70 already in progress: creating tablet
W20260927 13:49:48.130261 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet c989f70385f64593a46f633c98267627 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c989f70385f64593a46f633c98267627 already in progress: creating tablet
W20260927 13:49:48.130877 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2999bd61907847938975a6232e3899e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2999bd61907847938975a6232e3899e4 already in progress: creating tablet
I20260927 13:49:48.131155 5619 raft_consensus.cc:359] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.131429 5619 raft_consensus.cc:385] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 13:49:48.131405 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2 because the tablet was not found. No further retry: Not found: Tablet not found: 9b6ff9ddb6664a5a867ac0f64ac1e9a2
I20260927 13:49:48.131572 5619 raft_consensus.cc:740] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.131731 5623 tablet_replica.cc:333] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:48.132004 5623 raft_consensus.cc:2243] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:48.131935 5619 consensus_queue.cc:260] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.132323 5623 pending_rounds.cc:70] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:48.132457 5623 pending_rounds.cc:77] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957582823768064 op_type: NO_OP noop_request { }
I20260927 13:49:48.133291 5623 raft_consensus.cc:2889] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:48.133488 5623 raft_consensus.cc:2272] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:48.134285 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ce893441d5e4d9f89743e75eb762276 has no consensus state
I20260927 13:49:48.136484 5625 ts_tablet_manager.cc:1929] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.136826 5625 log.cc:1199] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/77f549f487ea4dbb8c7fceee6f8a6db0
I20260927 13:49:48.137281 5625 ts_tablet_manager.cc:1950] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.137454 5623 ts_tablet_manager.cc:1916] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.137805 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_33b78a7e92ec433d8ca4472fdb03f35c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.138568 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33b78a7e92ec433d8ca4472fdb03f35c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.138535 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 77f549f487ea4dbb8c7fceee6f8a6db0 (table default.Table_db24dbfc253c4e76ab35b8bb7770eb8b [id=3b60feafc4a7467b8e301307adaa8187]) successfully deleted
W20260927 13:49:48.139892 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 4295710c33714360b3691f48f47f4293 because the tablet was not found. No further retry: Not found: Tablet not found: 4295710c33714360b3691f48f47f4293
I20260927 13:49:48.140079 5384 raft_consensus.cc:3060] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.139128 5625 tablet_replica.cc:333] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.140489 5625 raft_consensus.cc:2243] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.140653 5625 raft_consensus.cc:2272] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.141209 5625 ts_tablet_manager.cc:1916] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.143882 5623 ts_tablet_manager.cc:1929] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:48.144014 5623 log.cc:1199] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/7dc612cbcd5d4755a188408f2a036f34
I20260927 13:49:48.144564 5623 ts_tablet_manager.cc:1950] T 7dc612cbcd5d4755a188408f2a036f34 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:48.145545 5623 tablet_replica.cc:333] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:48.145576 5995 consensus_queue.cc:1048] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:48.145767 5623 raft_consensus.cc:2243] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.145740 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 7dc612cbcd5d4755a188408f2a036f34 (table default.Table_6f09b6613d87411faca990bffef9d028 [id=7f846a3fd7cf4362870ca0e938dd45bd]) successfully deleted
I20260927 13:49:48.145911 5623 raft_consensus.cc:2272] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.149309 5625 ts_tablet_manager.cc:1929] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.149538 5625 log.cc:1199] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/0004ef0b2dd841ac860798d804374dc1
I20260927 13:49:48.149969 5625 ts_tablet_manager.cc:1950] T 0004ef0b2dd841ac860798d804374dc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.151242 4921 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (table default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]). Expected version 1 got 0
I20260927 13:49:48.154733 5623 ts_tablet_manager.cc:1916] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.155362 5619 ts_tablet_manager.cc:1434] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.032s user 0.002s sys 0.001s
I20260927 13:49:48.155849 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 4abe721ef8614d86870a0526de69014f (DEFAULT_TABLE table=default.Table_15df8518ff4f446cadb3f1c389a17954 [id=fcaf2809390c4d6c9dd836f5bfdacf40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.156231 5619 tablet_bootstrap.cc:492] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:48.156299 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abe721ef8614d86870a0526de69014f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.156554 5626 raft_consensus.cc:359] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.156996 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 351132ca12924a35910ca5473696a02f (DEFAULT_TABLE table=default.Table_060df9c137224b90b29c16e43fce88ef [id=9f535502ed1745438ed8e3292ebec99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.157405 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351132ca12924a35910ca5473696a02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.158403 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 17153df5ba20458aa0a5c0297e959810 (DEFAULT_TABLE table=default.Table_444ab715a6674d1d9088f289fbb20fb6 [id=ac8977fb4dd34fa48e02d04b2053a1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.158767 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17153df5ba20458aa0a5c0297e959810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.158988 5619 tablet_bootstrap.cc:654] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.160679 5606 tablet_replica.cc:333] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:48.160915 5606 raft_consensus.cc:2243] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.161087 5606 raft_consensus.cc:2272] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.156796 5626 raft_consensus.cc:385] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.161568 5626 raft_consensus.cc:740] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.161854 5626 consensus_queue.cc:260] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.162448 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 351132ca12924a35910ca5473696a02f (DEFAULT_TABLE table=default.Table_060df9c137224b90b29c16e43fce88ef [id=9f535502ed1745438ed8e3292ebec99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.119046 5628 raft_consensus.cc:740] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.162817 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351132ca12924a35910ca5473696a02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.165266 5928 raft_consensus.cc:493] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.165429 5928 raft_consensus.cc:515] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:48.166188 5928 leader_election.cc:290] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:48.166495 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 17153df5ba20458aa0a5c0297e959810 (DEFAULT_TABLE table=default.Table_444ab715a6674d1d9088f289fbb20fb6 [id=ac8977fb4dd34fa48e02d04b2053a1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.166882 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17153df5ba20458aa0a5c0297e959810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.167317 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fc2734e88e431facdf72e9ef136106" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:48.167959 5044 leader_election.cc:343] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.168929 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fc2734e88e431facdf72e9ef136106" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:48.169556 5045 leader_election.cc:343] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.169674 5045 leader_election.cc:304] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:48.170241 5928 raft_consensus.cc:2749] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:48.170488 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 4abe721ef8614d86870a0526de69014f (DEFAULT_TABLE table=default.Table_15df8518ff4f446cadb3f1c389a17954 [id=fcaf2809390c4d6c9dd836f5bfdacf40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.170848 5626 ts_tablet_manager.cc:1434] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.057s user 0.000s sys 0.002s
I20260927 13:49:48.170886 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abe721ef8614d86870a0526de69014f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.171182 5626 tablet_bootstrap.cc:492] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:48.172093 5628 consensus_queue.cc:260] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.174561 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 351132ca12924a35910ca5473696a02f (DEFAULT_TABLE table=default.Table_060df9c137224b90b29c16e43fce88ef [id=9f535502ed1745438ed8e3292ebec99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.175046 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351132ca12924a35910ca5473696a02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.175480 5628 ts_tablet_manager.cc:1434] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.058s user 0.002s sys 0.000s
I20260927 13:49:48.175693 5606 ts_tablet_manager.cc:1916] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.162063 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 4abe721ef8614d86870a0526de69014f (DEFAULT_TABLE table=default.Table_15df8518ff4f446cadb3f1c389a17954 [id=fcaf2809390c4d6c9dd836f5bfdacf40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.192148 5995 raft_consensus.cc:493] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.192351 5995 raft_consensus.cc:515] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.193169 5995 leader_election.cc:290] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:48.194569 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e0b4c217ca41b98013155b8d952fe6" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:48.194805 5109 raft_consensus.cc:2468] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:48.195326 5184 leader_election.cc:304] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:48.196187 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e0b4c217ca41b98013155b8d952fe6" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:48.196796 5185 leader_election.cc:343] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.197213 5995 raft_consensus.cc:2804] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:48.197325 5995 raft_consensus.cc:493] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:48.197409 5995 raft_consensus.cc:3060] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.200865 5995 raft_consensus.cc:515] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.202342 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e0b4c217ca41b98013155b8d952fe6" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
W20260927 13:49:48.202909 5185 leader_election.cc:343] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.203799 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e0b4c217ca41b98013155b8d952fe6" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:48.203991 5109 raft_consensus.cc:3060] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.205228 5928 raft_consensus.cc:493] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.205420 5928 raft_consensus.cc:515] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.206797 5928 leader_election.cc:290] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.207540 5109 raft_consensus.cc:2468] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:48.208002 5184 leader_election.cc:304] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:48.208328 5894 raft_consensus.cc:2804] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:48.208457 5894 raft_consensus.cc:697] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:48.208756 5894 consensus_queue.cc:237] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.209029 5727 raft_consensus.cc:493] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.209173 5727 raft_consensus.cc:515] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.210804 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 17153df5ba20458aa0a5c0297e959810 (DEFAULT_TABLE table=default.Table_444ab715a6674d1d9088f289fbb20fb6 [id=ac8977fb4dd34fa48e02d04b2053a1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.211231 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17153df5ba20458aa0a5c0297e959810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.211149 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 2329b988f5d9410d96eca321a7b8f3a6 (DEFAULT_TABLE table=default.Table_812430ef8c1c4462ae6a6663805f50b8 [id=24cbb4b2dc904080a522c768da9ebe68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.211795 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2329b988f5d9410d96eca321a7b8f3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.213374 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95399b042654100a609427597d6fe72" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:48.213604 5382 raft_consensus.cc:2468] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:48.215341 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ce37d4abf4b92af22b46654b86ba5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:48.216423 5045 leader_election.cc:343] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.216457 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 2329b988f5d9410d96eca321a7b8f3a6 (DEFAULT_TABLE table=default.Table_812430ef8c1c4462ae6a6663805f50b8 [id=24cbb4b2dc904080a522c768da9ebe68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.216857 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2329b988f5d9410d96eca321a7b8f3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.216882 5891 raft_consensus.cc:493] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.217280 5891 raft_consensus.cc:515] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.217628 5727 leader_election.cc:290] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:48.217945 5891 leader_election.cc:290] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:48.218487 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ce37d4abf4b92af22b46654b86ba5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:48.218775 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 2329b988f5d9410d96eca321a7b8f3a6 (DEFAULT_TABLE table=default.Table_812430ef8c1c4462ae6a6663805f50b8 [id=24cbb4b2dc904080a522c768da9ebe68]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:48.219091 5184 leader_election.cc:343] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b95399b042654100a609427597d6fe72
I20260927 13:49:48.220160 5185 leader_election.cc:304] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:48.220829 5623 ts_tablet_manager.cc:1929] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.220952 5891 raft_consensus.cc:2804] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:48.221056 5891 raft_consensus.cc:493] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:48.221179 5891 raft_consensus.cc:3060] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.221259 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2329b988f5d9410d96eca321a7b8f3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.224418 5891 raft_consensus.cc:515] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.220978 5623 log.cc:1199] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/14d3a3282d684415858dc971cb02eec1
I20260927 13:49:48.225011 5727 raft_consensus.cc:493] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.225154 5727 raft_consensus.cc:515] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.225315 5623 ts_tablet_manager.cc:1950] T 14d3a3282d684415858dc971cb02eec1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:48.225871 5727 leader_election.cc:290] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:48.226512 5623 tablet_replica.cc:333] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:48.226730 5623 raft_consensus.cc:2243] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.226814 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abe721ef8614d86870a0526de69014f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.226934 5623 raft_consensus.cc:2272] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.227470 5623 ts_tablet_manager.cc:1916] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:48.230268 5044 leader_election.cc:343] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.231315 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 559ac90ef36d406881dc17ade0560044 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.231719 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559ac90ef36d406881dc17ade0560044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.234380 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 14d3a3282d684415858dc971cb02eec1 (table default.Table_4333e4f147f24db68f8d26c70e28f4a4 [id=ff8466657bb24dd18b44b8d901412d8b]) successfully deleted
I20260927 13:49:48.235188 5891 leader_election.cc:290] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:48.235384 5044 leader_election.cc:304] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:48.237299 5319 consensus_peers.cc:597] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7681d137476040788e40dd787ce74ccd. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:48.237937 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95399b042654100a609427597d6fe72" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:48.238201 5383 raft_consensus.cc:3060] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.241257 5383 raft_consensus.cc:2468] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:48.237937 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85805d532ffa4c79974ce25041a72205" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:48.241590 5382 raft_consensus.cc:2468] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:48.241734 5185 leader_election.cc:304] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:48.242079 5185 leader_election.cc:304] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:48.242452 5727 raft_consensus.cc:2804] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:48.242903 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df271399b2c84653ac4a5b74efdc0197" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:48.242949 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet f9b019bbec5d40609dbf1c556cc26a63 because the tablet was not found. No further retry: Not found: Tablet not found: f9b019bbec5d40609dbf1c556cc26a63
I20260927 13:49:48.243541 5384 raft_consensus.cc:2468] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:48.244083 5185 leader_election.cc:304] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:48.245692 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2bf1c8729308443bba92997d06f84e9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.249255 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bf1c8729308443bba92997d06f84e9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.249564 5891 raft_consensus.cc:2804] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:48.249683 5891 raft_consensus.cc:493] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:48.249781 5891 raft_consensus.cc:3060] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.252664 5891 raft_consensus.cc:515] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.257560 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 559ac90ef36d406881dc17ade0560044 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.258169 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559ac90ef36d406881dc17ade0560044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.260149 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 63a1fca938c34718ae541f0038b56025 (DEFAULT_TABLE table=default.Table_69a87aa5933f49eaaa3085e0b505f5ca [id=97c4d9da0cc54c3d842a2001313e9a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.260555 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a1fca938c34718ae541f0038b56025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.268040 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 195ce37d4abf4b92af22b46654b86ba5
I20260927 13:49:48.269888 5891 leader_election.cc:290] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:48.262758 5995 leader_election.cc:290] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:48.273948 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ba67436a544e98788e9c1b00a1c33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.273880 5365 tablet_service.cc:1511] Processing CreateTablet for tablet f70b70eb29cb4361a12ed393eabb82e1 (DEFAULT_TABLE table=default.Table_80d468d713554a8fb3b781794b43157a [id=18b81e3d511942b38a609e5f9552b4d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.274787 5626 tablet_bootstrap.cc:654] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.275008 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70b70eb29cb4361a12ed393eabb82e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.277354 5891 raft_consensus.cc:2804] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:48.277468 5891 raft_consensus.cc:493] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:48.277587 5891 raft_consensus.cc:3060] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.280880 5891 raft_consensus.cc:515] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.281658 5891 leader_election.cc:290] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:48.281862 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 63a1fca938c34718ae541f0038b56025 (DEFAULT_TABLE table=default.Table_69a87aa5933f49eaaa3085e0b505f5ca [id=97c4d9da0cc54c3d842a2001313e9a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.282347 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a1fca938c34718ae541f0038b56025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.283524 5928 raft_consensus.cc:493] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.283618 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 195ce37d4abf4b92af22b46654b86ba5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.285611 5628 tablet_bootstrap.cc:492] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.286191 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 559ac90ef36d406881dc17ade0560044 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.268733 5623 ts_tablet_manager.cc:1929] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.269019 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 195ce37d4abf4b92af22b46654b86ba5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.288146 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 63a1fca938c34718ae541f0038b56025 (DEFAULT_TABLE table=default.Table_69a87aa5933f49eaaa3085e0b505f5ca [id=97c4d9da0cc54c3d842a2001313e9a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.288757 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 195ce37d4abf4b92af22b46654b86ba5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.289907 5928 raft_consensus.cc:515] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.290454 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ee4b85ee72994fe596598538d6755252" } modify_external_catalogs: true
I20260927 13:49:48.290910 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559ac90ef36d406881dc17ade0560044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.293319 6043 raft_consensus.cc:493] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.293537 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2999bd61907847938975a6232e3899e4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:48.294230 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85805d532ffa4c79974ce25041a72205" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:48.294902 5928 leader_election.cc:290] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.294888 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a1fca938c34718ae541f0038b56025. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:48.295939 5045 leader_election.cc:343] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.294878 6043 raft_consensus.cc:515] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.297102 5107 raft_consensus.cc:2468] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:48.298148 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2efee56b495340baa6dd51f0f3e2aaa7
I20260927 13:49:48.298719 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d930205241084c7b957ca0983bfb037f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.299342 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d930205241084c7b957ca0983bfb037f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.301749 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ee4b85ee72994fe596598538d6755252" } modify_external_catalogs: true
I20260927 13:49:48.301951 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b8d6958e6f44d3a98ed96d89d4c1b4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:48.302268 4928 catalog_manager.cc:6934] ReplaceTablet: tablet 2efee56b495340baa6dd51f0f3e2aaa7 deleted and replaced by tablet 5e3fa4870d5547a2bbffe1745b964504
I20260927 13:49:48.302383 5619 tablet_bootstrap.cc:492] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:48.303193 5928 raft_consensus.cc:2749] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:48.304155 5045 leader_election.cc:343] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.306283 5619 ts_tablet_manager.cc:1403] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.150s user 0.001s sys 0.004s
I20260927 13:49:48.306445 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 0004ef0b2dd841ac860798d804374dc1 (table default.Table_5f2f268fd879476db40bf7a96885d2a5 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]) successfully deleted
I20260927 13:49:48.307121 5619 raft_consensus.cc:359] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.303119 6043 leader_election.cc:290] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.307317 5619 raft_consensus.cc:385] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.307405 5619 raft_consensus.cc:740] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.307849 5619 consensus_queue.cc:260] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.309830 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85805d532ffa4c79974ce25041a72205" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:48.312032 5619 ts_tablet_manager.cc:1434] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:49:48.312388 5619 tablet_bootstrap.cc:492] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:48.303877 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 2efee56b495340baa6dd51f0f3e2aaa7 with delete_type TABLET_DATA_DELETED (replaced by tablet 5e3fa4870d5547a2bbffe1745b964504) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.315907 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 2efee56b495340baa6dd51f0f3e2aaa7 with delete_type TABLET_DATA_DELETED (replaced by tablet 5e3fa4870d5547a2bbffe1745b964504) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.325162 5628 tablet_bootstrap.cc:654] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.325138 5107 raft_consensus.cc:3060] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.325093 5625 tablet_replica.cc:333] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.327450 5625 raft_consensus.cc:2243] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.327728 5625 raft_consensus.cc:2272] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.329099 5107 raft_consensus.cc:2468] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:48.329934 5606 ts_tablet_manager.cc:1929] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.330479 5625 ts_tablet_manager.cc:1916] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.330706 5606 log.cc:1199] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/f9b019bbec5d40609dbf1c556cc26a63
I20260927 13:49:48.331604 5606 ts_tablet_manager.cc:1950] T f9b019bbec5d40609dbf1c556cc26a63 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:48.333702 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 132) took 2301 ms. Trace:
I20260927 13:49:48.336764 5606 rpcz_store.cc:276] 0927 13:49:46.031884 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.031943 (+ 59us) service_pool.cc:224] Handling call
0927 13:49:48.160605 (+2128662us) ts_tablet_manager.cc:1151] Deleting tablet f9b019bbec5d40609dbf1c556cc26a63
0927 13:49:48.160618 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.291688 (+131070us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.329851 (+ 38163us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.333640 (+ 3789us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2047609}
I20260927 13:49:48.334923 5619 tablet_bootstrap.cc:654] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:48.339954 5319 consensus_peers.cc:597] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b6ff9ddb6664a5a867ac0f64ac1e9a2. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:48.340039 5606 tablet_replica.cc:333] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:48.340227 5606 raft_consensus.cc:2243] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:48.340348 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet f9b019bbec5d40609dbf1c556cc26a63 (table default.Table_eae0be8d08ec43279ba35789c84b573c [id=599a7a50e2324466b865d11e66bc51bd]) successfully deleted
I20260927 13:49:48.341758 5606 pending_rounds.cc:70] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:48.343050 5606 pending_rounds.cc:77] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957579174592512 op_type: NO_OP noop_request { }
I20260927 13:49:48.343719 5606 raft_consensus.cc:2889] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260927 13:49:48.344018 5044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 123164us
I20260927 13:49:48.344395 5606 raft_consensus.cc:2272] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:48.347064 5319 consensus_peers.cc:597] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14d3a3282d684415858dc971cb02eec1. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:48.347936 5628 tablet_bootstrap.cc:492] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.348160 5628 ts_tablet_manager.cc:1403] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.077s user 0.008s sys 0.000s
I20260927 13:49:48.348690 5606 ts_tablet_manager.cc:1916] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.349043 5628 raft_consensus.cc:359] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.349330 5628 raft_consensus.cc:385] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.349465 5628 raft_consensus.cc:740] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.349804 5628 consensus_queue.cc:260] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.352065 5628 ts_tablet_manager.cc:1434] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:48.352607 5628 tablet_bootstrap.cc:492] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:49:48.355060 5184 leader_election.cc:343] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: df271399b2c84653ac4a5b74efdc0197
I20260927 13:49:48.355618 5227 tablet_service.cc:1511] Processing CreateTablet for tablet f70b70eb29cb4361a12ed393eabb82e1 (DEFAULT_TABLE table=default.Table_80d468d713554a8fb3b781794b43157a [id=18b81e3d511942b38a609e5f9552b4d8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:48.356233 5184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 49822.8us
I20260927 13:49:48.356441 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (table default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]). Expected version 1 got 0
W20260927 13:49:48.356504 5184 leader_election.cc:343] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b95399b042654100a609427597d6fe72
I20260927 13:49:48.356715 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c2fc2734e88e431facdf72e9ef136106 (table default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e]). Expected version 2 got 0
W20260927 13:49:48.357461 5184 leader_election.cc:343] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: df271399b2c84653ac4a5b74efdc0197
I20260927 13:49:48.357673 5184 leader_election.cc:304] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:48.357954 5623 log.cc:1199] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/587471d2b7e647388e7bb1e7f8e06b40
I20260927 13:49:48.357931 5891 raft_consensus.cc:2804] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:48.360211 5891 raft_consensus.cc:697] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:48.360476 5891 consensus_queue.cc:237] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.361244 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 4abe721ef8614d86870a0526de69014f
I20260927 13:49:48.362422 5619 tablet_bootstrap.cc:492] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:48.362327 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 4abe721ef8614d86870a0526de69014f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.362690 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70b70eb29cb4361a12ed393eabb82e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.363564 5217 tablet_service.cc:1558] Processing DeleteTablet for tablet 4abe721ef8614d86870a0526de69014f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.364068 5623 ts_tablet_manager.cc:1950] T 587471d2b7e647388e7bb1e7f8e06b40 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:48.364017 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4d67b784836e4d3b93bfc13e260f4761" } new_table_name: "default.Table_1644e061770e4453a64e74d48c0cd703" modify_external_catalogs: true
I20260927 13:49:48.364926 5623 tablet_replica.cc:333] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:48.365569 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 910b73528ed949bc86badcc4cf6c74a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.365669 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 587471d2b7e647388e7bb1e7f8e06b40 (table default.Table_f7b0ebc78f334f75b9104777be4c6c68 [id=f44e5332ddd545c3b7e52da7a624181a]) successfully deleted
I20260927 13:49:48.365914 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 2efee56b495340baa6dd51f0f3e2aaa7 with delete_type TABLET_DATA_DELETED (replaced by tablet 5e3fa4870d5547a2bbffe1745b964504) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.366155 5623 raft_consensus.cc:2243] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.366174 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b64d3aa052bf4c48b3802f6006cce9c9
I20260927 13:49:48.366317 5623 raft_consensus.cc:2272] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.366720 4923 catalog_manager.cc:6934] ReplaceTablet: tablet b64d3aa052bf4c48b3802f6006cce9c9 deleted and replaced by tablet 03a1f13b31934baa8ce18fc499e94806
I20260927 13:49:48.367087 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e11854abc7164d67b4195185f22c8295"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:48.367447 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet b64d3aa052bf4c48b3802f6006cce9c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 03a1f13b31934baa8ce18fc499e94806) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:48.367667 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e11854abc7164d67b4195185f22c8295 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.369364 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 85805d532ffa4c79974ce25041a72205
I20260927 13:49:48.370059 5625 ts_tablet_manager.cc:1929] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.370054 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c343af7db0904049b004a47d2ae605b6" } new_table_name: "default.Table_913f04b3fb9d4853bf4336a083b8db90" modify_external_catalogs: true
I20260927 13:49:48.370225 5625 log.cc:1199] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f5bf9ba5d857421ebc783d4c567f411c
I20260927 13:49:48.370257 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 85805d532ffa4c79974ce25041a72205 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.370695 5628 tablet_bootstrap.cc:654] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.371146 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet b64d3aa052bf4c48b3802f6006cce9c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 03a1f13b31934baa8ce18fc499e94806) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.371592 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 0c72e1a5dced499a932bdc302e006f29 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.372105 5623 ts_tablet_manager.cc:1916] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.373636 4928 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d6c46d0e50a44232a82d00c88d9f63b5 (table default.Table_abad46e19bc54aac8cf5415b2752c808 [id=e65860898b9041118d5fbb8b5aef2df4]). Expected version 1 got 0
I20260927 13:49:48.374280 5625 ts_tablet_manager.cc:1950] T f5bf9ba5d857421ebc783d4c567f411c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.375347 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f5bf9ba5d857421ebc783d4c567f411c (table default.Table_71b0f958b1ec49bf9f334180403b5e3f [id=e84cfb4f1dc04be8928d31ded73197c1]) successfully deleted
I20260927 13:49:48.375711 5625 tablet_replica.cc:333] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.375756 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_62cceedd20a943deabde3440a6a59adb" } new_table_name: "default.Table_f3005f35fe3f408bac8f54c5a509d4ad" modify_external_catalogs: true
I20260927 13:49:48.375999 5625 raft_consensus.cc:2243] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.376158 5625 raft_consensus.cc:2272] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.376694 5625 ts_tablet_manager.cc:1916] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.375380 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 321b26c89f1a4c8d88f401c8ece448b0
I20260927 13:49:48.378180 5619 ts_tablet_manager.cc:1403] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.003s
I20260927 13:49:48.378453 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5f7db155b7014eeb9796b1896fa0319b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:48.378929 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 85805d532ffa4c79974ce25041a72205 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:48.378968 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f7db155b7014eeb9796b1896fa0319b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.378602 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 321b26c89f1a4c8d88f401c8ece448b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.379040 5619 raft_consensus.cc:359] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.379257 5619 raft_consensus.cc:385] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.379333 5619 raft_consensus.cc:740] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.379590 5619 consensus_queue.cc:260] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.380076 5619 ts_tablet_manager.cc:1434] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:48.382557 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet 321b26c89f1a4c8d88f401c8ece448b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.383071 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 4abe721ef8614d86870a0526de69014f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.384003 6044 raft_consensus.cc:493] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.384137 6044 raft_consensus.cc:515] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.385035 6044 leader_election.cc:290] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.385099 5606 ts_tablet_manager.cc:1929] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:48.385228 5606 log.cc:1199] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/9b6ff9ddb6664a5a867ac0f64ac1e9a2
I20260927 13:49:48.385792 4925 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]). Expected version 1 got 0
I20260927 13:49:48.386730 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1ae91d9d1b754d34b300597015c74ff5" } new_table_name: "default.Table_e969ed1c04384e2cbafb90d72cbdef52" modify_external_catalogs: true
I20260927 13:49:48.387729 5625 ts_tablet_manager.cc:1929] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.389325 5628 tablet_bootstrap.cc:492] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.389580 5628 ts_tablet_manager.cc:1403] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.037s user 0.007s sys 0.000s
I20260927 13:49:48.390681 5628 raft_consensus.cc:359] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.390924 5628 raft_consensus.cc:385] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.391062 5628 raft_consensus.cc:740] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.391377 5628 consensus_queue.cc:260] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.391953 5628 ts_tablet_manager.cc:1434] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:48.393623 5628 tablet_bootstrap.cc:492] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.395582 5628 tablet_bootstrap.cc:654] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.396682 5625 log.cc:1199] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/c7670d5f54df49f4a074588ab9269145
I20260927 13:49:48.397119 5625 ts_tablet_manager.cc:1950] T c7670d5f54df49f4a074588ab9269145 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.398514 5088 tablet_service.cc:1511] Processing CreateTablet for tablet f70b70eb29cb4361a12ed393eabb82e1 (DEFAULT_TABLE table=default.Table_80d468d713554a8fb3b781794b43157a [id=18b81e3d511942b38a609e5f9552b4d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.398892 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70b70eb29cb4361a12ed393eabb82e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.391093 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effce815011d47df960df2c79d41aa1f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:48.402562 5606 ts_tablet_manager.cc:1950] T 9b6ff9ddb6664a5a867ac0f64ac1e9a2 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:49:48.402616 5045 leader_election.cc:343] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.402923 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 321b26c89f1a4c8d88f401c8ece448b0 (DEFAULT_TABLE table=default.Table_dbe657f659e24156b29a259c4b995402 [id=c1b3466f7acf411dbb7b0a2d63403edf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.403293 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 321b26c89f1a4c8d88f401c8ece448b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.403455 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 133) took 2364 ms. Trace:
I20260927 13:49:48.403560 5606 rpcz_store.cc:276] 0927 13:49:46.038547 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.038618 (+ 71us) service_pool.cc:224] Handling call
0927 13:49:48.338042 (+2299424us) ts_tablet_manager.cc:1151] Deleting tablet 9b6ff9ddb6664a5a867ac0f64ac1e9a2
0927 13:49:48.338053 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.381940 (+ 43887us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.385036 (+ 3096us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.403395 (+ 18359us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2225005}
I20260927 13:49:48.404028 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 145) took 1896 ms. Trace:
I20260927 13:49:48.395704 5619 tablet_bootstrap.cc:492] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:48.395704 5787 raft_consensus.cc:493] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.396134 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 85805d532ffa4c79974ce25041a72205 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.397226 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet b64d3aa052bf4c48b3802f6006cce9c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 03a1f13b31934baa8ce18fc499e94806) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.401971 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 321b26c89f1a4c8d88f401c8ece448b0 (DEFAULT_TABLE table=default.Table_dbe657f659e24156b29a259c4b995402 [id=c1b3466f7acf411dbb7b0a2d63403edf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.404300 5787 raft_consensus.cc:515] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.409713 5787 leader_election.cc:290] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.410470 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2ba67436a544e98788e9c1b00a1c33" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:48.407579 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 321b26c89f1a4c8d88f401c8ece448b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.414696 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 321b26c89f1a4c8d88f401c8ece448b0 (DEFAULT_TABLE table=default.Table_dbe657f659e24156b29a259c4b995402 [id=c1b3466f7acf411dbb7b0a2d63403edf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.415683 5223 tablet_service.cc:1511] Processing CreateTablet for tablet a443f65eba384b998fdc57ec57e37d87 (DEFAULT_TABLE table=default.Table_a0d3e839f0b941a7a8d6d59a62ae8507 [id=f7a31bf57f1245cab85dd2c38d85c79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.417083 5623 ts_tablet_manager.cc:1929] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.407262 5619 tablet_bootstrap.cc:654] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.404116 5606 rpcz_store.cc:276] 0927 13:49:46.507073 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.526258 (+ 19185us) service_pool.cc:224] Handling call
0927 13:49:48.403824 (+1877566us) ts_tablet_manager.cc:1151] Deleting tablet bc8f6354c1034814af3cc20df25ddb47
0927 13:49:48.403833 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.403979 (+ 146us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1877286}
W20260927 13:49:48.418794 5319 leader_election.cc:343] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2a2ba67436a544e98788e9c1b00a1c33
I20260927 13:49:48.418897 5606 tablet_replica.cc:333] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:48.419142 5606 raft_consensus.cc:2243] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.419447 5606 raft_consensus.cc:2272] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.420130 5606 ts_tablet_manager.cc:1916] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:48.420281 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet bc8f6354c1034814af3cc20df25ddb47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc8f6354c1034814af3cc20df25ddb47 already in progress: creating tablet
I20260927 13:49:48.422178 5727 raft_consensus.cc:697] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:48.422545 5727 consensus_queue.cc:237] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.423043 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet c7670d5f54df49f4a074588ab9269145 (table default.Table_1ae91d9d1b754d34b300597015c74ff5 [id=544e192ba7d148e5b94011fd326fdb0a]) successfully deleted
I20260927 13:49:48.423573 5625 tablet_replica.cc:333] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.424201 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 321b26c89f1a4c8d88f401c8ece448b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.424225 5249 raft_consensus.cc:2468] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:49:48.424412 5185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 134750us
I20260927 13:49:48.424489 5625 raft_consensus.cc:2243] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.424831 5319 leader_election.cc:304] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:48.424865 5625 raft_consensus.cc:2272] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.425036 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85805d532ffa4c79974ce25041a72205" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:48.425189 5385 raft_consensus.cc:3060] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.425298 5787 raft_consensus.cc:2804] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:48.425393 5787 raft_consensus.cc:493] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:48.425493 5787 raft_consensus.cc:3060] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.426684 5625 ts_tablet_manager.cc:1916] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.428817 5385 raft_consensus.cc:2468] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:48.428751 5787 raft_consensus.cc:515] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.429580 5626 tablet_bootstrap.cc:492] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:48.429719 5626 ts_tablet_manager.cc:1403] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.259s user 0.004s sys 0.009s
I20260927 13:49:48.424273 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 321b26c89f1a4c8d88f401c8ece448b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.430536 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a443f65eba384b998fdc57ec57e37d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.430698 5353 tablet_service.cc:1511] Processing CreateTablet for tablet a443f65eba384b998fdc57ec57e37d87 (DEFAULT_TABLE table=default.Table_a0d3e839f0b941a7a8d6d59a62ae8507 [id=f7a31bf57f1245cab85dd2c38d85c79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.430923 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df271399b2c84653ac4a5b74efdc0197" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:48.431116 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a443f65eba384b998fdc57ec57e37d87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:48.430708 5319 leader_election.cc:343] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2a2ba67436a544e98788e9c1b00a1c33
I20260927 13:49:48.431880 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2999bd61907847938975a6232e3899e4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:48.432228 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effce815011d47df960df2c79d41aa1f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:48.432201 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b8d6958e6f44d3a98ed96d89d4c1b4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:48.432545 5044 leader_election.cc:343] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.431118 5385 raft_consensus.cc:3060] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.432673 5044 leader_election.cc:304] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:48.432765 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2ba67436a544e98788e9c1b00a1c33" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:48.432940 5248 raft_consensus.cc:3060] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.433089 6044 raft_consensus.cc:2749] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:48.433501 5044 leader_election.cc:343] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.433617 5044 leader_election.cc:304] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:48.433959 6044 raft_consensus.cc:2749] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:48.434325 5044 leader_election.cc:343] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.434440 5044 leader_election.cc:304] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:48.434752 6044 raft_consensus.cc:2749] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:48.435559 5385 raft_consensus.cc:2468] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:48.436174 5248 raft_consensus.cc:2468] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:48.436971 5787 leader_election.cc:290] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.437309 5319 leader_election.cc:304] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:48.438311 5626 raft_consensus.cc:359] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.442669 5623 log.cc:1199] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/3663033220094a4ea6df8e2982eb2188
I20260927 13:49:48.443553 5626 raft_consensus.cc:385] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.441692 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 31ee75d0a39c42b09f2f46a1774f925c
I20260927 13:49:48.443766 5626 raft_consensus.cc:740] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.443775 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_71880460bb5749cf90eed9712c6c61a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:48.444499 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4d452d91413a42a1900d8b3557e07e22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.445012 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d452d91413a42a1900d8b3557e07e22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:48.445899 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71880460bb5749cf90eed9712c6c61a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.441784 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 0c72e1a5dced499a932bdc302e006f29
I20260927 13:49:48.446676 4924 catalog_manager.cc:6934] ReplaceTablet: tablet 0c72e1a5dced499a932bdc302e006f29 deleted and replaced by tablet 2cec272546cb4373bf69e3ab344c46e1
I20260927 13:49:48.446919 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 85805d532ffa4c79974ce25041a72205 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.447702 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c193f6d7a86a41b58650b5be4520226d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:48.448299 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_abad46e19bc54aac8cf5415b2752c808" } new_table_name: "default.Table_ba244e66b84a4e73978644722f0d7b09" modify_external_catalogs: true
I20260927 13:49:48.443193 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_cc674605834f48fb90b47899e544a8c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.449918 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc674605834f48fb90b47899e544a8c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.450168 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c72e1a5dced499a932bdc302e006f29 with delete_type TABLET_DATA_DELETED (replaced by tablet 2cec272546cb4373bf69e3ab344c46e1) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:48.450225 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b0fd6fb92eb64e948e67f70c512376e2 consensus state has no leader
I20260927 13:49:48.450426 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ee75d0a39c42b09f2f46a1774f925c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.444015 5623 ts_tablet_manager.cc:1950] T 3663033220094a4ea6df8e2982eb2188 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
W20260927 13:49:48.443444 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 has no consensus state
I20260927 13:49:48.451897 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet 80b1970a344045389709260c850adc07 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.452025 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 3663033220094a4ea6df8e2982eb2188 (table default.Table_a9cae6841bf84f09bdea303110cd78ad [id=17e5201d16ce4ce59807538c4e68b495]) successfully deleted
W20260927 13:49:48.448297 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c193f6d7a86a41b58650b5be4520226d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.449272 5727 consensus_queue.cc:1048] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:48.449939 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c72e1a5dced499a932bdc302e006f29 with delete_type TABLET_DATA_DELETED (replaced by tablet 2cec272546cb4373bf69e3ab344c46e1) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.450670 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ee75d0a39c42b09f2f46a1774f925c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:48.453447 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 6bb5fdbfebd5401e92186997f9a30d36 because the tablet was not found. No further retry: Not found: Tablet not found: 6bb5fdbfebd5401e92186997f9a30d36
I20260927 13:49:48.454412 5626 consensus_queue.cc:260] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.454515 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c72e1a5dced499a932bdc302e006f29 with delete_type TABLET_DATA_DELETED (replaced by tablet 2cec272546cb4373bf69e3ab344c46e1) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.454953 5626 ts_tablet_manager.cc:1434] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260927 13:49:48.455384 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ee75d0a39c42b09f2f46a1774f925c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.457558 5087 tablet_service.cc:1511] Processing CreateTablet for tablet a443f65eba384b998fdc57ec57e37d87 (DEFAULT_TABLE table=default.Table_a0d3e839f0b941a7a8d6d59a62ae8507 [id=f7a31bf57f1245cab85dd2c38d85c79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.458050 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a443f65eba384b998fdc57ec57e37d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.460700 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet b95399b042654100a609427597d6fe72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:44 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.461069 5623 tablet_replica.cc:333] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:48.461241 5787 raft_consensus.cc:2804] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:48.461292 5623 raft_consensus.cc:2243] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.461477 5623 raft_consensus.cc:2272] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.462044 5623 ts_tablet_manager.cc:1916] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.466863 5628 tablet_bootstrap.cc:492] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
W20260927 13:49:48.467878 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 730cd78c7b1a49d892a5ecb46fae0812 has no consensus state
I20260927 13:49:48.468286 5628 ts_tablet_manager.cc:1403] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.075s user 0.004s sys 0.003s
I20260927 13:49:48.469296 5628 raft_consensus.cc:359] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.469574 5628 raft_consensus.cc:385] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.469731 5628 raft_consensus.cc:740] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.470088 5628 consensus_queue.cc:260] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.471613 5628 ts_tablet_manager.cc:1434] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 13:49:48.472003 5628 tablet_bootstrap.cc:492] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.472119 6044 raft_consensus.cc:493] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.472281 6044 raft_consensus.cc:515] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.474300 5628 tablet_bootstrap.cc:654] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.476150 5358 tablet_service.cc:1511] Processing CreateTablet for tablet a81b44fb2f644dff899d6d4aa435ccee (DEFAULT_TABLE table=default.Table_fab1230046a44991874933aff1c03068 [id=9add8d65c6ee4e2fbdba0385c7c781f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.476811 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81b44fb2f644dff899d6d4aa435ccee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.482594 5628 tablet_bootstrap.cc:492] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.482993 5628 ts_tablet_manager.cc:1403] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260927 13:49:48.485513 5088 tablet_service.cc:1511] Processing CreateTablet for tablet a81b44fb2f644dff899d6d4aa435ccee (DEFAULT_TABLE table=default.Table_fab1230046a44991874933aff1c03068 [id=9add8d65c6ee4e2fbdba0385c7c781f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.485962 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81b44fb2f644dff899d6d4aa435ccee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.487236 5082 tablet_service.cc:1511] Processing CreateTablet for tablet b8311ff24259477a9523355908ac14f8 (DEFAULT_TABLE table=default.Table_2e1239a5183b45839ad4a031b7398f95 [id=deaa0ccfa31b4763887d5bfd6418ce26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.487353 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce893441d5e4d9f89743e75eb762276 (DEFAULT_TABLE table=default.Table_6f968553a801422ba747b1d4516c2074 [id=b330cf549e3842ad9e82aed396bcba89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.487615 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8311ff24259477a9523355908ac14f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.487826 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce893441d5e4d9f89743e75eb762276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.488471 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 56b9612ffea543b9b0779c46533d91ab (DEFAULT_TABLE table=default.Table_8f56db43a65c4bd5a295fc1966c944a2 [id=a8089fe90d01478dbf155541ed227099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.488852 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b9612ffea543b9b0779c46533d91ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.488935 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 3b855dedb8d04145b0c4469b9ba79453 (DEFAULT_TABLE table=default.Table_fec7020fbf30493cbe6a218ae1cc9dab [id=05951559c98143f5bf067109c7ce2e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.489245 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b855dedb8d04145b0c4469b9ba79453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.492789 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce893441d5e4d9f89743e75eb762276 (DEFAULT_TABLE table=default.Table_6f968553a801422ba747b1d4516c2074 [id=b330cf549e3842ad9e82aed396bcba89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.493240 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce893441d5e4d9f89743e75eb762276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.494594 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 3b855dedb8d04145b0c4469b9ba79453 (DEFAULT_TABLE table=default.Table_fec7020fbf30493cbe6a218ae1cc9dab [id=05951559c98143f5bf067109c7ce2e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.494935 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b855dedb8d04145b0c4469b9ba79453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.494976 6044 leader_election.cc:290] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.483937 5628 raft_consensus.cc:359] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:48.495252 5628 raft_consensus.cc:385] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.495363 5628 raft_consensus.cc:740] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.495613 5628 consensus_queue.cc:260] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:48.496464 5628 ts_tablet_manager.cc:1434] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260927 13:49:48.496811 5628 tablet_bootstrap.cc:492] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.497023 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76add3b9ef254ece958121a336e87936" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:48.499384 5628 tablet_bootstrap.cc:654] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.500416 5352 tablet_service.cc:1511] Processing CreateTablet for tablet b8311ff24259477a9523355908ac14f8 (DEFAULT_TABLE table=default.Table_2e1239a5183b45839ad4a031b7398f95 [id=deaa0ccfa31b4763887d5bfd6418ce26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.500825 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8311ff24259477a9523355908ac14f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.500943 5625 ts_tablet_manager.cc:1929] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.501046 5625 log.cc:1199] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a3b1d54e4af0432f9d1ef9879d2ec4e9
I20260927 13:49:48.501406 5625 ts_tablet_manager.cc:1950] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.502043 5787 raft_consensus.cc:697] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:48.502378 5787 consensus_queue.cc:237] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:48.502713 5045 leader_election.cc:343] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.503899 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 56b9612ffea543b9b0779c46533d91ab (DEFAULT_TABLE table=default.Table_8f56db43a65c4bd5a295fc1966c944a2 [id=a8089fe90d01478dbf155541ed227099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.504293 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b9612ffea543b9b0779c46533d91ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.504794 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 (table default.Table_87c2ff7de94d4663aebf61e88f2d5080 [id=c4c8708f397345919b0e8b06ab47b367]) successfully deleted
I20260927 13:49:48.505131 5625 tablet_replica.cc:333] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.505348 5625 raft_consensus.cc:2243] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.505504 5625 raft_consensus.cc:2272] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.506356 5625 ts_tablet_manager.cc:1916] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.523146 5619 tablet_bootstrap.cc:492] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:48.523365 5619 ts_tablet_manager.cc:1403] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.128s user 0.003s sys 0.006s
I20260927 13:49:48.528515 5628 tablet_bootstrap.cc:492] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.528754 5628 ts_tablet_manager.cc:1403] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260927 13:49:48.529815 5628 raft_consensus.cc:359] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.530069 5628 raft_consensus.cc:385] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.530189 5628 raft_consensus.cc:740] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.530511 5628 consensus_queue.cc:260] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.531190 5628 ts_tablet_manager.cc:1434] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:48.531611 5628 tablet_bootstrap.cc:492] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.534042 5628 tablet_bootstrap.cc:654] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.540953 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e2579c7764f14413988b3e9bfd6ae8d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.541561 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2579c7764f14413988b3e9bfd6ae8d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.541688 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7d190d6d35774a4f9f8ca7efceb00954"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.542171 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d190d6d35774a4f9f8ca7efceb00954 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.543080 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2e1239a5183b45839ad4a031b7398f95" } modify_external_catalogs: true
I20260927 13:49:48.543241 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2e1239a5183b45839ad4a031b7398f95" } modify_external_catalogs: true
I20260927 13:49:48.544724 5628 tablet_bootstrap.cc:492] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.544914 5628 ts_tablet_manager.cc:1403] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.004s
I20260927 13:49:48.546018 5628 raft_consensus.cc:359] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.546221 5628 raft_consensus.cc:385] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.546311 5628 raft_consensus.cc:740] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.547876 5628 consensus_queue.cc:260] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.548897 5628 ts_tablet_manager.cc:1434] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260927 13:49:48.549212 5628 tablet_bootstrap.cc:492] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.552655 5352 tablet_service.cc:1511] Processing CreateTablet for tablet a7a97f4df3a84781bfcbdc768d518ef0 (DEFAULT_TABLE table=default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.553339 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a97f4df3a84781bfcbdc768d518ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.555727 5628 tablet_bootstrap.cc:654] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.555970 6044 raft_consensus.cc:493] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.556169 6044 raft_consensus.cc:515] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:48.556911 6044 leader_election.cc:290] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:48.556802 5619 raft_consensus.cc:359] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.557039 5619 raft_consensus.cc:385] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.558249 5087 tablet_service.cc:1511] Processing CreateTablet for tablet a7a97f4df3a84781bfcbdc768d518ef0 (DEFAULT_TABLE table=default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.558651 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a97f4df3a84781bfcbdc768d518ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.568979 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 059afd48ac4a41569ed1d3556b7974f0 (DEFAULT_TABLE table=default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.569499 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059afd48ac4a41569ed1d3556b7974f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.571143 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 9f080b4ca9894eae8305d1548010a6cb (DEFAULT_TABLE table=default.Table_3e9c701f47c14f53a3e9d39d0ec63a7d [id=42bfb85e0c8f425ea04c34b94ec24c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.571527 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f080b4ca9894eae8305d1548010a6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.587435 5626 tablet_bootstrap.cc:492] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:48.589279 5625 ts_tablet_manager.cc:1929] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.589535 5625 log.cc:1199] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/2999bd61907847938975a6232e3899e4
I20260927 13:49:48.590453 5625 ts_tablet_manager.cc:1950] T 2999bd61907847938975a6232e3899e4 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.590854 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 56b9612ffea543b9b0779c46533d91ab (DEFAULT_TABLE table=default.Table_8f56db43a65c4bd5a295fc1966c944a2 [id=a8089fe90d01478dbf155541ed227099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.591125 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 2999bd61907847938975a6232e3899e4 (table default.Table_7cef271e951d46f38d090f892f8e54c0 [id=55be6819da774e158af5a660b686a1f3]) successfully deleted
I20260927 13:49:48.591406 5223 tablet_service.cc:1511] Processing CreateTablet for tablet a81b44fb2f644dff899d6d4aa435ccee (DEFAULT_TABLE table=default.Table_fab1230046a44991874933aff1c03068 [id=9add8d65c6ee4e2fbdba0385c7c781f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.591583 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72711f14f26a479c9699b172b41b1db0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:48.591763 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 3b855dedb8d04145b0c4469b9ba79453 (DEFAULT_TABLE table=default.Table_fec7020fbf30493cbe6a218ae1cc9dab [id=05951559c98143f5bf067109c7ce2e28]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:48.591881 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 6817fb4caf6a445b899830c6702bf911 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6817fb4caf6a445b899830c6702bf911 already in progress: creating tablet
I20260927 13:49:48.591955 5619 raft_consensus.cc:740] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.592772 5606 ts_tablet_manager.cc:1929] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.592907 5606 log.cc:1199] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/e56df07d0a524e5184bdc7fc8d95857c
I20260927 13:49:48.593714 5606 ts_tablet_manager.cc:1950] T e56df07d0a524e5184bdc7fc8d95857c P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:48.594530 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 146) took 1974 ms. Trace:
I20260927 13:49:48.595258 5606 rpcz_store.cc:276] 0927 13:49:46.620480 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.620787 (+ 307us) service_pool.cc:224] Handling call
0927 13:49:48.418810 (+1798023us) ts_tablet_manager.cc:1151] Deleting tablet e56df07d0a524e5184bdc7fc8d95857c
0927 13:49:48.418818 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.511730 (+ 92912us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.560149 (+ 48419us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.594488 (+ 34339us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1773935}
I20260927 13:49:48.595697 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 147) took 1823 ms. Trace:
I20260927 13:49:48.596503 5606 rpcz_store.cc:276] 0927 13:49:46.772502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.772563 (+ 61us) service_pool.cc:224] Handling call
0927 13:49:48.595567 (+1823004us) ts_tablet_manager.cc:1151] Deleting tablet 0018704e08254c2e8d30c7067df4420c
0927 13:49:48.595576 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.595668 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1822794}
I20260927 13:49:48.596812 5606 tablet_replica.cc:333] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:48.596779 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c42b0575837344b49224e6f62cb664e9" } modify_external_catalogs: true
I20260927 13:49:48.596936 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c42b0575837344b49224e6f62cb664e9" } modify_external_catalogs: true
I20260927 13:49:48.597213 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b9612ffea543b9b0779c46533d91ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.597536 5606 raft_consensus.cc:2243] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:48.597841 5606 pending_rounds.cc:70] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:48.598012 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet e56df07d0a524e5184bdc7fc8d95857c (table default.Table_5e60c258bac24c7cabc2b7e1e6052193 [id=a160103a454d421c8be6a88afa7c1419]) successfully deleted
I20260927 13:49:48.598006 5606 pending_rounds.cc:77] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957579058479104 op_type: NO_OP noop_request { }
I20260927 13:49:48.598172 5606 raft_consensus.cc:2889] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:48.595788 5619 consensus_queue.cc:260] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:48.598466 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 0018704e08254c2e8d30c7067df4420c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0018704e08254c2e8d30c7067df4420c already in progress: creating tablet
W20260927 13:49:48.598681 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1245334728994a60ad641c2e90f8d2df consensus state has no leader
I20260927 13:49:48.598590 5228 tablet_service.cc:1511] Processing CreateTablet for tablet 9f080b4ca9894eae8305d1548010a6cb (DEFAULT_TABLE table=default.Table_3e9c701f47c14f53a3e9d39d0ec63a7d [id=42bfb85e0c8f425ea04c34b94ec24c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.598901 5606 raft_consensus.cc:2272] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.598942 5229 tablet_service.cc:1511] Processing CreateTablet for tablet b8311ff24259477a9523355908ac14f8 (DEFAULT_TABLE table=default.Table_2e1239a5183b45839ad4a031b7398f95 [id=deaa0ccfa31b4763887d5bfd6418ce26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.599074 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f4169b61d7234a6286c6c26a3b3b2c65" } modify_external_catalogs: true
I20260927 13:49:48.599233 5222 tablet_service.cc:1511] Processing CreateTablet for tablet a7a97f4df3a84781bfcbdc768d518ef0 (DEFAULT_TABLE table=default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.599267 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f4169b61d7234a6286c6c26a3b3b2c65" } modify_external_catalogs: true
I20260927 13:49:48.599522 5606 ts_tablet_manager.cc:1916] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.600831 5619 ts_tablet_manager.cc:1434] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.077s user 0.001s sys 0.003s
I20260927 13:49:48.601101 5619 tablet_bootstrap.cc:492] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:48.604379 5619 tablet_bootstrap.cc:654] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.606076 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 80b1970a344045389709260c850adc07
I20260927 13:49:48.606627 4930 catalog_manager.cc:6934] ReplaceTablet: tablet 80b1970a344045389709260c850adc07 deleted and replaced by tablet 081f18e00af74e5c811f774d29422351
I20260927 13:49:48.610572 5626 tablet_bootstrap.cc:654] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.612648 4923 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d6c46d0e50a44232a82d00c88d9f63b5 (table default.Table_ba244e66b84a4e73978644722f0d7b09 [id=e65860898b9041118d5fbb8b5aef2df4]). Expected version 2 got 0
I20260927 13:49:48.613700 4921 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f3005f35fe3f408bac8f54c5a509d4ad" } modify_external_catalogs: true
I20260927 13:49:48.613938 4921 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f3005f35fe3f408bac8f54c5a509d4ad" } modify_external_catalogs: true
I20260927 13:49:48.619832 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81b44fb2f644dff899d6d4aa435ccee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.620162 5220 tablet_service.cc:1511] Processing CreateTablet for tablet 059afd48ac4a41569ed1d3556b7974f0 (DEFAULT_TABLE table=default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.621110 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059afd48ac4a41569ed1d3556b7974f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.626628 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 80b1970a344045389709260c850adc07 with delete_type TABLET_DATA_DELETED (replaced by tablet 081f18e00af74e5c811f774d29422351) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.633811 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b8311ff24259477a9523355908ac14f8
I20260927 13:49:48.634233 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce893441d5e4d9f89743e75eb762276 (DEFAULT_TABLE table=default.Table_6f968553a801422ba747b1d4516c2074 [id=b330cf549e3842ad9e82aed396bcba89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.635301 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet b8311ff24259477a9523355908ac14f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.617076 5185 leader_election.cc:304] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:48.636886 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f080b4ca9894eae8305d1548010a6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.638303 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a97f4df3a84781bfcbdc768d518ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.638841 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 80b1970a344045389709260c850adc07 with delete_type TABLET_DATA_DELETED (replaced by tablet 081f18e00af74e5c811f774d29422351) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.644349 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 564f5c92bf144fa1bfc2e1e07132dd69 (DEFAULT_TABLE table=default.Table_2d7d460396774c7982b3391c3ad1827f [id=c81f7b3016144fd7a7329fbf31049d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.648322 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet 85805d532ffa4c79974ce25041a72205 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.654424 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b855dedb8d04145b0c4469b9ba79453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.656517 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 1245334728994a60ad641c2e90f8d2df (DEFAULT_TABLE table=default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:48.657236 5185 raft_consensus.cc:2686] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:49:48.658594 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet b8311ff24259477a9523355908ac14f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.659569 4929 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d6c46d0e50a44232a82d00c88d9f63b5 (table default.Table_ba244e66b84a4e73978644722f0d7b09 [id=e65860898b9041118d5fbb8b5aef2df4]). Expected version 2 got 0
I20260927 13:49:48.659930 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564f5c92bf144fa1bfc2e1e07132dd69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.660012 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4a75f85041ad48c1bb68bc4f505b6ccd" } modify_external_catalogs: true
I20260927 13:49:48.660215 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4a75f85041ad48c1bb68bc4f505b6ccd" } modify_external_catalogs: true
W20260927 13:49:48.662065 5185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 194538us
I20260927 13:49:48.663211 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1245334728994a60ad641c2e90f8d2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.665301 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8311ff24259477a9523355908ac14f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.669003 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76add3b9ef254ece958121a336e87936" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:48.669747 5219 tablet_service.cc:1511] Processing CreateTablet for tablet d1f9ae430c414cdf9370388d51dd7c63 (DEFAULT_TABLE table=default.Table_e680c915b7b546a7927c1795fa7f3ef4 [id=793fd3b0ccee43a88ba3992caa0408ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.672487 4927 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet e1284e67734e4e2a82ac7a2f915f02d2
I20260927 13:49:48.672722 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 80b1970a344045389709260c850adc07 with delete_type TABLET_DATA_DELETED (replaced by tablet 081f18e00af74e5c811f774d29422351) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:48.673192 5044 leader_election.cc:343] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.673323 5044 leader_election.cc:304] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:48.673861 6044 raft_consensus.cc:2749] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:48.674216 5319 consensus_peers.cc:597] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70d1197bee2d477ab77d15cbd4907595. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:48.676328 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 9f080b4ca9894eae8305d1548010a6cb (DEFAULT_TABLE table=default.Table_3e9c701f47c14f53a3e9d39d0ec63a7d [id=42bfb85e0c8f425ea04c34b94ec24c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.677374 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5dfc30791e4347db940f164882d547d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:48.677465 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a0d3e839f0b941a7a8d6d59a62ae8507" } new_table_name: "default.Table_03c0639b89c9428091f98822abc5f438" modify_external_catalogs: true
I20260927 13:49:48.677841 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_13294c9335de4fd3ad6c089efad19634"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.678033 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5dfc30791e4347db940f164882d547d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:48.678385 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13294c9335de4fd3ad6c089efad19634 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.679466 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_80d468d713554a8fb3b781794b43157a" } new_table_name: "default.Table_55aa0cde9170428d848330642e3b171e" modify_external_catalogs: true
I20260927 13:49:48.679672 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4d452d91413a42a1900d8b3557e07e22" } new_table_name: "default.Table_d294f0cb024e426592bf4bf7f261f4be" modify_external_catalogs: true
I20260927 13:49:48.680984 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a212266119b14cedb7576aff1e810ca4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.681417 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a212266119b14cedb7576aff1e810ca4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.687098 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce893441d5e4d9f89743e75eb762276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.687142 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d936492f977944a59cdb4de68a75c0a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.687655 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d936492f977944a59cdb4de68a75c0a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.688482 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 059afd48ac4a41569ed1d3556b7974f0 (DEFAULT_TABLE table=default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:48.689672 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 84006.7us
W20260927 13:49:48.690198 5045 leader_election.cc:343] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.692016 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 1f34f2d0f6e9420a8ad38d708b658b17
I20260927 13:49:48.692973 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f34f2d0f6e9420a8ad38d708b658b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.694682 5088 tablet_service.cc:1511] Processing CreateTablet for tablet d1f9ae430c414cdf9370388d51dd7c63 (DEFAULT_TABLE table=default.Table_e680c915b7b546a7927c1795fa7f3ef4 [id=793fd3b0ccee43a88ba3992caa0408ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.695281 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 98ffe83306e74749b5b3f68e6c2c708c (DEFAULT_TABLE table=default.Table_0956a69da22a495691888f08a70b62dc [id=126aea719ed34308a0742ed1fe5d6970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.695662 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 1245334728994a60ad641c2e90f8d2df (DEFAULT_TABLE table=default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.697738 5078 tablet_service.cc:1511] Processing CreateTablet for tablet 931a48792f4c4525bd563a4dd1062e35 (DEFAULT_TABLE table=default.Table_dfa3b09930634e67ba11591b71147d46 [id=bed97aef149a417bb3807414f58ba52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.700119 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 564f5c92bf144fa1bfc2e1e07132dd69 (DEFAULT_TABLE table=default.Table_2d7d460396774c7982b3391c3ad1827f [id=c81f7b3016144fd7a7329fbf31049d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.700361 4925 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]). Expected version 1 got 0
I20260927 13:49:48.701046 4925 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f34f2d0f6e9420a8ad38d708b658b17 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.704093 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 31ee75d0a39c42b09f2f46a1774f925c (DEFAULT_TABLE table=default.Table_ee4b85ee72994fe596598538d6755252 [id=c2ce8f3fda214134bf35a2866675d0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.706727 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b0fd6fb92eb64e948e67f70c512376e2
I20260927 13:49:48.706949 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ffe83306e74749b5b3f68e6c2c708c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.709008 4921 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 72711f14f26a479c9699b172b41b1db0 (table default.Table_9fd82aceaf6d491facc37c309420e9ed [id=aa9bfeb5b20c499d9897f950fa6db2a9]). Expected version 3 got 0
I20260927 13:49:48.709252 4921 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d6c46d0e50a44232a82d00c88d9f63b5 (table default.Table_ba244e66b84a4e73978644722f0d7b09 [id=e65860898b9041118d5fbb8b5aef2df4]). Expected version 2 got 0
I20260927 13:49:48.709316 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72711f14f26a479c9699b172b41b1db0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:48.709446 4921 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 1cc174eab36b46fb8e276b3168fbfbcd (table default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe]). Expected version 3 got 0
W20260927 13:49:48.710903 5044 leader_election.cc:343] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.711040 5044 leader_election.cc:304] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:48.711655 6044 raft_consensus.cc:2749] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:48.712426 5218 tablet_service.cc:1511] Processing CreateTablet for tablet 98ffe83306e74749b5b3f68e6c2c708c (DEFAULT_TABLE table=default.Table_0956a69da22a495691888f08a70b62dc [id=126aea719ed34308a0742ed1fe5d6970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.713104 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f9ae430c414cdf9370388d51dd7c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.715384 4925 master_service.cc:960] ReplaceTablet: received request to replace tablet 129c2f99d5b143b3bd25731cfeb0009e from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.715607 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet b0fd6fb92eb64e948e67f70c512376e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.717468 5625 tablet_replica.cc:333] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.717686 5625 raft_consensus.cc:2243] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.717875 5625 raft_consensus.cc:2272] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.718070 4923 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 30033b9c2638447fa46b566f699007e1
I20260927 13:49:48.718376 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet 2329b988f5d9410d96eca321a7b8f3a6 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.718464 5625 ts_tablet_manager.cc:1916] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.718657 5350 tablet_service.cc:1511] Processing CreateTablet for tablet d1f9ae430c414cdf9370388d51dd7c63 (DEFAULT_TABLE table=default.Table_e680c915b7b546a7927c1795fa7f3ef4 [id=793fd3b0ccee43a88ba3992caa0408ab]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:48.718806 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a443f65eba384b998fdc57ec57e37d87 consensus state has no leader
I20260927 13:49:48.719221 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 931a48792f4c4525bd563a4dd1062e35 (DEFAULT_TABLE table=default.Table_dfa3b09930634e67ba11591b71147d46 [id=bed97aef149a417bb3807414f58ba52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.719686 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 564f5c92bf144fa1bfc2e1e07132dd69 (DEFAULT_TABLE table=default.Table_2d7d460396774c7982b3391c3ad1827f [id=c81f7b3016144fd7a7329fbf31049d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.720119 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet b8311ff24259477a9523355908ac14f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:48.724270 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f70b70eb29cb4361a12ed393eabb82e1 consensus state has no leader
I20260927 13:49:48.724534 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f34f2d0f6e9420a8ad38d708b658b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:48.724699 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3e0e8d6bc744d69a9f41d45459d3b2b has no consensus state
I20260927 13:49:48.724745 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 98ffe83306e74749b5b3f68e6c2c708c (DEFAULT_TABLE table=default.Table_0956a69da22a495691888f08a70b62dc [id=126aea719ed34308a0742ed1fe5d6970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.725085 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet b0fd6fb92eb64e948e67f70c512376e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.725246 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 31ee75d0a39c42b09f2f46a1774f925c (DEFAULT_TABLE table=default.Table_ee4b85ee72994fe596598538d6755252 [id=c2ce8f3fda214134bf35a2866675d0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.725422 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931a48792f4c4525bd563a4dd1062e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.725545 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 1245334728994a60ad641c2e90f8d2df (DEFAULT_TABLE table=default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.726862 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564f5c92bf144fa1bfc2e1e07132dd69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.730173 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ee75d0a39c42b09f2f46a1774f925c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.727332 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet bc8f6354c1034814af3cc20df25ddb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.736745 5625 ts_tablet_manager.cc:1929] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.737469 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 03917a40b5884401a6bc09c7925fd1ae (DEFAULT_TABLE table=default.Table_5e60c258bac24c7cabc2b7e1e6052193 [id=a160103a454d421c8be6a88afa7c1419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.735139 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f9ae430c414cdf9370388d51dd7c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.737612 5625 log.cc:1199] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/d2e0b4c217ca41b98013155b8d952fe6
I20260927 13:49:48.738139 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1245334728994a60ad641c2e90f8d2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.740430 5625 ts_tablet_manager.cc:1950] T d2e0b4c217ca41b98013155b8d952fe6 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.741819 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 129c2f99d5b143b3bd25731cfeb0009e
I20260927 13:49:48.742352 4925 catalog_manager.cc:6934] ReplaceTablet: tablet 129c2f99d5b143b3bd25731cfeb0009e deleted and replaced by tablet 46537e1b33f24d50b705d53f6978da3c
I20260927 13:49:48.742843 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 129c2f99d5b143b3bd25731cfeb0009e with delete_type TABLET_DATA_DELETED (replaced by tablet 46537e1b33f24d50b705d53f6978da3c) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.738600 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 03917a40b5884401a6bc09c7925fd1ae (DEFAULT_TABLE table=default.Table_5e60c258bac24c7cabc2b7e1e6052193 [id=a160103a454d421c8be6a88afa7c1419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.746414 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03917a40b5884401a6bc09c7925fd1ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.746929 6044 raft_consensus.cc:493] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.747076 6044 raft_consensus.cc:515] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.747721 6044 leader_election.cc:290] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.748850 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c976a667e7c4b948b3aa176b13b7d0d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:48.749912 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet d2e0b4c217ca41b98013155b8d952fe6 (table default.Table_268838ff93954800813c2850f8dbef43 [id=393d91e6e8194f008d5ef165bcfb6b82]) successfully deleted
I20260927 13:49:48.749972 5625 tablet_replica.cc:333] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
W20260927 13:49:48.750473 5045 leader_election.cc:343] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.750916 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f080b4ca9894eae8305d1548010a6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.751300 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f9ae430c414cdf9370388d51dd7c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.753002 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03917a40b5884401a6bc09c7925fd1ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.754256 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ee75d0a39c42b09f2f46a1774f925c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.756448 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059afd48ac4a41569ed1d3556b7974f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.757622 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ffe83306e74749b5b3f68e6c2c708c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.757592 5606 ts_tablet_manager.cc:1929] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:48.757714 5606 log.cc:1199] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/7681d137476040788e40dd787ce74ccd
I20260927 13:49:48.758239 5606 ts_tablet_manager.cc:1950] T 7681d137476040788e40dd787ce74ccd P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:48.758304 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 129c2f99d5b143b3bd25731cfeb0009e with delete_type TABLET_DATA_DELETED (replaced by tablet 46537e1b33f24d50b705d53f6978da3c) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.759110 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 148) took 1985 ms. Trace:
I20260927 13:49:48.759248 5606 rpcz_store.cc:276] 0927 13:49:46.773917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.773969 (+ 52us) service_pool.cc:224] Handling call
0927 13:49:48.596752 (+1822783us) ts_tablet_manager.cc:1151] Deleting tablet 7681d137476040788e40dd787ce74ccd
0927 13:49:48.596764 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.744106 (+147342us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.757503 (+ 13397us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.759064 (+ 1561us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1822528}
I20260927 13:49:48.759666 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 7681d137476040788e40dd787ce74ccd (table default.Table_f91dab3c58974becbe03c7d55f1a01d4 [id=a22a9a93ae2543e583d24dd648813233]) successfully deleted
I20260927 13:49:48.760399 6044 raft_consensus.cc:493] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.760638 6044 raft_consensus.cc:515] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.761310 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1245334728994a60ad641c2e90f8d2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.761806 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc174eab36b46fb8e276b3168fbfbcd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:48.762394 5045 leader_election.cc:343] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.762787 6044 leader_election.cc:290] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.763924 5351 tablet_service.cc:1511] Processing CreateTablet for tablet ec40378eb80c412198d5b66c02e975ef (DEFAULT_TABLE table=default.Table_298f6b42cb084ec7abaaea11e41d12b9 [id=27609594a3c74bf895858e5dc48a543e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.764353 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec40378eb80c412198d5b66c02e975ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.764919 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931a48792f4c4525bd563a4dd1062e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.769013 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564f5c92bf144fa1bfc2e1e07132dd69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.772218 5628 tablet_bootstrap.cc:492] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.772855 5628 ts_tablet_manager.cc:1403] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.223s user 0.027s sys 0.029s
I20260927 13:49:48.773695 5628 raft_consensus.cc:359] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.773921 5628 raft_consensus.cc:385] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.773996 5628 raft_consensus.cc:740] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.774433 5628 consensus_queue.cc:260] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.778860 5628 ts_tablet_manager.cc:1434] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260927 13:49:48.779266 5628 tablet_bootstrap.cc:492] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.781729 5628 tablet_bootstrap.cc:654] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.782845 5727 raft_consensus.cc:493] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:49:48.786055 5319 consensus_peers.cc:597] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14d3a3282d684415858dc971cb02eec1. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:48.791931 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
I20260927 13:49:48.798972 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_dcdac8819c9b408fbef7c11fdd631090"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.799701 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcdac8819c9b408fbef7c11fdd631090 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.799770 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 154) took 1856 ms. Trace:
I20260927 13:49:48.799902 5606 rpcz_store.cc:276] 0927 13:49:46.941168 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.942231 (+ 1063us) service_pool.cc:224] Handling call
0927 13:49:48.796940 (+1854709us) ts_tablet_manager.cc:1151] Deleting tablet 8e959f8c6fa74a1bbaf06d91c3e484bc
0927 13:49:48.796952 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.797125 (+ 173us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1854430}
I20260927 13:49:48.800076 4928 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
W20260927 13:49:48.800434 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e959f8c6fa74a1bbaf06d91c3e484bc already in progress: creating tablet
I20260927 13:49:48.801203 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 155) took 1854 ms. Trace:
I20260927 13:49:48.801308 5606 rpcz_store.cc:276] 0927 13:49:46.946931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:46.951977 (+ 5046us) service_pool.cc:224] Handling call
0927 13:49:48.801054 (+1849077us) ts_tablet_manager.cc:1151] Deleting tablet a3b1d54e4af0432f9d1ef9879d2ec4e9
0927 13:49:48.801065 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.801166 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1848803}
W20260927 13:49:48.801787 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 already in progress: creating tablet
I20260927 13:49:48.802130 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_33b78a7e92ec433d8ca4472fdb03f35c" } new_table_name: "default.Table_c381014a617d46298a7927df0468de9c" modify_external_catalogs: true
I20260927 13:49:48.803423 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc174eab36b46fb8e276b3168fbfbcd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:48.804069 5044 leader_election.cc:343] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.804246 5044 leader_election.cc:304] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:48.804597 6044 raft_consensus.cc:2749] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:48.804806 6044 raft_consensus.cc:493] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.804965 6044 raft_consensus.cc:515] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.805636 6044 leader_election.cc:290] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.805976 5625 raft_consensus.cc:2243] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.806156 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ffe83306e74749b5b3f68e6c2c708c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.806190 5625 raft_consensus.cc:2272] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.806704 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910b73528ed949bc86badcc4cf6c74a3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:48.806785 5625 ts_tablet_manager.cc:1916] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:48.807435 5045 leader_election.cc:343] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.808915 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c976a667e7c4b948b3aa176b13b7d0d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:48.809059 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d1cf0c8faaa24af2b046a519baa60406" } new_table_name: "default.Table_977d1a0483e64f658c2eaead2cc16803" modify_external_catalogs: true
I20260927 13:49:48.806813 5727 raft_consensus.cc:515] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.809778 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 156) took 1802 ms. Trace:
I20260927 13:49:48.809899 5606 rpcz_store.cc:276] 0927 13:49:47.006945 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.009339 (+ 2394us) service_pool.cc:224] Handling call
0927 13:49:48.808355 (+1799016us) ts_tablet_manager.cc:1151] Deleting tablet c7670d5f54df49f4a074588ab9269145
0927 13:49:48.808362 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.809743 (+ 1381us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1798254}
I20260927 13:49:48.810217 5727 leader_election.cc:290] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:48.810359 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet c7670d5f54df49f4a074588ab9269145 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7670d5f54df49f4a074588ab9269145 already in progress: creating tablet
W20260927 13:49:48.810675 5044 leader_election.cc:343] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.810786 5044 leader_election.cc:304] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:48.810830 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8bd375289d574bfeba1cc363b93ad32f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:48.811177 6043 raft_consensus.cc:2749] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:48.811363 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bd375289d574bfeba1cc363b93ad32f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.812682 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8f37429d15a547309157abf1d100b8a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.813262 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f37429d15a547309157abf1d100b8a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.814008 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_73379a6f459d47958328cadfbd64bdce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:48.814376 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4c568b96084baeb7438a4857adadc1" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
W20260927 13:49:48.814508 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73379a6f459d47958328cadfbd64bdce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.814494 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 160) took 1652 ms. Trace:
I20260927 13:49:48.814571 5109 raft_consensus.cc:2468] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:48.814615 5606 rpcz_store.cc:276] 0927 13:49:47.162417 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.163567 (+ 1150us) service_pool.cc:224] Handling call
0927 13:49:48.814366 (+1650799us) ts_tablet_manager.cc:1151] Deleting tablet 24bf9abe277040078eb765728e3c52ef
0927 13:49:48.814375 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.814460 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1650382}
I20260927 13:49:48.814951 5606 tablet_replica.cc:333] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:48.815151 5606 raft_consensus.cc:2243] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 2 LEADER]: Raft consensus shutting down.
I20260927 13:49:48.815498 5606 raft_consensus.cc:2272] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:48.815662 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 24bf9abe277040078eb765728e3c52ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24bf9abe277040078eb765728e3c52ef already in progress: creating tablet
I20260927 13:49:48.816083 5606 ts_tablet_manager.cc:1916] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.818157 5626 tablet_bootstrap.cc:492] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:48.818020 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_68a7db0e7ab24bd9b8e401ef348959ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:48.818569 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68a7db0e7ab24bd9b8e401ef348959ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.820789 5628 tablet_bootstrap.cc:492] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.820932 5628 ts_tablet_manager.cc:1403] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.006s
I20260927 13:49:48.821683 5628 raft_consensus.cc:359] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.821848 5628 raft_consensus.cc:385] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.821938 5628 raft_consensus.cc:740] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.822206 5628 consensus_queue.cc:260] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.822968 5628 ts_tablet_manager.cc:1434] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:48.824725 5625 ts_tablet_manager.cc:1929] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.824954 5625 log.cc:1199] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/195ce37d4abf4b92af22b46654b86ba5
I20260927 13:49:48.825403 5625 ts_tablet_manager.cc:1950] T 195ce37d4abf4b92af22b46654b86ba5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.826151 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d19f692aecb1401a8f49d2595a038ce8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:48.826653 5628 tablet_bootstrap.cc:492] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:49:48.826715 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d19f692aecb1401a8f49d2595a038ce8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:48.828658 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2329b988f5d9410d96eca321a7b8f3a6
I20260927 13:49:48.829160 4923 catalog_manager.cc:6934] ReplaceTablet: tablet 2329b988f5d9410d96eca321a7b8f3a6 deleted and replaced by tablet 1ac23ce85393457e8fd5402a9e0f55cb
I20260927 13:49:48.829497 5628 tablet_bootstrap.cc:654] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.830369 5619 tablet_bootstrap.cc:492] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:48.830628 5625 tablet_replica.cc:333] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.830739 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 195ce37d4abf4b92af22b46654b86ba5 (table default.Table_34e3d06c06ed4b90b3444e8c803d2e07 [id=ce8690509c5c4110bf5dd62244aceb46]) successfully deleted
I20260927 13:49:48.830816 5625 raft_consensus.cc:2243] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.830973 5619 ts_tablet_manager.cc:1403] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.230s user 0.003s sys 0.009s
I20260927 13:49:48.830996 5625 raft_consensus.cc:2272] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.831501 5625 ts_tablet_manager.cc:1916] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.831727 5619 raft_consensus.cc:359] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.831929 5619 raft_consensus.cc:385] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.832012 5619 raft_consensus.cc:740] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.832253 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 2329b988f5d9410d96eca321a7b8f3a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ac23ce85393457e8fd5402a9e0f55cb) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:48.832340 5619 consensus_queue.cc:260] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.835264 5619 ts_tablet_manager.cc:1434] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:48.835631 5619 tablet_bootstrap.cc:492] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:48.836773 6068 raft_consensus.cc:493] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.836908 6068 raft_consensus.cc:515] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.838209 6068 leader_election.cc:290] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:48.839677 5319 leader_election.cc:343] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b783ffbf2a05453fa43797ce495f8e7a
I20260927 13:49:48.840757 5625 ts_tablet_manager.cc:1929] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.840894 5625 log.cc:1199] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/2efee56b495340baa6dd51f0f3e2aaa7
I20260927 13:49:48.841282 5625 ts_tablet_manager.cc:1950] T 2efee56b495340baa6dd51f0f3e2aaa7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.844300 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_812430ef8c1c4462ae6a6663805f50b8" } modify_external_catalogs: true
I20260927 13:49:48.844560 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_812430ef8c1c4462ae6a6663805f50b8" } modify_external_catalogs: true
I20260927 13:49:48.847627 5625 tablet_replica.cc:333] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.847862 5625 raft_consensus.cc:2243] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.847903 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 2efee56b495340baa6dd51f0f3e2aaa7 (table default.Table_009df0f55a87479eab602a85d1503bf9 [id=1ea34fa23bae4ba88424a02d4e54a803]) successfully deleted
W20260927 13:49:48.848169 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 4abe721ef8614d86870a0526de69014f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4abe721ef8614d86870a0526de69014f already in progress: creating tablet
W20260927 13:49:48.848809 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1efaf62692c545dcaa5175fcd826785a has no consensus state
I20260927 13:49:48.849035 5625 raft_consensus.cc:2272] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.849628 5625 ts_tablet_manager.cc:1916] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.855747 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 03917a40b5884401a6bc09c7925fd1ae (DEFAULT_TABLE table=default.Table_5e60c258bac24c7cabc2b7e1e6052193 [id=a160103a454d421c8be6a88afa7c1419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.857110 5619 tablet_bootstrap.cc:654] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.861901 5214 tablet_service.cc:1511] Processing CreateTablet for tablet ec40378eb80c412198d5b66c02e975ef (DEFAULT_TABLE table=default.Table_298f6b42cb084ec7abaaea11e41d12b9 [id=27609594a3c74bf895858e5dc48a543e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.864355 5625 ts_tablet_manager.cc:1929] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.864521 5625 log.cc:1199] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/910b73528ed949bc86badcc4cf6c74a3
I20260927 13:49:48.864645 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet 2c976a667e7c4b948b3aa176b13b7d0d from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.866014 5625 ts_tablet_manager.cc:1950] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.866894 5625 tablet_replica.cc:333] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.866858 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 910b73528ed949bc86badcc4cf6c74a3 (table default.Table_791bee87bef64e35bb7c22d8611be6d5 [id=53769bb0c70748e6b710b518250b2649]) successfully deleted
I20260927 13:49:48.867106 5625 raft_consensus.cc:2243] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.867314 5625 raft_consensus.cc:2272] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:48.867568 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b64d3aa052bf4c48b3802f6006cce9c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b64d3aa052bf4c48b3802f6006cce9c9 already in progress: creating tablet
I20260927 13:49:48.867638 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4c568b96084baeb7438a4857adadc1" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:48.867884 5625 ts_tablet_manager.cc:1916] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.867878 5384 raft_consensus.cc:2468] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:48.867846 5220 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f34f2d0f6e9420a8ad38d708b658b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.871302 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 2329b988f5d9410d96eca321a7b8f3a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ac23ce85393457e8fd5402a9e0f55cb) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:48.871496 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 931a48792f4c4525bd563a4dd1062e35 (DEFAULT_TABLE table=default.Table_dfa3b09930634e67ba11591b71147d46 [id=bed97aef149a417bb3807414f58ba52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.868218 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910b73528ed949bc86badcc4cf6c74a3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:48.878489 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet b0fd6fb92eb64e948e67f70c512376e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.878978 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b783ffbf2a05453fa43797ce495f8e7a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:48.879683 5319 leader_election.cc:343] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.879897 5319 leader_election.cc:304] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:48.880470 6068 raft_consensus.cc:2749] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:48.881085 5216 tablet_service.cc:1558] Processing DeleteTablet for tablet 2329b988f5d9410d96eca321a7b8f3a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ac23ce85393457e8fd5402a9e0f55cb) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.881578 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 31ee75d0a39c42b09f2f46a1774f925c (DEFAULT_TABLE table=default.Table_ee4b85ee72994fe596598538d6755252 [id=c2ce8f3fda214134bf35a2866675d0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.883193 5625 ts_tablet_manager.cc:1929] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.883436 5625 log.cc:1199] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/85805d532ffa4c79974ce25041a72205
W20260927 13:49:48.883424 5319 consensus_peers.cc:597] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3663033220094a4ea6df8e2982eb2188. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:48.883827 5625 ts_tablet_manager.cc:1950] T 85805d532ffa4c79974ce25041a72205 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.884567 5625 tablet_replica.cc:333] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.884568 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 85805d532ffa4c79974ce25041a72205 (table default.Table_ee17c48a3ba7447594c552e6d7f13b1a [id=eb074c2c15c542e59ca9fb68049ac69c]) successfully deleted
I20260927 13:49:48.884796 5625 raft_consensus.cc:2243] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.884966 5625 raft_consensus.cc:2272] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:48.885773 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 321b26c89f1a4c8d88f401c8ece448b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 321b26c89f1a4c8d88f401c8ece448b0 already in progress: creating tablet
I20260927 13:49:48.886142 5226 tablet_service.cc:1558] Processing DeleteTablet for tablet 129c2f99d5b143b3bd25731cfeb0009e with delete_type TABLET_DATA_DELETED (replaced by tablet 46537e1b33f24d50b705d53f6978da3c) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:48.887290 5184 leader_election.cc:304] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:48.887447 5623 ts_tablet_manager.cc:1929] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.887569 5623 log.cc:1199] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/df271399b2c84653ac4a5b74efdc0197
I20260927 13:49:48.887696 5727 raft_consensus.cc:2804] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:48.887794 5727 raft_consensus.cc:493] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:48.887914 5727 raft_consensus.cc:3060] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.888051 5623 ts_tablet_manager.cc:1950] T df271399b2c84653ac4a5b74efdc0197 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:48.888473 5625 ts_tablet_manager.cc:1916] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:48.887578 5184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 70809.1us
I20260927 13:49:48.889041 5623 tablet_replica.cc:333] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:48.889259 5623 raft_consensus.cc:2243] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.889410 5623 raft_consensus.cc:2272] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.889935 5623 ts_tablet_manager.cc:1916] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.890076 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03917a40b5884401a6bc09c7925fd1ae. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:48.890728 5044 leader_election.cc:343] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.890857 5044 leader_election.cc:304] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:48.891106 5044 raft_consensus.cc:2686] T 910b73528ed949bc86badcc4cf6c74a3 P 34fc5fe0a32d42ab83f4aa6d07341409: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:49:48.892033 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec40378eb80c412198d5b66c02e975ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.887351 5626 ts_tablet_manager.cc:1403] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.231s user 0.000s sys 0.007s
I20260927 13:49:48.894178 5626 raft_consensus.cc:359] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.894399 5626 raft_consensus.cc:385] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.894471 5626 raft_consensus.cc:740] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.894752 5626 consensus_queue.cc:260] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.895249 5626 ts_tablet_manager.cc:1434] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:48.895977 5626 tablet_bootstrap.cc:492] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:48.896158 5628 tablet_bootstrap.cc:492] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.896325 5628 ts_tablet_manager.cc:1403] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.070s user 0.010s sys 0.021s
I20260927 13:49:48.896536 4928 master_service.cc:960] ReplaceTablet: received request to replace tablet 80b1970a344045389709260c850adc07 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:48.897070 5628 raft_consensus.cc:359] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.897285 5628 raft_consensus.cc:385] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 13:49:48.897291 5319 consensus_peers.cc:597] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3663033220094a4ea6df8e2982eb2188. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:48.897358 5628 raft_consensus.cc:740] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.897619 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet df271399b2c84653ac4a5b74efdc0197 (table default.Table_4a67727b46b74c27a439bc32c6cb411f [id=a8628dbf015640b9ad49c4aa66f46cac]) successfully deleted
I20260927 13:49:48.897627 5628 consensus_queue.cc:260] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.898059 5606 ts_tablet_manager.cc:1929] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260927 13:49:48.898272 5606 log.cc:1199] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/70d1197bee2d477ab77d15cbd4907595
I20260927 13:49:48.898295 5628 ts_tablet_manager.cc:1434] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:48.898574 5628 tablet_bootstrap.cc:492] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.899091 5606 ts_tablet_manager.cc:1950] T 70d1197bee2d477ab77d15cbd4907595 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:48.900712 5628 tablet_bootstrap.cc:654] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.904249 5619 tablet_bootstrap.cc:492] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:48.904345 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 168) took 1553 ms. Trace:
I20260927 13:49:48.904443 5619 ts_tablet_manager.cc:1403] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.001s
I20260927 13:49:48.904475 5606 rpcz_store.cc:276] 0927 13:49:47.351356 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.351405 (+ 49us) service_pool.cc:224] Handling call
0927 13:49:48.814887 (+1463482us) ts_tablet_manager.cc:1151] Deleting tablet 70d1197bee2d477ab77d15cbd4907595
0927 13:49:48.814895 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.882581 (+ 67686us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.897982 (+ 15401us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.904292 (+ 6310us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1463276}
I20260927 13:49:48.905189 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ee75d0a39c42b09f2f46a1774f925c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.906045 5625 ts_tablet_manager.cc:1929] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.906205 5625 log.cc:1199] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/0c72e1a5dced499a932bdc302e006f29
I20260927 13:49:48.906553 5625 ts_tablet_manager.cc:1950] T 0c72e1a5dced499a932bdc302e006f29 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.907183 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 0c72e1a5dced499a932bdc302e006f29 (table default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]) successfully deleted
I20260927 13:49:48.907460 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 70d1197bee2d477ab77d15cbd4907595 (table default.Table_dfa3b09930634e67ba11591b71147d46 [id=bed97aef149a417bb3807414f58ba52a]) successfully deleted
I20260927 13:49:48.905210 5619 raft_consensus.cc:359] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.907672 5619 raft_consensus.cc:385] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.907775 5619 raft_consensus.cc:740] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:49:48.907764 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 31ee75d0a39c42b09f2f46a1774f925c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ee75d0a39c42b09f2f46a1774f925c already in progress: creating tablet
W20260927 13:49:48.908046 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 80b1970a344045389709260c850adc07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80b1970a344045389709260c850adc07 already in progress: creating tablet
I20260927 13:49:48.908012 5619 consensus_queue.cc:260] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.908368 5625 tablet_replica.cc:333] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:48.908538 5619 ts_tablet_manager.cc:1434] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 13:49:48.908569 5625 raft_consensus.cc:2243] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.908743 5625 raft_consensus.cc:2272] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.908979 5619 tablet_bootstrap.cc:492] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:48.909109 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b8311ff24259477a9523355908ac14f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8311ff24259477a9523355908ac14f8 already in progress: creating tablet
I20260927 13:49:48.909242 5625 ts_tablet_manager.cc:1916] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.909649 5081 tablet_service.cc:1511] Processing CreateTablet for tablet ec40378eb80c412198d5b66c02e975ef (DEFAULT_TABLE table=default.Table_298f6b42cb084ec7abaaea11e41d12b9 [id=27609594a3c74bf895858e5dc48a543e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:48.910985 5606 tablet_replica.cc:333] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:48.911165 5606 raft_consensus.cc:2243] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.911231 5628 tablet_bootstrap.cc:492] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.911363 5628 ts_tablet_manager.cc:1403] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260927 13:49:48.912503 5628 raft_consensus.cc:359] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.912703 5628 raft_consensus.cc:385] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.912794 5628 raft_consensus.cc:740] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.913019 5628 consensus_queue.cc:260] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.913620 5628 ts_tablet_manager.cc:1434] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:49:48.913851 5628 tablet_bootstrap.cc:492] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.913854 6068 raft_consensus.cc:493] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.913988 6068 raft_consensus.cc:515] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.914270 5606 raft_consensus.cc:2272] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.914691 6068 leader_election.cc:290] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.914844 5606 ts_tablet_manager.cc:1916] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.915441 5628 tablet_bootstrap.cc:654] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.915371 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c1b74943b9479e8b37969b2933c5a4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:48.916038 5319 leader_election.cc:343] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.920997 5628 tablet_bootstrap.cc:492] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:48.921161 5628 ts_tablet_manager.cc:1403] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260927 13:49:48.921358 5619 tablet_bootstrap.cc:654] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.922852 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c1b74943b9479e8b37969b2933c5a4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:48.923053 5109 raft_consensus.cc:2468] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:48.923934 5319 leader_election.cc:304] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:48.924408 6068 raft_consensus.cc:2804] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:48.924525 6068 raft_consensus.cc:493] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:48.924619 6068 raft_consensus.cc:3060] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.927742 6068 raft_consensus.cc:515] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.928505 6068 leader_election.cc:290] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:48.934091 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c1b74943b9479e8b37969b2933c5a4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:48.934369 5109 raft_consensus.cc:3060] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.934289 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c1b74943b9479e8b37969b2933c5a4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:49:48.936544 5319 leader_election.cc:343] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:48.937264 5109 raft_consensus.cc:2468] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:48.942003 5319 leader_election.cc:304] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:48.942996 5619 tablet_bootstrap.cc:492] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:48.943038 6068 raft_consensus.cc:2804] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:48.943207 5619 ts_tablet_manager.cc:1403] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.003s
I20260927 13:49:48.943310 6068 raft_consensus.cc:697] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:48.943629 6068 consensus_queue.cc:237] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.944083 5619 raft_consensus.cc:359] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.944993 5619 raft_consensus.cc:385] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.945762 5619 raft_consensus.cc:740] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.949879 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931a48792f4c4525bd563a4dd1062e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.951627 5619 consensus_queue.cc:260] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.952982 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec40378eb80c412198d5b66c02e975ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:48.953280 5606 ts_tablet_manager.cc:1929] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:48.953460 5606 log.cc:1199] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/4295710c33714360b3691f48f47f4293
I20260927 13:49:48.953970 5606 ts_tablet_manager.cc:1950] T 4295710c33714360b3691f48f47f4293 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:48.954813 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 169) took 1593 ms. Trace:
I20260927 13:49:48.955562 5619 ts_tablet_manager.cc:1434] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.012s user 0.002s sys 0.001s
I20260927 13:49:48.955541 5606 rpcz_store.cc:276] 0927 13:49:47.361340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.361791 (+ 451us) service_pool.cc:224] Handling call
0927 13:49:48.910907 (+1549116us) ts_tablet_manager.cc:1151] Deleting tablet 4295710c33714360b3691f48f47f4293
0927 13:49:48.910915 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.936942 (+ 26027us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.951341 (+ 14399us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.954775 (+ 3434us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1548893}
I20260927 13:49:48.957029 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 4295710c33714360b3691f48f47f4293 (table default.Table_97bdee39a93e4f98ae6382e7ab44eda7 [id=2fe2768ea9264c38973e4ed5206c77f2]) successfully deleted
I20260927 13:49:48.957371 5606 tablet_replica.cc:333] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:48.957617 5606 raft_consensus.cc:2243] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:48.957844 5606 raft_consensus.cc:2272] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:48.958961 5606 ts_tablet_manager.cc:1916] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:48.959782 5628 raft_consensus.cc:359] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.960094 5628 raft_consensus.cc:385] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.960194 5628 raft_consensus.cc:740] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.960479 5628 consensus_queue.cc:260] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.961097 5628 ts_tablet_manager.cc:1434] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.040s user 0.002s sys 0.001s
I20260927 13:49:48.961030 5727 raft_consensus.cc:515] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.962131 5628 tablet_bootstrap.cc:492] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:48.956154 5619 tablet_bootstrap.cc:492] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:48.964448 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4c568b96084baeb7438a4857adadc1" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:48.964659 5109 raft_consensus.cc:3060] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:48.965790 5619 tablet_bootstrap.cc:654] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.967845 5727 leader_election.cc:290] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:48.970702 5626 tablet_bootstrap.cc:654] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.972739 5606 ts_tablet_manager.cc:1929] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.972774 5628 tablet_bootstrap.cc:654] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:48.972997 5606 log.cc:1199] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/a61eedf06dab4096a397da8ce98a07da
I20260927 13:49:48.973436 5606 ts_tablet_manager.cc:1950] T a61eedf06dab4096a397da8ce98a07da P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:48.974360 5625 ts_tablet_manager.cc:1929] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:48.974776 5625 log.cc:1199] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/1f34f2d0f6e9420a8ad38d708b658b17
I20260927 13:49:48.975324 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 170) took 1613 ms. Trace:
I20260927 13:49:48.975885 5606 rpcz_store.cc:276] 0927 13:49:47.361492 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.362056 (+ 564us) service_pool.cc:224] Handling call
0927 13:49:48.957308 (+1595252us) ts_tablet_manager.cc:1151] Deleting tablet a61eedf06dab4096a397da8ce98a07da
0927 13:49:48.957317 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.967577 (+ 10260us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.972662 (+ 5085us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:48.975267 (+ 2605us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1594916}
I20260927 13:49:48.977787 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet a61eedf06dab4096a397da8ce98a07da (table default.Table_62531a04ef9143aa9089eb9779aee6f5 [id=823e5f62db3849ce913eba29b20a4e0a]) successfully deleted
I20260927 13:49:48.978360 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 172) took 1616 ms. Trace:
I20260927 13:49:48.980322 5606 rpcz_store.cc:276] 0927 13:49:47.361734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.362187 (+ 453us) service_pool.cc:224] Handling call
0927 13:49:48.978185 (+1615998us) ts_tablet_manager.cc:1151] Deleting tablet a1489f766164444b9aaa7b58e81a72d9
0927 13:49:48.978212 (+ 27us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.978300 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1614563}
W20260927 13:49:48.981225 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a1489f766164444b9aaa7b58e81a72d9 because the tablet was not found. No further retry: Not found: Tablet not found: a1489f766164444b9aaa7b58e81a72d9
I20260927 13:49:48.982484 5625 ts_tablet_manager.cc:1950] T 1f34f2d0f6e9420a8ad38d708b658b17 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:48.983361 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 171) took 1621 ms. Trace:
I20260927 13:49:48.983861 5606 rpcz_store.cc:276] 0927 13:49:47.361600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.362162 (+ 562us) service_pool.cc:224] Handling call
0927 13:49:48.983190 (+1621028us) ts_tablet_manager.cc:1151] Deleting tablet 7e6721aa2fa0437eae7ca052c19f0f2e
0927 13:49:48.983212 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.983307 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1596292}
W20260927 13:49:48.984680 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 7e6721aa2fa0437eae7ca052c19f0f2e because the tablet was not found. No further retry: Not found: Tablet not found: 7e6721aa2fa0437eae7ca052c19f0f2e
I20260927 13:49:48.985234 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 179) took 1239 ms. Trace:
I20260927 13:49:48.986014 5606 rpcz_store.cc:276] 0927 13:49:47.745566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.745644 (+ 78us) service_pool.cc:224] Handling call
0927 13:49:48.985062 (+1239418us) ts_tablet_manager.cc:1151] Deleting tablet a6af740383384609a354d7f0fae2cd70
0927 13:49:48.985072 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.985171 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1239171}
W20260927 13:49:48.986572 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a6af740383384609a354d7f0fae2cd70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6af740383384609a354d7f0fae2cd70 already in progress: creating tablet
I20260927 13:49:48.986871 5891 raft_consensus.cc:493] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:48.987042 5891 raft_consensus.cc:515] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.987299 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 180) took 1241 ms. Trace:
I20260927 13:49:48.988191 5606 rpcz_store.cc:276] 0927 13:49:47.745767 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.746391 (+ 624us) service_pool.cc:224] Handling call
0927 13:49:48.987090 (+1240699us) ts_tablet_manager.cc:1151] Deleting tablet 6bb5fdbfebd5401e92186997f9a30d36
0927 13:49:48.987099 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.987164 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1240525}
W20260927 13:49:48.988734 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 6bb5fdbfebd5401e92186997f9a30d36 because the tablet was not found. No further retry: Not found: Tablet not found: 6bb5fdbfebd5401e92186997f9a30d36
I20260927 13:49:48.988091 5619 tablet_bootstrap.cc:492] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:48.989111 5619 ts_tablet_manager.cc:1403] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.005s
I20260927 13:49:48.989234 5891 leader_election.cc:290] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:48.989981 5619 raft_consensus.cc:359] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.990259 5619 raft_consensus.cc:385] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:48.990432 5619 raft_consensus.cc:740] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:48.990715 5619 consensus_queue.cc:260] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:48.991308 5619 ts_tablet_manager.cc:1434] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:48.991654 5619 tablet_bootstrap.cc:492] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:48.994562 5184 leader_election.cc:343] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b783ffbf2a05453fa43797ce495f8e7a
I20260927 13:49:48.995504 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 182) took 1249 ms. Trace:
I20260927 13:49:48.995667 5606 rpcz_store.cc:276] 0927 13:49:47.746027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.746595 (+ 568us) service_pool.cc:224] Handling call
0927 13:49:48.995297 (+1248702us) ts_tablet_manager.cc:1151] Deleting tablet b4bdd64d67d94276b20ab862dec0d2ee
0927 13:49:48.995306 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.995450 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1248561}
W20260927 13:49:48.996225 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b4bdd64d67d94276b20ab862dec0d2ee because the tablet was not found. No further retry: Not found: Tablet not found: b4bdd64d67d94276b20ab862dec0d2ee
I20260927 13:49:48.996665 5606 tablet_replica.cc:333] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:48.997555 5606 raft_consensus.cc:2243] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:48.999851 5628 tablet_bootstrap.cc:492] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.000021 5628 ts_tablet_manager.cc:1403] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.002s
I20260927 13:49:49.001389 5628 raft_consensus.cc:359] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.001595 5628 raft_consensus.cc:385] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.001680 5628 raft_consensus.cc:740] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.001940 5628 consensus_queue.cc:260] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.002530 5628 ts_tablet_manager.cc:1434] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:49:49.002911 5606 pending_rounds.cc:70] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:49.002985 5606 pending_rounds.cc:77] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957580480110592 op_type: NO_OP noop_request { }
I20260927 13:49:49.003120 5606 raft_consensus.cc:2889] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:49.003244 5606 raft_consensus.cc:2272] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.003912 5606 ts_tablet_manager.cc:1916] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.005134 5628 tablet_bootstrap.cc:492] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:49.004084 5619 tablet_bootstrap.cc:654] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.009539 5109 raft_consensus.cc:2468] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:49.004606 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4c568b96084baeb7438a4857adadc1" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:49.004906 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b783ffbf2a05453fa43797ce495f8e7a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:49.010057 5384 raft_consensus.cc:2468] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:49.005234 5383 raft_consensus.cc:3060] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:49.011159 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 1f34f2d0f6e9420a8ad38d708b658b17 (table default.Table_f4169b61d7234a6286c6c26a3b3b2c65 [id=30320123ccb44660bb6013069aa42e18]) successfully deleted
I20260927 13:49:49.010058 5385 raft_consensus.cc:3060] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:49.016775 5385 raft_consensus.cc:2468] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:49.019845 5626 tablet_bootstrap.cc:492] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:49.024536 5606 ts_tablet_manager.cc:1929] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.010854 5625 tablet_replica.cc:333] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:49.019381 5628 tablet_bootstrap.cc:654] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.026284 5625 raft_consensus.cc:2243] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.026526 5625 raft_consensus.cc:2272] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.027210 5625 ts_tablet_manager.cc:1916] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.036747 5626 ts_tablet_manager.cc:1403] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.126s user 0.004s sys 0.001s
I20260927 13:49:49.037997 5185 leader_election.cc:304] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:49.038512 5894 raft_consensus.cc:2804] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:49.040226 5894 raft_consensus.cc:493] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:49.040382 5894 raft_consensus.cc:3060] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:49.040938 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fec7020fbf30493cbe6a218ae1cc9dab" } modify_external_catalogs: true
I20260927 13:49:49.041162 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fec7020fbf30493cbe6a218ae1cc9dab" } modify_external_catalogs: true
I20260927 13:49:49.041316 5184 leader_election.cc:304] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:49.041826 4921 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_847c101270804f9f856b7e564cc9fbbe" } modify_external_catalogs: true
I20260927 13:49:49.041998 4921 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_847c101270804f9f856b7e564cc9fbbe" } modify_external_catalogs: true
I20260927 13:49:49.042470 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6f968553a801422ba747b1d4516c2074" } modify_external_catalogs: true
I20260927 13:49:49.042629 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6f968553a801422ba747b1d4516c2074" } modify_external_catalogs: true
I20260927 13:49:49.044976 5894 raft_consensus.cc:515] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.045619 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3efafc6b184f4f73bd2b6fad23d8991c" } modify_external_catalogs: true
I20260927 13:49:49.045753 5894 leader_election.cc:290] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:49.045796 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3efafc6b184f4f73bd2b6fad23d8991c" } modify_external_catalogs: true
I20260927 13:49:49.045969 5894 raft_consensus.cc:2804] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:49.046093 5894 raft_consensus.cc:697] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:49.046452 5894 consensus_queue.cc:237] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.047739 5606 log.cc:1199] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/14d3a3282d684415858dc971cb02eec1
I20260927 13:49:49.047561 6045 consensus_queue.cc:1048] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260927 13:49:49.048170 5606 ts_tablet_manager.cc:1950] T 14d3a3282d684415858dc971cb02eec1 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.041667 5891 consensus_queue.cc:1048] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
W20260927 13:49:49.048810 4915 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 825a73d47bff4246965be82eb482f7aa (table default.Table_de911651b6ff4188876ef1d412e041b7 [id=119de2adb4d24563b76c6099dec2d9a9], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 825a73d47bff4246965be82eb482f7aa consensus state has no leader
I20260927 13:49:49.035219 6068 raft_consensus.cc:493] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.049763 6068 raft_consensus.cc:515] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.050580 6068 leader_election.cc:290] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:49.051647 5319 leader_election.cc:343] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: dff5992b27f049f5890e65d5a8dcc3cf
I20260927 13:49:49.042562 5619 tablet_bootstrap.cc:492] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:49.052210 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b783ffbf2a05453fa43797ce495f8e7a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:49.052416 5383 raft_consensus.cc:3060] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:49.053156 5619 ts_tablet_manager.cc:1403] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.062s user 0.007s sys 0.002s
I20260927 13:49:49.057341 5619 raft_consensus.cc:359] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:49.066015 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_73379a6f459d47958328cadfbd64bdce" } new_table_name: "default.Table_6697aa5e44b143bd8c7c394f45b4ba7a" modify_external_catalogs: true
I20260927 13:49:49.057509 5383 raft_consensus.cc:2468] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:49.069504 5619 raft_consensus.cc:385] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.072150 5185 leader_election.cc:304] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:49.076689 5623 ts_tablet_manager.cc:1929] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.076887 5218 tablet_service.cc:1558] Processing DeleteTablet for tablet b783ffbf2a05453fa43797ce495f8e7a with delete_type TABLET_DATA_DELETED (replaced by tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.083361 5625 ts_tablet_manager.cc:1929] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.083559 5625 log.cc:1199] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b0fd6fb92eb64e948e67f70c512376e2
I20260927 13:49:49.083994 5625 ts_tablet_manager.cc:1950] T b0fd6fb92eb64e948e67f70c512376e2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:49.084537 5625 tablet_replica.cc:333] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:49.084664 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b0fd6fb92eb64e948e67f70c512376e2 (table default.Table_f3005f35fe3f408bac8f54c5a509d4ad [id=aa02060d09be44a7ad563c010ba2b274]) successfully deleted
I20260927 13:49:49.084795 5625 raft_consensus.cc:2243] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.085007 5625 raft_consensus.cc:2272] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.085659 5625 ts_tablet_manager.cc:1916] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.086668 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff5992b27f049f5890e65d5a8dcc3cf" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.088053 6094 raft_consensus.cc:2804] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:49.088327 6094 raft_consensus.cc:697] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:49.091943 5628 tablet_bootstrap.cc:492] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.094154 6043 raft_consensus.cc:493] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.094339 6043 raft_consensus.cc:515] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.099471 4749 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu pid 4825
I20260927 13:49:49.100760 4889 generic_service.cc:196] Checking for leaks (request via RPC)
I20260927 13:49:49.101563 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f0ac9487c6b5426eaebbdbb92e46c3ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.102427 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0ac9487c6b5426eaebbdbb92e46c3ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.104024 5619 raft_consensus.cc:740] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.104527 5619 consensus_queue.cc:260] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:49.105288 5619 ts_tablet_manager.cc:1434] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.051s user 0.000s sys 0.002s
I20260927 13:49:49.088059 5626 raft_consensus.cc:359] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:49.087361 5319 leader_election.cc:343] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:49.112962 5184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 55232us
I20260927 13:49:49.113016 5319 leader_election.cc:304] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:49.112998 6088 tablet.cc:1751] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:49.113729 6068 raft_consensus.cc:2749] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.083670 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 184) took 1335 ms. Trace:
I20260927 13:49:49.114161 5606 rpcz_store.cc:276] 0927 13:49:47.746334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.746769 (+ 435us) service_pool.cc:224] Handling call
0927 13:49:48.996575 (+1249806us) ts_tablet_manager.cc:1151] Deleting tablet 14d3a3282d684415858dc971cb02eec1
0927 13:49:48.996583 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.021212 (+ 24629us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.024453 (+ 3241us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.081949 (+ 57496us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1249644}
I20260927 13:49:49.114400 5626 raft_consensus.cc:385] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.114655 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 181) took 1368 ms. Trace:
I20260927 13:49:49.114758 5606 rpcz_store.cc:276] 0927 13:49:47.745907 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.746958 (+ 1051us) service_pool.cc:224] Handling call
0927 13:49:49.114482 (+1367524us) ts_tablet_manager.cc:1151] Deleting tablet 587471d2b7e647388e7bb1e7f8e06b40
0927 13:49:49.114496 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.114591 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1367355}
I20260927 13:49:49.115146 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 183) took 1368 ms. Trace:
I20260927 13:49:49.115232 5606 rpcz_store.cc:276] 0927 13:49:47.746188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.749932 (+ 3744us) service_pool.cc:224] Handling call
0927 13:49:49.115009 (+1365077us) ts_tablet_manager.cc:1151] Deleting tablet 66524dd4f62f4da4be845d5efefe8db1
0927 13:49:49.115021 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.115086 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364392}
I20260927 13:49:49.115494 6043 leader_election.cc:290] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.115653 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 186) took 1365 ms. Trace:
I20260927 13:49:49.115665 5628 ts_tablet_manager.cc:1403] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.087s user 0.011s sys 0.003s
I20260927 13:49:49.115734 5606 rpcz_store.cc:276] 0927 13:49:47.750583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.750642 (+ 59us) service_pool.cc:224] Handling call
0927 13:49:49.115506 (+1364864us) ts_tablet_manager.cc:1151] Deleting tablet c989f70385f64593a46f633c98267627
0927 13:49:49.115514 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.115604 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364664}
I20260927 13:49:49.116009 5606 tablet_replica.cc:333] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.116240 5606 raft_consensus.cc:2243] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.116978 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 14d3a3282d684415858dc971cb02eec1 (table default.Table_4333e4f147f24db68f8d26c70e28f4a4 [id=ff8466657bb24dd18b44b8d901412d8b]) successfully deleted
W20260927 13:49:49.117317 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 587471d2b7e647388e7bb1e7f8e06b40 because the tablet was not found. No further retry: Not found: Tablet not found: 587471d2b7e647388e7bb1e7f8e06b40
W20260927 13:49:49.117544 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 66524dd4f62f4da4be845d5efefe8db1 because the tablet was not found. No further retry: Not found: Tablet not found: 66524dd4f62f4da4be845d5efefe8db1
W20260927 13:49:49.117743 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet c989f70385f64593a46f633c98267627 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c989f70385f64593a46f633c98267627 already in progress: creating tablet
I20260927 13:49:49.118407 5606 raft_consensus.cc:2272] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.119158 5606 ts_tablet_manager.cc:1916] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.126497 5623 log.cc:1199] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/7cb2864ea38b4a538884a2c728f08313
I20260927 13:49:49.126080 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a49834518ff34b1981d44f3824c131f3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:49.140196 5626 raft_consensus.cc:740] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.140889 5623 ts_tablet_manager.cc:1950] T 7cb2864ea38b4a538884a2c728f08313 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:49.141738 5619 tablet_bootstrap.cc:492] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:49.144836 5045 leader_election.cc:343] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.146044 5628 raft_consensus.cc:359] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.146430 5628 raft_consensus.cc:385] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.146600 5628 raft_consensus.cc:740] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.146952 5628 consensus_queue.cc:260] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.148638 5619 tablet_bootstrap.cc:654] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.147565 5628 ts_tablet_manager.cc:1434] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260927 13:49:49.149138 5625 ts_tablet_manager.cc:1929] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.150635 5625 log.cc:1199] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/bc8f6354c1034814af3cc20df25ddb47
I20260927 13:49:49.150930 5628 tablet_bootstrap.cc:492] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:49.151059 5625 ts_tablet_manager.cc:1950] T bc8f6354c1034814af3cc20df25ddb47 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:49.151203 4925 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 1ac23ce85393457e8fd5402a9e0f55cb
I20260927 13:49:49.151521 5625 tablet_replica.cc:333] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:49.151728 5625 raft_consensus.cc:2243] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.151671 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_27f67bf75f984096adeb5e1be68feb3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:49.151875 5625 raft_consensus.cc:2272] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:49.152248 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27f67bf75f984096adeb5e1be68feb3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.152679 5625 ts_tablet_manager.cc:1916] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.153090 5628 tablet_bootstrap.cc:654] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.151683 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet bc8f6354c1034814af3cc20df25ddb47 (table default.Table_e6eff4f97e084636b5609c6c269cf5ec [id=4f32d603a6764a359605a945c924f6c5]) successfully deleted
I20260927 13:49:49.108517 6090 tablet.cc:1751] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260927 13:49:49.163363 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 64c7919f5076406186000cd4077aadaf has no consensus state
I20260927 13:49:49.164350 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet c79b1f2962f44a23916bbfe4cf55a4bc
I20260927 13:49:49.164368 5625 ts_tablet_manager.cc:1929] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.164507 5625 log.cc:1199] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/129c2f99d5b143b3bd25731cfeb0009e
I20260927 13:49:49.164882 5625 ts_tablet_manager.cc:1950] T 129c2f99d5b143b3bd25731cfeb0009e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:49.165148 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_b12c6e4211af4ab7b866815072339fe6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.165693 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b12c6e4211af4ab7b866815072339fe6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.160068 5606 ts_tablet_manager.cc:1929] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.165992 5606 log.cc:1199] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b783ffbf2a05453fa43797ce495f8e7a
I20260927 13:49:49.166368 5606 ts_tablet_manager.cc:1950] T b783ffbf2a05453fa43797ce495f8e7a P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.167140 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 185) took 1416 ms. Trace:
I20260927 13:49:49.167505 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet c79b1f2962f44a23916bbfe4cf55a4bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.168309 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_00fb64d2378d4fecbcc59cd9c70072aa" } new_table_name: "default.Table_eb3c068026374d0ca946d3a8bd94db90" modify_external_catalogs: true
I20260927 13:49:49.169768 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet c79b1f2962f44a23916bbfe4cf55a4bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.170027 5619 tablet_bootstrap.cc:492] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:49.170014 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8f37429d15a547309157abf1d100b8a2" } new_table_name: "default.Table_88984f1568c54b4398964528d6e45861" modify_external_catalogs: true
I20260927 13:49:49.170210 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 129c2f99d5b143b3bd25731cfeb0009e (table default.Table_22d5c80b2b5b4ee09361300740be2ab2 [id=f78659fb9203483aa74b05e453e1fa63]) successfully deleted
I20260927 13:49:49.174244 5628 tablet_bootstrap.cc:492] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.174469 5628 ts_tablet_manager.cc:1403] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.001s
I20260927 13:49:49.175243 5628 raft_consensus.cc:359] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.175491 5628 raft_consensus.cc:385] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.175611 5628 raft_consensus.cc:740] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.175904 5628 consensus_queue.cc:260] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.176565 5628 ts_tablet_manager.cc:1434] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:49.176877 5628 tablet_bootstrap.cc:492] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:49.177487 5625 tablet_replica.cc:333] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:49.177704 5625 raft_consensus.cc:2243] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.177948 5625 raft_consensus.cc:2272] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.178627 5625 ts_tablet_manager.cc:1916] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.179023 5628 tablet_bootstrap.cc:654] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.182694 5619 ts_tablet_manager.cc:1403] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.041s user 0.000s sys 0.003s
I20260927 13:49:49.182829 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 197) took 1203 ms. Trace:
I20260927 13:49:49.182971 5623 rpcz_store.cc:276] 0927 13:49:47.938716 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.939063 (+ 347us) service_pool.cc:224] Handling call
0927 13:49:48.888980 (+949917us) ts_tablet_manager.cc:1151] Deleting tablet 7cb2864ea38b4a538884a2c728f08313
0927 13:49:48.888988 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:48.922147 (+ 33159us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.076607 (+154460us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.141791 (+ 65184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3,"tablet-delete.queue_time_us":949778}
I20260927 13:49:49.107463 6094 consensus_queue.cc:237] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.183696 5619 raft_consensus.cc:359] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.183874 5619 raft_consensus.cc:385] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.183951 5619 raft_consensus.cc:740] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.167260 5606 rpcz_store.cc:276] 0927 13:49:47.750390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.750879 (+ 489us) service_pool.cc:224] Handling call
0927 13:49:49.115926 (+1365047us) ts_tablet_manager.cc:1151] Deleting tablet b783ffbf2a05453fa43797ce495f8e7a
0927 13:49:49.115936 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.138424 (+ 22488us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.159982 (+ 21558us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.167101 (+ 7119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364902}
I20260927 13:49:49.186739 5628 tablet_bootstrap.cc:492] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.186959 5628 ts_tablet_manager.cc:1403] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.004s
I20260927 13:49:49.188433 5628 raft_consensus.cc:359] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:49.189234 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b783ffbf2a05453fa43797ce495f8e7a (table default.Table_1644e061770e4453a64e74d48c0cd703 [id=ee0789e9d1f34c3791d35794473e2246]) successfully deleted
I20260927 13:49:49.189949 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 187) took 1428 ms. Trace:
W20260927 13:49:49.192056 5184 leader_election.cc:343] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b783ffbf2a05453fa43797ce495f8e7a
I20260927 13:49:49.191959 5626 consensus_queue.cc:260] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.192776 5606 rpcz_store.cc:276] 0927 13:49:47.761917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.761978 (+ 61us) service_pool.cc:224] Handling call
0927 13:49:49.189693 (+1427715us) ts_tablet_manager.cc:1151] Deleting tablet 0004ef0b2dd841ac860798d804374dc1
0927 13:49:49.189708 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.189904 (+ 196us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1427459}
W20260927 13:49:49.193411 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 0004ef0b2dd841ac860798d804374dc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0004ef0b2dd841ac860798d804374dc1 already in progress: creating tablet
I20260927 13:49:49.193439 5623 tablet_replica.cc:333] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.190541 5619 consensus_queue.cc:260] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.196040 5619 ts_tablet_manager.cc:1434] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260927 13:49:49.199242 5619 tablet_bootstrap.cc:492] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:49.199615 5628 raft_consensus.cc:385] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.201740 5619 tablet_bootstrap.cc:654] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.201910 5628 raft_consensus.cc:740] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.202248 5625 ts_tablet_manager.cc:1929] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:49.202421 5625 log.cc:1199] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/c79b1f2962f44a23916bbfe4cf55a4bc
I20260927 13:49:49.202679 5628 consensus_queue.cc:260] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:49.205655 5623 raft_consensus.cc:2243] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.209095 6088 tablet.cc:1751] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 13:49:49.209765 5628 ts_tablet_manager.cc:1434] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260927 13:49:49.210137 5628 tablet_bootstrap.cc:492] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:49.216468 5628 tablet_bootstrap.cc:654] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.202929 5625 ts_tablet_manager.cc:1950] T c79b1f2962f44a23916bbfe4cf55a4bc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:49.196466 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 188) took 1432 ms. Trace:
W20260927 13:49:49.218317 5184 consensus_peers.cc:597] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2801473216a3475384d1494892b8df7b. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:49:49.218585 5184 consensus_peers.cc:597] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2e0b4c217ca41b98013155b8d952fe6. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:49.218953 5626 ts_tablet_manager.cc:1434] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.157s user 0.002s sys 0.001s
I20260927 13:49:49.219305 5626 tablet_bootstrap.cc:492] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:49.220454 5606 rpcz_store.cc:276] 0927 13:49:47.763866 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.766241 (+ 2375us) service_pool.cc:224] Handling call
0927 13:49:49.196289 (+1430048us) ts_tablet_manager.cc:1151] Deleting tablet f5bf9ba5d857421ebc783d4c567f411c
0927 13:49:49.196315 (+ 26us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.196430 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1429850}
W20260927 13:49:49.221056 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet f5bf9ba5d857421ebc783d4c567f411c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5bf9ba5d857421ebc783d4c567f411c already in progress: creating tablet
I20260927 13:49:49.221493 5606 tablet_replica.cc:333] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.221580 5626 tablet_bootstrap.cc:654] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.221851 5606 raft_consensus.cc:2243] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.222074 5606 raft_consensus.cc:2272] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.222404 5623 raft_consensus.cc:2272] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.223096 5623 ts_tablet_manager.cc:1916] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.223510 5606 ts_tablet_manager.cc:1916] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.223726 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet c79b1f2962f44a23916bbfe4cf55a4bc (table default.Table_847c101270804f9f856b7e564cc9fbbe [id=d140ef61df2143d8bd6f44d8f92153c9]) successfully deleted
W20260927 13:49:49.230180 5185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 87637.8us
I20260927 13:49:49.231825 5623 ts_tablet_manager.cc:1929] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.231765 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 7cb2864ea38b4a538884a2c728f08313 (table default.Table_3e04bdb3f0cd4ebea2e3f8efefa7f056 [id=8a1cfc06002240faae3fd4bb724fc5f4]) successfully deleted
I20260927 13:49:49.231976 5623 log.cc:1199] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/2a2ba67436a544e98788e9c1b00a1c33
I20260927 13:49:49.232379 5623 ts_tablet_manager.cc:1950] T 2a2ba67436a544e98788e9c1b00a1c33 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:49.233202 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 196) took 1294 ms. Trace:
I20260927 13:49:49.233384 5623 rpcz_store.cc:276] 0927 13:49:47.938596 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.938895 (+ 299us) service_pool.cc:224] Handling call
0927 13:49:49.184856 (+1245961us) ts_tablet_manager.cc:1151] Deleting tablet 2a2ba67436a544e98788e9c1b00a1c33
0927 13:49:49.184875 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.228171 (+ 43296us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.231744 (+ 3573us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.233160 (+ 1416us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":855,"tablet-delete.queue_time_us":1243888}
I20260927 13:49:49.233870 5623 tablet_replica.cc:333] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.234170 5623 raft_consensus.cc:2243] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:49.234606 5623 raft_consensus.cc:2272] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.235515 5623 ts_tablet_manager.cc:1916] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.239506 5628 tablet_bootstrap.cc:492] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.239667 5628 ts_tablet_manager.cc:1403] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.003s
I20260927 13:49:49.240541 5628 raft_consensus.cc:359] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.240742 5628 raft_consensus.cc:385] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.240840 5628 raft_consensus.cc:740] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.243438 5623 ts_tablet_manager.cc:1929] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.243637 5623 log.cc:1199] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/2801473216a3475384d1494892b8df7b
I20260927 13:49:49.244138 5623 ts_tablet_manager.cc:1950] T 2801473216a3475384d1494892b8df7b P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
W20260927 13:49:49.244865 5184 consensus_peers.cc:597] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 85805d532ffa4c79974ce25041a72205. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:49.244949 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 199) took 1302 ms. Trace:
I20260927 13:49:49.245057 5623 rpcz_store.cc:276] 0927 13:49:47.942415 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.942468 (+ 53us) service_pool.cc:224] Handling call
0927 13:49:49.233794 (+1291326us) ts_tablet_manager.cc:1151] Deleting tablet 2801473216a3475384d1494892b8df7b
0927 13:49:49.233807 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.239341 (+ 5534us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.243353 (+ 4012us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.244884 (+ 1531us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1291152}
I20260927 13:49:49.245569 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 200) took 1270 ms. Trace:
I20260927 13:49:49.245694 5623 rpcz_store.cc:276] 0927 13:49:47.974951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.975006 (+ 55us) service_pool.cc:224] Handling call
0927 13:49:49.245401 (+1270395us) ts_tablet_manager.cc:1151] Deleting tablet 6817fb4caf6a445b899830c6702bf911
0927 13:49:49.245415 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.245510 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1270154}
I20260927 13:49:49.246145 5623 tablet_replica.cc:333] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.246323 5619 tablet_bootstrap.cc:492] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:49.246371 5623 raft_consensus.cc:2243] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:49.246560 5619 ts_tablet_manager.cc:1403] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.002s
I20260927 13:49:49.246712 5623 raft_consensus.cc:2272] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.246994 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a49834518ff34b1981d44f3824c131f3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.247404 5619 raft_consensus.cc:359] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:49.247572 5623 ts_tablet_manager.cc:1916] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.247841 5619 raft_consensus.cc:385] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.247983 5619 raft_consensus.cc:740] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.248342 5619 consensus_queue.cc:260] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:49.248560 6094 consensus_queue.cc:1048] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:49.249029 5619 ts_tablet_manager.cc:1434] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:49:49.249439 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet c79b1f2962f44a23916bbfe4cf55a4bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.249498 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 2a2ba67436a544e98788e9c1b00a1c33 (table default.Table_1716b29ed09743aabc7f196195efefdf [id=ec11e094cff046098922a5d559575bcb]) successfully deleted
I20260927 13:49:49.249924 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 2801473216a3475384d1494892b8df7b (table default.Table_9fd82aceaf6d491facc37c309420e9ed [id=aa9bfeb5b20c499d9897f950fa6db2a9]) successfully deleted
W20260927 13:49:49.250379 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 6817fb4caf6a445b899830c6702bf911 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6817fb4caf6a445b899830c6702bf911 already in progress: creating tablet
W20260927 13:49:49.251700 5044 leader_election.cc:343] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.251866 5044 leader_election.cc:304] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:49.252151 6043 raft_consensus.cc:2749] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.252691 5619 tablet_bootstrap.cc:492] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:49.256378 6043 raft_consensus.cc:493] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.256524 6043 raft_consensus.cc:515] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.257229 6043 leader_election.cc:290] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.258291 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae5f63f709f455b8eceb44771845a3f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:49.259022 5045 leader_election.cc:343] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.259976 5628 consensus_queue.cc:260] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.260840 5623 ts_tablet_manager.cc:1929] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.263901 5619 tablet_bootstrap.cc:654] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.263789 5628 ts_tablet_manager.cc:1434] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.024s user 0.001s sys 0.002s
I20260927 13:49:49.264611 5623 log.cc:1199] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/d2e0b4c217ca41b98013155b8d952fe6
I20260927 13:49:49.266207 5628 tablet_bootstrap.cc:492] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:49.268388 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae5f63f709f455b8eceb44771845a3f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.268649 5623 ts_tablet_manager.cc:1950] T d2e0b4c217ca41b98013155b8d952fe6 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
W20260927 13:49:49.269202 5044 leader_election.cc:343] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.269349 5044 leader_election.cc:304] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:49.269476 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 201) took 1234 ms. Trace:
I20260927 13:49:49.269611 6043 raft_consensus.cc:2749] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.269570 5623 rpcz_store.cc:276] 0927 13:49:48.034896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.035481 (+ 585us) service_pool.cc:224] Handling call
0927 13:49:49.246015 (+1210534us) ts_tablet_manager.cc:1151] Deleting tablet d2e0b4c217ca41b98013155b8d952fe6
0927 13:49:49.246026 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.250857 (+ 4831us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.260748 (+ 9891us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.269444 (+ 8696us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1210331}
I20260927 13:49:49.269965 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 208) took 1001 ms. Trace:
I20260927 13:49:49.270027 6112 tablet.cc:1751] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:49.270020 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet d2e0b4c217ca41b98013155b8d952fe6 (table default.Table_268838ff93954800813c2850f8dbef43 [id=393d91e6e8194f008d5ef165bcfb6b82]) successfully deleted
I20260927 13:49:49.270190 5623 rpcz_store.cc:276] 0927 13:49:48.268863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.268923 (+ 60us) service_pool.cc:224] Handling call
0927 13:49:49.269836 (+1000913us) ts_tablet_manager.cc:1151] Deleting tablet 195ce37d4abf4b92af22b46654b86ba5
0927 13:49:49.269848 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.269937 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":981466}
W20260927 13:49:49.270869 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 195ce37d4abf4b92af22b46654b86ba5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 195ce37d4abf4b92af22b46654b86ba5 already in progress: creating tablet
I20260927 13:49:49.271138 5623 tablet_replica.cc:333] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.271348 5623 raft_consensus.cc:2243] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
W20260927 13:49:49.271458 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 4abe721ef8614d86870a0526de69014f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4abe721ef8614d86870a0526de69014f already in progress: creating tablet
I20260927 13:49:49.271631 5623 pending_rounds.cc:70] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
W20260927 13:49:49.271703 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2efee56b495340baa6dd51f0f3e2aaa7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2efee56b495340baa6dd51f0f3e2aaa7 already in progress: creating tablet
I20260927 13:49:49.271720 5623 pending_rounds.cc:77] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957584326590464 op_type: NO_OP noop_request { }
I20260927 13:49:49.271818 5623 raft_consensus.cc:2889] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:49.271929 5623 raft_consensus.cc:2272] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:49.272257 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b64d3aa052bf4c48b3802f6006cce9c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b64d3aa052bf4c48b3802f6006cce9c9 already in progress: creating tablet
I20260927 13:49:49.272588 5623 ts_tablet_manager.cc:1916] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.273428 6108 tablet.cc:1746] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: Skipping requested alter to schema version 2, tablet already version 2
I20260927 13:49:49.275488 5626 tablet_bootstrap.cc:492] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:49.275713 5626 ts_tablet_manager.cc:1403] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.009s
I20260927 13:49:49.276587 5626 raft_consensus.cc:359] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.276844 5626 raft_consensus.cc:385] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.277060 5626 raft_consensus.cc:740] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.277365 5626 consensus_queue.cc:260] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.278007 5626 ts_tablet_manager.cc:1434] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:49.278473 5626 tablet_bootstrap.cc:492] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:49.279613 5606 ts_tablet_manager.cc:1929] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.280404 5626 tablet_bootstrap.cc:654] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.280704 5606 log.cc:1199] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/2801473216a3475384d1494892b8df7b
I20260927 13:49:49.282931 5623 ts_tablet_manager.cc:1929] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.283077 5623 log.cc:1199] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/85805d532ffa4c79974ce25041a72205
I20260927 13:49:49.283572 5623 ts_tablet_manager.cc:1950] T 85805d532ffa4c79974ce25041a72205 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:49.283978 5606 ts_tablet_manager.cc:1950] T 2801473216a3475384d1494892b8df7b P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.284772 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 85805d532ffa4c79974ce25041a72205 (table default.Table_ee17c48a3ba7447594c552e6d7f13b1a [id=eb074c2c15c542e59ca9fb68049ac69c]) successfully deleted
W20260927 13:49:49.285446 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 321b26c89f1a4c8d88f401c8ece448b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 321b26c89f1a4c8d88f401c8ece448b0 already in progress: creating tablet
W20260927 13:49:49.286037 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 0c72e1a5dced499a932bdc302e006f29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c72e1a5dced499a932bdc302e006f29 already in progress: creating tablet
W20260927 13:49:49.286675 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 31ee75d0a39c42b09f2f46a1774f925c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ee75d0a39c42b09f2f46a1774f925c already in progress: creating tablet
I20260927 13:49:49.286963 5623 tablet_replica.cc:333] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.287264 5623 raft_consensus.cc:2243] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:49.287567 5623 pending_rounds.cc:70] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:49.287685 5623 pending_rounds.cc:77] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957584581611520 op_type: NO_OP noop_request { }
I20260927 13:49:49.287837 5623 raft_consensus.cc:2889] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:49.287995 5623 raft_consensus.cc:2272] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.288969 5623 ts_tablet_manager.cc:1916] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.290350 5628 tablet_bootstrap.cc:654] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.293710 6111 tablet.cc:1751] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 13:49:49.295312 5623 ts_tablet_manager.cc:1929] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.295514 5623 log.cc:1199] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b95399b042654100a609427597d6fe72
I20260927 13:49:49.296124 5623 ts_tablet_manager.cc:1950] T b95399b042654100a609427597d6fe72 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:49.297173 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b95399b042654100a609427597d6fe72 (table default.Table_6437470f54684ecab34ab24defbe6a83 [id=c0b49915096e4176b4ff5ec9e6faa830]) successfully deleted
W20260927 13:49:49.297869 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 80b1970a344045389709260c850adc07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80b1970a344045389709260c850adc07 already in progress: creating tablet
I20260927 13:49:49.273717 6115 tablet.cc:1751] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260927 13:49:49.298800 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b8311ff24259477a9523355908ac14f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8311ff24259477a9523355908ac14f8 already in progress: creating tablet
W20260927 13:49:49.299571 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 1f34f2d0f6e9420a8ad38d708b658b17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f34f2d0f6e9420a8ad38d708b658b17 already in progress: creating tablet
W20260927 13:49:49.300205 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b0fd6fb92eb64e948e67f70c512376e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0fd6fb92eb64e948e67f70c512376e2 already in progress: creating tablet
I20260927 13:49:49.300400 5619 tablet_bootstrap.cc:492] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:49.300592 5619 ts_tablet_manager.cc:1403] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.002s
I20260927 13:49:49.303449 6068 raft_consensus.cc:493] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.303627 6068 raft_consensus.cc:515] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.304284 6068 leader_election.cc:290] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:49.304824 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 129c2f99d5b143b3bd25731cfeb0009e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 129c2f99d5b143b3bd25731cfeb0009e already in progress: creating tablet
I20260927 13:49:49.304926 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 189) took 1529 ms. Trace:
I20260927 13:49:49.305004 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fd6fb92eb64e948e67f70c512376e2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.305197 5623 tablet_replica.cc:333] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.305064 5606 rpcz_store.cc:276] 0927 13:49:47.775063 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.775151 (+ 88us) service_pool.cc:224] Handling call
0927 13:49:49.221407 (+1446256us) ts_tablet_manager.cc:1151] Deleting tablet 2801473216a3475384d1494892b8df7b
0927 13:49:49.221423 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.227842 (+ 6419us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.279223 (+ 51381us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.304850 (+ 25627us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1445989}
I20260927 13:49:49.305415 5623 raft_consensus.cc:2243] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:49.305639 5623 pending_rounds.cc:70] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:49.305646 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 2801473216a3475384d1494892b8df7b (table default.Table_9fd82aceaf6d491facc37c309420e9ed [id=aa9bfeb5b20c499d9897f950fa6db2a9]) successfully deleted
W20260927 13:49:49.305704 5319 leader_election.cc:343] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.305821 5623 pending_rounds.cc:77] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957587709198336 op_type: NO_OP noop_request { }
I20260927 13:49:49.305968 5623 raft_consensus.cc:2889] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:49.306141 5606 tablet_replica.cc:333] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.306176 5623 raft_consensus.cc:2272] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.306478 5606 raft_consensus.cc:2243] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.306725 5606 raft_consensus.cc:2272] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.307237 5623 ts_tablet_manager.cc:1916] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.307586 5606 ts_tablet_manager.cc:1916] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.311419 6112 tablet.cc:1746] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Skipping requested alter to schema version 2, tablet already version 2
I20260927 13:49:49.313347 5623 ts_tablet_manager.cc:1929] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.313465 5623 log.cc:1199] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b783ffbf2a05453fa43797ce495f8e7a
I20260927 13:49:49.313891 5623 ts_tablet_manager.cc:1950] T b783ffbf2a05453fa43797ce495f8e7a P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:49.314024 6090 tablet.cc:1746] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: Skipping requested alter to schema version 2, tablet already version 2
I20260927 13:49:49.314888 6068 raft_consensus.cc:493] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.315120 6068 raft_consensus.cc:515] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:49.315925 6068 leader_election.cc:290] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.316187 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b783ffbf2a05453fa43797ce495f8e7a (table default.Table_1644e061770e4453a64e74d48c0cd703 [id=ee0789e9d1f34c3791d35794473e2246]) successfully deleted
I20260927 13:49:49.316648 5623 tablet_replica.cc:333] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.316901 5623 raft_consensus.cc:2243] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:49.316875 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4b7500f05e4b63b4d79fabde88ebe6" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.317315 5623 raft_consensus.cc:2272] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:49.317721 5319 leader_election.cc:343] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.318032 5623 ts_tablet_manager.cc:1916] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.318679 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e02f217077414076ab9e4f74fdd61b36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.319307 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e02f217077414076ab9e4f74fdd61b36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.301975 5619 raft_consensus.cc:359] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.320974 5619 raft_consensus.cc:385] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.321074 5619 raft_consensus.cc:740] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.323925 5619 consensus_queue.cc:260] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.324702 5619 ts_tablet_manager.cc:1434] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260927 13:49:49.325103 5619 tablet_bootstrap.cc:492] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:49.326679 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 081f18e00af74e5c811f774d29422351 has no consensus state
I20260927 13:49:49.327009 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f5dfa3e80454463908df19a49454764 from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:49.333436 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 has no consensus state
I20260927 13:49:49.333743 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f34f2d0f6e9420a8ad38d708b658b17 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:49.334410 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_29868ee7e5ee42a78f9361cfba0334e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.335045 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29868ee7e5ee42a78f9361cfba0334e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:49.335820 5319 leader_election.cc:343] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b0fd6fb92eb64e948e67f70c512376e2
I20260927 13:49:49.335983 5319 leader_election.cc:304] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:49.336959 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c381014a617d46298a7927df0468de9c" } new_table_name: "default.Table_b76c0a83f3804d4fa4fab07460d3b61f" modify_external_catalogs: true
I20260927 13:49:49.341687 5628 tablet_bootstrap.cc:492] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.343593 5628 ts_tablet_manager.cc:1403] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.078s user 0.002s sys 0.006s
I20260927 13:49:49.345767 5619 tablet_bootstrap.cc:654] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.346343 4925 catalog_manager.cc:5838] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } }
I20260927 13:49:49.346724 4925 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]). Expected version 1 got 0
I20260927 13:49:49.349089 5626 tablet_bootstrap.cc:492] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:49.349359 5626 ts_tablet_manager.cc:1403] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20260927 13:49:49.349531 5081 tablet_service.cc:1511] Processing CreateTablet for tablet bb505472de024c2e9b3861f3225b7e40 (DEFAULT_TABLE table=default.Table_d936492f977944a59cdb4de68a75c0a8 [id=3bbc5d02a6d14ec98f4377270e60e6fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.350319 5223 tablet_service.cc:1511] Processing CreateTablet for tablet bb505472de024c2e9b3861f3225b7e40 (DEFAULT_TABLE table=default.Table_d936492f977944a59cdb4de68a75c0a8 [id=3bbc5d02a6d14ec98f4377270e60e6fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.350354 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c470b14844004302969f3c3a0802ace8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.350924 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c470b14844004302969f3c3a0802ace8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.349182 5351 tablet_service.cc:1511] Processing CreateTablet for tablet bb505472de024c2e9b3861f3225b7e40 (DEFAULT_TABLE table=default.Table_d936492f977944a59cdb4de68a75c0a8 [id=3bbc5d02a6d14ec98f4377270e60e6fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.351840 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb505472de024c2e9b3861f3225b7e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.351940 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_19cca2a50519472a82c4cd1940234797" } new_table_name: "default.Table_511b3463a96f497dade7a9c12509f338" modify_external_catalogs: true
I20260927 13:49:49.354686 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb505472de024c2e9b3861f3225b7e40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:49.349699 5319 leader_election.cc:343] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7a4b7500f05e4b63b4d79fabde88ebe6
I20260927 13:49:49.354867 5628 raft_consensus.cc:359] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.354898 5319 leader_election.cc:304] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:49.355049 5628 raft_consensus.cc:385] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.355125 5628 raft_consensus.cc:740] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.355327 6063 raft_consensus.cc:2749] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.349862 6068 raft_consensus.cc:2749] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.358361 5628 consensus_queue.cc:260] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.358557 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb505472de024c2e9b3861f3225b7e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.363911 5628 ts_tablet_manager.cc:1434] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
W20260927 13:49:49.364246 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1efaf62692c545dcaa5175fcd826785a consensus state has no leader
I20260927 13:49:49.364270 5628 tablet_bootstrap.cc:492] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:49.368054 5628 tablet_bootstrap.cc:654] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.368747 5626 raft_consensus.cc:359] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.370847 5606 ts_tablet_manager.cc:1929] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.379030 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 1575501a5d1f4b0d80f153cf5bde5fa9 (DEFAULT_TABLE table=default.Table_13294c9335de4fd3ad6c089efad19634 [id=4da4496b3f7b4dada56f6a6cb22f7569]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.380175 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 1f5dfa3e80454463908df19a49454764
I20260927 13:49:49.380640 4926 catalog_manager.cc:6934] ReplaceTablet: tablet 1f5dfa3e80454463908df19a49454764 deleted and replaced by tablet a813939920244be781d546311fe8a33e
I20260927 13:49:49.381024 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6e0a2dbfabb64a0995f5d5a8878c1378"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.381588 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e0a2dbfabb64a0995f5d5a8878c1378 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.382061 5626 raft_consensus.cc:385] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.382232 5626 raft_consensus.cc:740] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.384621 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5dfa3e80454463908df19a49454764 with delete_type TABLET_DATA_DELETED (replaced by tablet a813939920244be781d546311fe8a33e) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.384896 5606 log.cc:1199] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/7dc612cbcd5d4755a188408f2a036f34
W20260927 13:49:49.385023 5319 consensus_peers.cc:597] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a2ba67436a544e98788e9c1b00a1c33. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:49.372675 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 1575501a5d1f4b0d80f153cf5bde5fa9 (DEFAULT_TABLE table=default.Table_13294c9335de4fd3ad6c089efad19634 [id=4da4496b3f7b4dada56f6a6cb22f7569]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.385177 5626 consensus_queue.cc:260] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.385344 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5dfa3e80454463908df19a49454764 with delete_type TABLET_DATA_DELETED (replaced by tablet a813939920244be781d546311fe8a33e) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.385461 5606 ts_tablet_manager.cc:1950] T 7dc612cbcd5d4755a188408f2a036f34 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.385514 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1575501a5d1f4b0d80f153cf5bde5fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.386235 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 190) took 1610 ms. Trace:
I20260927 13:49:49.386365 5606 rpcz_store.cc:276] 0927 13:49:47.776054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.776107 (+ 53us) service_pool.cc:224] Handling call
0927 13:49:49.305947 (+1529840us) ts_tablet_manager.cc:1151] Deleting tablet 7dc612cbcd5d4755a188408f2a036f34
0927 13:49:49.305984 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.347660 (+ 41676us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.370763 (+ 23103us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.386202 (+ 15439us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1529612}
I20260927 13:49:49.386906 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 7dc612cbcd5d4755a188408f2a036f34 (table default.Table_6f09b6613d87411faca990bffef9d028 [id=7f846a3fd7cf4362870ca0e938dd45bd]) successfully deleted
W20260927 13:49:49.387002 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 1f5dfa3e80454463908df19a49454764 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f5dfa3e80454463908df19a49454764 already in progress: creating tablet
I20260927 13:49:49.387507 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 191) took 1584 ms. Trace:
I20260927 13:49:49.387658 5606 rpcz_store.cc:276] 0927 13:49:47.803074 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.803135 (+ 61us) service_pool.cc:224] Handling call
0927 13:49:49.387368 (+1584233us) ts_tablet_manager.cc:1151] Deleting tablet 2999bd61907847938975a6232e3899e4
0927 13:49:49.387378 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.387478 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1576926}
I20260927 13:49:49.388587 5626 ts_tablet_manager.cc:1434] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.039s user 0.002s sys 0.000s
W20260927 13:49:49.388578 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2999bd61907847938975a6232e3899e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2999bd61907847938975a6232e3899e4 already in progress: creating tablet
I20260927 13:49:49.388857 5606 tablet_replica.cc:333] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.389102 5606 raft_consensus.cc:2243] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:49.389573 5606 pending_rounds.cc:70] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:49.389961 5606 pending_rounds.cc:77] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957582299205632 op_type: NO_OP noop_request { }
I20260927 13:49:49.390239 5606 raft_consensus.cc:2889] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:49.390264 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1575501a5d1f4b0d80f153cf5bde5fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.390496 5606 raft_consensus.cc:2272] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.391161 5606 ts_tablet_manager.cc:1916] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.395728 5626 tablet_bootstrap.cc:492] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:49.389822 5623 ts_tablet_manager.cc:1929] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:49.397745 5623 log.cc:1199] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/c79b1f2962f44a23916bbfe4cf55a4bc
I20260927 13:49:49.398247 5623 ts_tablet_manager.cc:1950] T c79b1f2962f44a23916bbfe4cf55a4bc P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:49.374787 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 1575501a5d1f4b0d80f153cf5bde5fa9 (DEFAULT_TABLE table=default.Table_13294c9335de4fd3ad6c089efad19634 [id=4da4496b3f7b4dada56f6a6cb22f7569]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.400601 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1575501a5d1f4b0d80f153cf5bde5fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.404649 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5dfa3e80454463908df19a49454764 with delete_type TABLET_DATA_DELETED (replaced by tablet a813939920244be781d546311fe8a33e) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.406682 6043 raft_consensus.cc:493] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.406764 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet c79b1f2962f44a23916bbfe4cf55a4bc (table default.Table_847c101270804f9f856b7e564cc9fbbe [id=d140ef61df2143d8bd6f44d8f92153c9]) successfully deleted
I20260927 13:49:49.406858 6043 raft_consensus.cc:515] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.407657 6043 leader_election.cc:290] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.408352 5350 tablet_service.cc:1511] Processing CreateTablet for tablet c332b6ec9ca94ce398a71e82e20897d4 (DEFAULT_TABLE table=default.Table_71880460bb5749cf90eed9712c6c61a1 [id=db33cf0d6695498f8e5100abb2103d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.408692 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c332b6ec9ca94ce398a71e82e20897d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.410372 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a35fefc73c54d6c9b1907f55add7b92" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:49.411046 5215 tablet_service.cc:1511] Processing CreateTablet for tablet c332b6ec9ca94ce398a71e82e20897d4 (DEFAULT_TABLE table=default.Table_71880460bb5749cf90eed9712c6c61a1 [id=db33cf0d6695498f8e5100abb2103d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.411445 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c332b6ec9ca94ce398a71e82e20897d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:49.412312 5045 leader_election.cc:343] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:49.413098 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 1f5dfa3e80454463908df19a49454764 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f5dfa3e80454463908df19a49454764 already in progress: creating tablet
I20260927 13:49:49.413790 5606 ts_tablet_manager.cc:1929] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.414651 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a35fefc73c54d6c9b1907f55add7b92" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:49.415203 5044 leader_election.cc:343] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.415354 5044 leader_election.cc:304] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:49.415813 6043 raft_consensus.cc:2749] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.416472 5076 tablet_service.cc:1511] Processing CreateTablet for tablet c332b6ec9ca94ce398a71e82e20897d4 (DEFAULT_TABLE table=default.Table_71880460bb5749cf90eed9712c6c61a1 [id=db33cf0d6695498f8e5100abb2103d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.416854 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c332b6ec9ca94ce398a71e82e20897d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.422510 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2c976a667e7c4b948b3aa176b13b7d0d
I20260927 13:49:49.422955 5606 log.cc:1199] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/3663033220094a4ea6df8e2982eb2188
I20260927 13:49:49.423431 5606 ts_tablet_manager.cc:1950] T 3663033220094a4ea6df8e2982eb2188 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.423506 4922 catalog_manager.cc:6934] ReplaceTablet: tablet 2c976a667e7c4b948b3aa176b13b7d0d deleted and replaced by tablet 67b921ed2ca0425b86cc2e679d0320cc
I20260927 13:49:49.424227 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 192) took 1570 ms. Trace:
I20260927 13:49:49.424345 5606 rpcz_store.cc:276] 0927 13:49:47.853851 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.853930 (+ 79us) service_pool.cc:224] Handling call
0927 13:49:49.388797 (+1534867us) ts_tablet_manager.cc:1151] Deleting tablet 3663033220094a4ea6df8e2982eb2188
0927 13:49:49.388807 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.403960 (+ 15153us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.413706 (+ 9746us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.424192 (+ 10486us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1534641}
I20260927 13:49:49.424667 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c976a667e7c4b948b3aa176b13b7d0d with delete_type TABLET_DATA_DELETED (replaced by tablet 67b921ed2ca0425b86cc2e679d0320cc) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.424993 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 3663033220094a4ea6df8e2982eb2188 (table default.Table_a9cae6841bf84f09bdea303110cd78ad [id=17e5201d16ce4ce59807538c4e68b495]) successfully deleted
I20260927 13:49:49.425271 5625 tablet_replica.cc:333] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:49.425513 5625 raft_consensus.cc:2243] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.425693 5625 raft_consensus.cc:2272] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.426039 5626 tablet_bootstrap.cc:654] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.426560 5606 tablet_replica.cc:333] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.426608 5076 tablet_service.cc:1511] Processing CreateTablet for tablet fa9d09ca7952499ba135e15cecb1143e (DEFAULT_TABLE table=default.Table_cc674605834f48fb90b47899e544a8c3 [id=a923173934944f4592852e7779d0bb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.427038 5606 raft_consensus.cc:2243] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.427173 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9d09ca7952499ba135e15cecb1143e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.427556 5606 raft_consensus.cc:2272] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.427686 5625 ts_tablet_manager.cc:1916] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.427762 5352 tablet_service.cc:1511] Processing CreateTablet for tablet fa9d09ca7952499ba135e15cecb1143e (DEFAULT_TABLE table=default.Table_cc674605834f48fb90b47899e544a8c3 [id=a923173934944f4592852e7779d0bb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.428171 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9d09ca7952499ba135e15cecb1143e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.428406 5606 ts_tablet_manager.cc:1916] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.432204 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c976a667e7c4b948b3aa176b13b7d0d with delete_type TABLET_DATA_DELETED (replaced by tablet 67b921ed2ca0425b86cc2e679d0320cc) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.435952 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c976a667e7c4b948b3aa176b13b7d0d with delete_type TABLET_DATA_DELETED (replaced by tablet 67b921ed2ca0425b86cc2e679d0320cc) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.436834 5223 tablet_service.cc:1511] Processing CreateTablet for tablet fa9d09ca7952499ba135e15cecb1143e (DEFAULT_TABLE table=default.Table_cc674605834f48fb90b47899e544a8c3 [id=a923173934944f4592852e7779d0bb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.437278 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9d09ca7952499ba135e15cecb1143e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.437592 5625 ts_tablet_manager.cc:1929] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.437743 5625 log.cc:1199] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/2c976a667e7c4b948b3aa176b13b7d0d
I20260927 13:49:49.438097 5625 ts_tablet_manager.cc:1950] T 2c976a667e7c4b948b3aa176b13b7d0d P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:49.438983 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2c976a667e7c4b948b3aa176b13b7d0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c976a667e7c4b948b3aa176b13b7d0d already in progress: creating tablet
I20260927 13:49:49.439553 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 2c976a667e7c4b948b3aa176b13b7d0d (table default.Table_3efafc6b184f4f73bd2b6fad23d8991c [id=d6e13461272741bb8e15183f5bc473d2]) successfully deleted
I20260927 13:49:49.440506 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_00a670601e1d4a509989647bb84ca8cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.441128 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00a670601e1d4a509989647bb84ca8cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.446977 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 0851e183315a45f4a85d68d698e74cb7 (DEFAULT_TABLE table=default.Table_d930205241084c7b957ca0983bfb037f [id=dd996f6d5b764e799ed45890225b7670]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.447403 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0851e183315a45f4a85d68d698e74cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.449699 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 3b855dedb8d04145b0c4469b9ba79453
I20260927 13:49:49.450469 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet a8c1b74943b9479e8b37969b2933c5a4 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:49.452267 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b855dedb8d04145b0c4469b9ba79453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.453020 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 0851e183315a45f4a85d68d698e74cb7 (DEFAULT_TABLE table=default.Table_d930205241084c7b957ca0983bfb037f [id=dd996f6d5b764e799ed45890225b7670]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.453526 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0851e183315a45f4a85d68d698e74cb7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:49.453583 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 3b855dedb8d04145b0c4469b9ba79453 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b855dedb8d04145b0c4469b9ba79453 already in progress: creating tablet
I20260927 13:49:49.453962 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b855dedb8d04145b0c4469b9ba79453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:49.454690 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 3b855dedb8d04145b0c4469b9ba79453 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b855dedb8d04145b0c4469b9ba79453 already in progress: creating tablet
I20260927 13:49:49.456424 5606 ts_tablet_manager.cc:1929] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.460330 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 1efaf62692c545dcaa5175fcd826785a (DEFAULT_TABLE table=default.Table_b76c0a83f3804d4fa4fab07460d3b61f [id=27d4534550fd49038bcf9101064bfeb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.460800 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1efaf62692c545dcaa5175fcd826785a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.461227 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 6ce893441d5e4d9f89743e75eb762276
I20260927 13:49:49.462175 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce893441d5e4d9f89743e75eb762276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.462489 5606 log.cc:1199] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b95399b042654100a609427597d6fe72
I20260927 13:49:49.463044 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce893441d5e4d9f89743e75eb762276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.463158 5606 ts_tablet_manager.cc:1950] T b95399b042654100a609427597d6fe72 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.463342 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce893441d5e4d9f89743e75eb762276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.463959 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 193) took 1523 ms. Trace:
I20260927 13:49:49.464046 6099 raft_consensus.cc:493] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.464051 5606 rpcz_store.cc:276] 0927 13:49:47.940114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.940173 (+ 59us) service_pool.cc:224] Handling call
0927 13:49:49.426502 (+1486329us) ts_tablet_manager.cc:1151] Deleting tablet b95399b042654100a609427597d6fe72
0927 13:49:49.426511 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.431898 (+ 5387us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.456357 (+ 24459us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.463909 (+ 7552us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1486089}
I20260927 13:49:49.464178 6099 raft_consensus.cc:515] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.464478 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 194) took 1488 ms. Trace:
I20260927 13:49:49.464560 5606 rpcz_store.cc:276] 0927 13:49:47.976098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:47.976149 (+ 51us) service_pool.cc:224] Handling call
0927 13:49:49.464329 (+1488180us) ts_tablet_manager.cc:1151] Deleting tablet 6817fb4caf6a445b899830c6702bf911
0927 13:49:49.464339 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.464430 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1487981}
I20260927 13:49:49.464825 5606 tablet_replica.cc:333] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.464929 6099 leader_election.cc:290] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:49.465010 5606 raft_consensus.cc:2243] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.465194 5606 raft_consensus.cc:2272] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.465552 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b95399b042654100a609427597d6fe72 (table default.Table_6437470f54684ecab34ab24defbe6a83 [id=c0b49915096e4176b4ff5ec9e6faa830]) successfully deleted
W20260927 13:49:49.465850 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 6817fb4caf6a445b899830c6702bf911 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6817fb4caf6a445b899830c6702bf911 already in progress: creating tablet
I20260927 13:49:49.466512 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f549f487ea4dbb8c7fceee6f8a6db0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:49.466634 5184 leader_election.cc:343] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 77f549f487ea4dbb8c7fceee6f8a6db0
I20260927 13:49:49.466713 5382 raft_consensus.cc:2468] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:49.467113 5185 leader_election.cc:304] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:49.467660 6099 raft_consensus.cc:2804] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:49.467773 6099 raft_consensus.cc:493] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260927 13:49:49.467818 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 6ce893441d5e4d9f89743e75eb762276 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ce893441d5e4d9f89743e75eb762276 already in progress: creating tablet
I20260927 13:49:49.467890 6099 raft_consensus.cc:3060] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:49.456306 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b855dedb8d04145b0c4469b9ba79453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.470393 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_183efeacde2a430ba345a16786994e76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.470543 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 6ce893441d5e4d9f89743e75eb762276 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ce893441d5e4d9f89743e75eb762276 already in progress: creating tablet
W20260927 13:49:49.471024 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_183efeacde2a430ba345a16786994e76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.471832 6099 raft_consensus.cc:515] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.472074 5606 ts_tablet_manager.cc:1916] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.472883 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f549f487ea4dbb8c7fceee6f8a6db0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:49.473079 5382 raft_consensus.cc:3060] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:49.473749 5184 leader_election.cc:343] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 77f549f487ea4dbb8c7fceee6f8a6db0
I20260927 13:49:49.473915 6099 leader_election.cc:290] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:49.475471 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 0851e183315a45f4a85d68d698e74cb7 (DEFAULT_TABLE table=default.Table_d930205241084c7b957ca0983bfb037f [id=dd996f6d5b764e799ed45890225b7670]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.475916 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0851e183315a45f4a85d68d698e74cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.476253 5382 raft_consensus.cc:2468] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:49.476758 5185 leader_election.cc:304] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:49.477355 6099 raft_consensus.cc:2804] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:49.477911 6099 raft_consensus.cc:697] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:49.478298 6099 consensus_queue.cc:237] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.478983 5628 tablet_bootstrap.cc:492] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.479168 5628 ts_tablet_manager.cc:1403] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.115s user 0.013s sys 0.012s
I20260927 13:49:49.480010 5628 raft_consensus.cc:359] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.480275 5628 raft_consensus.cc:385] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.480417 5628 raft_consensus.cc:740] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.480688 5628 consensus_queue.cc:260] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.482463 5628 ts_tablet_manager.cc:1434] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:49.482810 5628 tablet_bootstrap.cc:492] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:49.485743 4921 catalog_manager.cc:5838] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:49.487735 5628 tablet_bootstrap.cc:654] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.491576 5619 tablet_bootstrap.cc:492] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:49.491838 5619 ts_tablet_manager.cc:1403] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.167s user 0.004s sys 0.001s
I20260927 13:49:49.492683 5619 raft_consensus.cc:359] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.492992 5619 raft_consensus.cc:385] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.493117 5619 raft_consensus.cc:740] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.493502 5619 consensus_queue.cc:260] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.496327 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 1efaf62692c545dcaa5175fcd826785a (DEFAULT_TABLE table=default.Table_b76c0a83f3804d4fa4fab07460d3b61f [id=27d4534550fd49038bcf9101064bfeb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.496742 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1efaf62692c545dcaa5175fcd826785a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.497087 5222 tablet_service.cc:1511] Processing CreateTablet for tablet f04b3a942c404f3894fbbd6ece24a727 (DEFAULT_TABLE table=default.Table_db70ad184fab4e5984d1777fecae5518 [id=c6230203df764e97a3fd3c8117177db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.497525 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04b3a942c404f3894fbbd6ece24a727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.497709 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 1efaf62692c545dcaa5175fcd826785a (DEFAULT_TABLE table=default.Table_b76c0a83f3804d4fa4fab07460d3b61f [id=27d4534550fd49038bcf9101064bfeb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.498582 5619 ts_tablet_manager.cc:1434] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260927 13:49:49.498085 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1efaf62692c545dcaa5175fcd826785a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.501685 5619 tablet_bootstrap.cc:492] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:49.504725 5606 ts_tablet_manager.cc:1929] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.506008 5628 tablet_bootstrap.cc:492] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.506239 5628 ts_tablet_manager.cc:1403] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.001s
I20260927 13:49:49.506974 5628 raft_consensus.cc:359] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.507223 5628 raft_consensus.cc:385] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.507339 5628 raft_consensus.cc:740] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.507603 5628 consensus_queue.cc:260] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.509384 5628 ts_tablet_manager.cc:1434] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260927 13:49:49.509718 5628 tablet_bootstrap.cc:492] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:49.512804 5628 tablet_bootstrap.cc:654] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.512988 5606 log.cc:1199] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/d2e0b4c217ca41b98013155b8d952fe6
I20260927 13:49:49.513492 5606 ts_tablet_manager.cc:1950] T d2e0b4c217ca41b98013155b8d952fe6 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.513362 6043 raft_consensus.cc:493] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.514456 6043 raft_consensus.cc:515] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.515072 6043 leader_election.cc:290] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.515194 6043 raft_consensus.cc:493] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.515334 6043 raft_consensus.cc:515] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.515829 6043 leader_election.cc:290] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.522148 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 195) took 1483 ms. Trace:
I20260927 13:49:49.522356 5606 rpcz_store.cc:276] 0927 13:49:48.034586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.034653 (+ 67us) service_pool.cc:224] Handling call
0927 13:49:49.464757 (+1430104us) ts_tablet_manager.cc:1151] Deleting tablet d2e0b4c217ca41b98013155b8d952fe6
0927 13:49:49.464764 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.476498 (+ 11734us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.504637 (+ 28139us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.518085 (+ 13448us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1429854}
I20260927 13:49:49.522950 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet d2e0b4c217ca41b98013155b8d952fe6 (table default.Table_268838ff93954800813c2850f8dbef43 [id=393d91e6e8194f008d5ef165bcfb6b82]) successfully deleted
I20260927 13:49:49.523837 5350 tablet_service.cc:1511] Processing CreateTablet for tablet f04b3a942c404f3894fbbd6ece24a727 (DEFAULT_TABLE table=default.Table_db70ad184fab4e5984d1777fecae5518 [id=c6230203df764e97a3fd3c8117177db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.523779 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_cb8208423d374903b009adbf0c2cbe9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:49.524225 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04b3a942c404f3894fbbd6ece24a727. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:49.524382 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb8208423d374903b009adbf0c2cbe9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.525986 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 5b224b590e5c4a2ab26ea7eaeedd976c (DEFAULT_TABLE table=default.Table_44d960a4808c41b3857a9d76053fc16a [id=0b26044e99f94ff398a2b411b35887b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.526095 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 5b224b590e5c4a2ab26ea7eaeedd976c (DEFAULT_TABLE table=default.Table_44d960a4808c41b3857a9d76053fc16a [id=0b26044e99f94ff398a2b411b35887b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.526435 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b224b590e5c4a2ab26ea7eaeedd976c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.526537 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b224b590e5c4a2ab26ea7eaeedd976c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.529958 5076 tablet_service.cc:1511] Processing CreateTablet for tablet f04b3a942c404f3894fbbd6ece24a727 (DEFAULT_TABLE table=default.Table_db70ad184fab4e5984d1777fecae5518 [id=c6230203df764e97a3fd3c8117177db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.530362 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04b3a942c404f3894fbbd6ece24a727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.531083 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bf9abe277040078eb765728e3c52ef" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:49.531917 5044 leader_election.cc:343] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.531971 5606 tablet_replica.cc:333] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.532217 5606 raft_consensus.cc:2243] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.532245 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74226753751a49fa8ce98eafb2ca1250" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.532399 5606 raft_consensus.cc:2272] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:49.532766 5044 leader_election.cc:343] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.533154 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 5b224b590e5c4a2ab26ea7eaeedd976c (DEFAULT_TABLE table=default.Table_44d960a4808c41b3857a9d76053fc16a [id=0b26044e99f94ff398a2b411b35887b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.534569 5606 ts_tablet_manager.cc:1916] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.534961 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b224b590e5c4a2ab26ea7eaeedd976c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.505100 5619 tablet_bootstrap.cc:654] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.543689 4927 master_service.cc:960] ReplaceTablet: received request to replace tablet d6c46d0e50a44232a82d00c88d9f63b5 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:49.545156 5628 tablet_bootstrap.cc:492] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.545398 5628 ts_tablet_manager.cc:1403] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.001s
I20260927 13:49:49.546205 5628 raft_consensus.cc:359] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:49.546494 5628 raft_consensus.cc:385] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.546643 5628 raft_consensus.cc:740] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.546938 5628 consensus_queue.cc:260] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:49.548962 5628 ts_tablet_manager.cc:1434] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:49.549332 5628 tablet_bootstrap.cc:492] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:49.554584 5628 tablet_bootstrap.cc:654] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.558215 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d294f0cb024e426592bf4bf7f261f4be" } modify_external_catalogs: true
I20260927 13:49:49.558418 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d294f0cb024e426592bf4bf7f261f4be" } modify_external_catalogs: true
W20260927 13:49:49.558456 5319 consensus_peers.cc:597] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a2ba67436a544e98788e9c1b00a1c33. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:49.562765 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bf9abe277040078eb765728e3c52ef" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:49.564112 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74226753751a49fa8ce98eafb2ca1250" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:49.564921 5045 leader_election.cc:343] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.565035 5606 ts_tablet_manager.cc:1929] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.565168 5606 log.cc:1199] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/df271399b2c84653ac4a5b74efdc0197
I20260927 13:49:49.565339 5045 leader_election.cc:304] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:49.565519 5606 ts_tablet_manager.cc:1950] T df271399b2c84653ac4a5b74efdc0197 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:49:49.565932 5045 leader_election.cc:343] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.566136 5045 leader_election.cc:304] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:49.566296 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 196) took 1463 ms. Trace:
I20260927 13:49:49.566481 6043 raft_consensus.cc:2749] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.566416 5606 rpcz_store.cc:276] 0927 13:49:48.102480 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.103058 (+ 578us) service_pool.cc:224] Handling call
0927 13:49:49.531885 (+1428827us) ts_tablet_manager.cc:1151] Deleting tablet df271399b2c84653ac4a5b74efdc0197
0927 13:49:49.531895 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.537861 (+ 5966us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.564966 (+ 27105us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.566243 (+ 1277us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1423758}
I20260927 13:49:49.566668 6043 raft_consensus.cc:2749] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.566915 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet df271399b2c84653ac4a5b74efdc0197 (table default.Table_4a67727b46b74c27a439bc32c6cb411f [id=a8628dbf015640b9ad49c4aa66f46cac]) successfully deleted
I20260927 13:49:49.571979 4928 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 67b921ed2ca0425b86cc2e679d0320cc
I20260927 13:49:49.574867 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8c3b2a8ae18e4aa0a1e71601ac62ea43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:49.575253 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 204) took 1304 ms. Trace:
I20260927 13:49:49.575366 5606 rpcz_store.cc:276] 0927 13:49:48.270391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.283517 (+ 13126us) service_pool.cc:224] Handling call
0927 13:49:49.575070 (+1291553us) ts_tablet_manager.cc:1151] Deleting tablet 195ce37d4abf4b92af22b46654b86ba5
0927 13:49:49.575082 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.575199 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1291320}
W20260927 13:49:49.575517 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c3b2a8ae18e4aa0a1e71601ac62ea43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:49.575862 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 195ce37d4abf4b92af22b46654b86ba5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 195ce37d4abf4b92af22b46654b86ba5 already in progress: creating tablet
I20260927 13:49:49.576879 5606 tablet_replica.cc:333] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.577361 5606 raft_consensus.cc:2243] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:49.577973 5606 pending_rounds.cc:70] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:49.578382 5606 pending_rounds.cc:77] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957584908312576 op_type: NO_OP noop_request { }
I20260927 13:49:49.578696 5606 raft_consensus.cc:2889] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:49.578994 5606 raft_consensus.cc:2272] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.585034 5606 ts_tablet_manager.cc:1916] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.587229 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cc674605834f48fb90b47899e544a8c3" } new_table_name: "default.Table_c4ef5bb456044de098673a074f5f615a" modify_external_catalogs: true
I20260927 13:49:49.591539 5626 tablet_bootstrap.cc:492] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:49.591714 5626 ts_tablet_manager.cc:1403] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.196s user 0.010s sys 0.000s
I20260927 13:49:49.592466 5626 raft_consensus.cc:359] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.592671 5626 raft_consensus.cc:385] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.592752 5626 raft_consensus.cc:740] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.594203 5218 tablet_service.cc:1511] Processing CreateTablet for tablet b4f7512333e245c4b35018961a510efd (DEFAULT_TABLE table=default.Table_6654f7ea3c6c4d07806b732f11f5d352 [id=cdbd4d2971cc4150b7fb0aa966a3a87c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.594633 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f7512333e245c4b35018961a510efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.598919 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_27f67bf75f984096adeb5e1be68feb3f" } modify_external_catalogs: true
I20260927 13:49:49.599136 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_27f67bf75f984096adeb5e1be68feb3f" } modify_external_catalogs: true
I20260927 13:49:49.601460 6127 raft_consensus.cc:493] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.601697 6127 raft_consensus.cc:515] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.603402 5353 tablet_service.cc:1511] Processing CreateTablet for tablet b4f7512333e245c4b35018961a510efd (DEFAULT_TABLE table=default.Table_6654f7ea3c6c4d07806b732f11f5d352 [id=cdbd4d2971cc4150b7fb0aa966a3a87c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.603861 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f7512333e245c4b35018961a510efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.604104 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1970a344045389709260c850adc07" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:49.604708 5044 leader_election.cc:343] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.605379 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1970a344045389709260c850adc07" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:49.606031 5045 leader_election.cc:343] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.606246 5045 leader_election.cc:304] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:49.606549 6043 raft_consensus.cc:2749] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.606859 6127 leader_election.cc:290] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.612920 5089 tablet_service.cc:1511] Processing CreateTablet for tablet b4f7512333e245c4b35018961a510efd (DEFAULT_TABLE table=default.Table_6654f7ea3c6c4d07806b732f11f5d352 [id=cdbd4d2971cc4150b7fb0aa966a3a87c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.613358 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f7512333e245c4b35018961a510efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.613821 5606 ts_tablet_manager.cc:1929] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.613948 5606 log.cc:1199] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/2a2ba67436a544e98788e9c1b00a1c33
I20260927 13:49:49.614351 5606 ts_tablet_manager.cc:1950] T 2a2ba67436a544e98788e9c1b00a1c33 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.615123 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 201) took 1363 ms. Trace:
I20260927 13:49:49.615211 5606 rpcz_store.cc:276] 0927 13:49:48.251281 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.273843 (+ 22562us) service_pool.cc:224] Handling call
0927 13:49:49.576801 (+1302958us) ts_tablet_manager.cc:1151] Deleting tablet 2a2ba67436a544e98788e9c1b00a1c33
0927 13:49:49.576812 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.597284 (+ 20472us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.613751 (+ 16467us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.615069 (+ 1318us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288189}
I20260927 13:49:49.615686 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 2a2ba67436a544e98788e9c1b00a1c33 (table default.Table_1716b29ed09743aabc7f196195efefdf [id=ec11e094cff046098922a5d559575bcb]) successfully deleted
I20260927 13:49:49.617408 6108 tablet.cc:1751] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:49.617911 6111 tablet.cc:1751] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:49.619624 6121 tablet.cc:1751] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:49.621269 5619 tablet_bootstrap.cc:492] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:49.621417 5619 ts_tablet_manager.cc:1403] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.120s user 0.002s sys 0.001s
I20260927 13:49:49.622368 5076 tablet_service.cc:1511] Processing CreateTablet for tablet daeb2045e5d84ed2b51dd88e197e84cb (DEFAULT_TABLE table=default.Table_c614391e114f4a7889ab500228e6318a [id=e84aa884563949dab840e102baec8988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.622453 5350 tablet_service.cc:1511] Processing CreateTablet for tablet f3e0e8d6bc744d69a9f41d45459d3b2b (DEFAULT_TABLE table=default.Table_d294f0cb024e426592bf4bf7f261f4be [id=56da4ca311574a50af8ec358752e07a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.622756 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daeb2045e5d84ed2b51dd88e197e84cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.622846 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e0e8d6bc744d69a9f41d45459d3b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.624516 5619 raft_consensus.cc:359] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.624709 5619 raft_consensus.cc:385] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.624815 5619 raft_consensus.cc:740] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.625099 5619 consensus_queue.cc:260] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.627136 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 206) took 1325 ms. Trace:
I20260927 13:49:49.627345 5606 rpcz_store.cc:276] 0927 13:49:48.301499 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.303691 (+ 2192us) service_pool.cc:224] Handling call
0927 13:49:49.626953 (+1323262us) ts_tablet_manager.cc:1151] Deleting tablet 2efee56b495340baa6dd51f0f3e2aaa7
0927 13:49:49.626962 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.627063 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1314321}
W20260927 13:49:49.627795 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2efee56b495340baa6dd51f0f3e2aaa7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2efee56b495340baa6dd51f0f3e2aaa7 already in progress: creating tablet
I20260927 13:49:49.628793 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 210) took 1246 ms. Trace:
I20260927 13:49:49.628918 5606 rpcz_store.cc:276] 0927 13:49:48.382383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.382433 (+ 50us) service_pool.cc:224] Handling call
0927 13:49:49.628480 (+1246047us) ts_tablet_manager.cc:1151] Deleting tablet 321b26c89f1a4c8d88f401c8ece448b0
0927 13:49:49.628595 (+ 115us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.628731 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1245796}
W20260927 13:49:49.629441 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 321b26c89f1a4c8d88f401c8ece448b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 321b26c89f1a4c8d88f401c8ece448b0 already in progress: creating tablet
I20260927 13:49:49.630415 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 207) took 1248 ms. Trace:
I20260927 13:49:49.630842 5606 rpcz_store.cc:276] 0927 13:49:48.381775 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.382988 (+ 1213us) service_pool.cc:224] Handling call
0927 13:49:49.630259 (+1247271us) ts_tablet_manager.cc:1151] Deleting tablet 4abe721ef8614d86870a0526de69014f
0927 13:49:49.630268 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.630358 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1247072}
I20260927 13:49:49.631368 5619 ts_tablet_manager.cc:1434] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20260927 13:49:49.631304 5223 tablet_service.cc:1511] Processing CreateTablet for tablet f3e0e8d6bc744d69a9f41d45459d3b2b (DEFAULT_TABLE table=default.Table_d294f0cb024e426592bf4bf7f261f4be [id=56da4ca311574a50af8ec358752e07a4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:49.631500 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 4abe721ef8614d86870a0526de69014f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4abe721ef8614d86870a0526de69014f already in progress: creating tablet
I20260927 13:49:49.631750 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e0e8d6bc744d69a9f41d45459d3b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.631878 5606 tablet_replica.cc:333] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.632068 5606 raft_consensus.cc:2243] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.632248 5606 pending_rounds.cc:70] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:49.632330 5606 pending_rounds.cc:77] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957584326590464 op_type: NO_OP noop_request { }
I20260927 13:49:49.632457 5606 raft_consensus.cc:2889] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:49.632589 5606 raft_consensus.cc:2272] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.634774 5606 ts_tablet_manager.cc:1916] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.639117 5619 tablet_bootstrap.cc:492] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:49.639575 5215 tablet_service.cc:1511] Processing CreateTablet for tablet daeb2045e5d84ed2b51dd88e197e84cb (DEFAULT_TABLE table=default.Table_c614391e114f4a7889ab500228e6318a [id=e84aa884563949dab840e102baec8988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.640039 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daeb2045e5d84ed2b51dd88e197e84cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.644723 5352 tablet_service.cc:1511] Processing CreateTablet for tablet daeb2045e5d84ed2b51dd88e197e84cb (DEFAULT_TABLE table=default.Table_c614391e114f4a7889ab500228e6318a [id=e84aa884563949dab840e102baec8988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.645185 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daeb2045e5d84ed2b51dd88e197e84cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.647089 4924 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cc6af9b33f0c464683e40adc28037bc8 (table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec]). Expected version 1 got 0
I20260927 13:49:49.648094 4925 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_ba244e66b84a4e73978644722f0d7b09 [id=e65860898b9041118d5fbb8b5aef2df4] alter complete (version 2)
I20260927 13:49:49.648799 5218 tablet_service.cc:1558] Processing DeleteTablet for tablet b783ffbf2a05453fa43797ce495f8e7a with delete_type TABLET_DATA_DELETED (replaced by tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:49.649487 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b783ffbf2a05453fa43797ce495f8e7a because the tablet was not found. No further retry: Not found: Tablet not found: b783ffbf2a05453fa43797ce495f8e7a
I20260927 13:49:49.651548 5606 ts_tablet_manager.cc:1929] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.651705 5606 log.cc:1199] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/85805d532ffa4c79974ce25041a72205
I20260927 13:49:49.652105 5606 ts_tablet_manager.cc:1950] T 85805d532ffa4c79974ce25041a72205 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.652915 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 209) took 1270 ms. Trace:
I20260927 13:49:49.653016 5606 rpcz_store.cc:276] 0927 13:49:48.382004 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.396046 (+ 14042us) service_pool.cc:224] Handling call
0927 13:49:49.631804 (+1235758us) ts_tablet_manager.cc:1151] Deleting tablet 85805d532ffa4c79974ce25041a72205
0927 13:49:49.631814 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.645369 (+ 13555us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.651476 (+ 6107us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:49.652865 (+ 1389us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1226553}
I20260927 13:49:49.653489 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 85805d532ffa4c79974ce25041a72205 (table default.Table_ee17c48a3ba7447594c552e6d7f13b1a [id=eb074c2c15c542e59ca9fb68049ac69c]) successfully deleted
I20260927 13:49:49.654804 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 80b1970a344045389709260c850adc07 with delete_type TABLET_DATA_DELETED (replaced by tablet 081f18e00af74e5c811f774d29422351) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.655085 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bf9abe277040078eb765728e3c52ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.655310 5625 tablet_replica.cc:333] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:49.655525 5625 raft_consensus.cc:2243] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.655735 5625 raft_consensus.cc:2272] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.656701 5625 ts_tablet_manager.cc:1916] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.658957 5626 consensus_queue.cc:260] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.659588 5626 ts_tablet_manager.cc:1434] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.068s user 0.003s sys 0.000s
I20260927 13:49:49.662175 5076 tablet_service.cc:1511] Processing CreateTablet for tablet f3e0e8d6bc744d69a9f41d45459d3b2b (DEFAULT_TABLE table=default.Table_d294f0cb024e426592bf4bf7f261f4be [id=56da4ca311574a50af8ec358752e07a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.662642 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e0e8d6bc744d69a9f41d45459d3b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.662534 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_967519598f9b4c999e93c6f358381116"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.663178 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_967519598f9b4c999e93c6f358381116 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.664757 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_73693476f4564e2e8e0f60b0f7e3d474"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.665408 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73693476f4564e2e8e0f60b0f7e3d474 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.665851 5626 tablet_bootstrap.cc:492] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:49.662818 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.666452 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 208) took 1284 ms. Trace:
I20260927 13:49:49.666582 5606 rpcz_store.cc:276] 0927 13:49:48.381911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.397151 (+ 15240us) service_pool.cc:224] Handling call
0927 13:49:49.666257 (+1269106us) ts_tablet_manager.cc:1151] Deleting tablet b64d3aa052bf4c48b3802f6006cce9c9
0927 13:49:49.666269 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.666400 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1257209}
W20260927 13:49:49.667066 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b64d3aa052bf4c48b3802f6006cce9c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b64d3aa052bf4c48b3802f6006cce9c9 already in progress: creating tablet
I20260927 13:49:49.667510 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 214) took 1213 ms. Trace:
I20260927 13:49:49.667634 5606 rpcz_store.cc:276] 0927 13:49:48.454231 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.454414 (+ 183us) service_pool.cc:224] Handling call
0927 13:49:49.667361 (+1212947us) ts_tablet_manager.cc:1151] Deleting tablet 0c72e1a5dced499a932bdc302e006f29
0927 13:49:49.667370 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.667461 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1212727}
I20260927 13:49:49.667982 5625 ts_tablet_manager.cc:1929] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.668098 5625 log.cc:1199] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/80b1970a344045389709260c850adc07
W20260927 13:49:49.668103 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 0c72e1a5dced499a932bdc302e006f29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c72e1a5dced499a932bdc302e006f29 already in progress: creating tablet
I20260927 13:49:49.668443 5625 ts_tablet_manager.cc:1950] T 80b1970a344045389709260c850adc07 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:49.668640 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 213) took 1214 ms. Trace:
I20260927 13:49:49.668779 5606 rpcz_store.cc:276] 0927 13:49:48.454059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.455284 (+ 1225us) service_pool.cc:224] Handling call
0927 13:49:49.668416 (+1213132us) ts_tablet_manager.cc:1151] Deleting tablet 31ee75d0a39c42b09f2f46a1774f925c
0927 13:49:49.668426 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.668593 (+ 167us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1212882}
W20260927 13:49:49.669535 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 31ee75d0a39c42b09f2f46a1774f925c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ee75d0a39c42b09f2f46a1774f925c already in progress: creating tablet
I20260927 13:49:49.669617 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 80b1970a344045389709260c850adc07 (table default.Table_eb3c068026374d0ca946d3a8bd94db90 [id=5900f338a23b46e8a487ec9cfa08b8a8]) successfully deleted
I20260927 13:49:49.670293 5625 tablet_replica.cc:333] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:49.670384 5628 tablet_bootstrap.cc:492] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.670538 5625 raft_consensus.cc:2243] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.670558 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 20766b5a757e4a7e954c198f8c9ca41f (DEFAULT_TABLE table=default.Table_e2579c7764f14413988b3e9bfd6ae8d0 [id=e60348438be94e88be62039a5ac173b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.670615 5628 ts_tablet_manager.cc:1403] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.121s user 0.006s sys 0.017s
I20260927 13:49:49.670733 5625 raft_consensus.cc:2272] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.670928 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20766b5a757e4a7e954c198f8c9ca41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.671279 5625 ts_tablet_manager.cc:1916] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.671489 5628 raft_consensus.cc:359] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.671670 5628 raft_consensus.cc:385] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.671747 5628 raft_consensus.cc:740] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.672016 5628 consensus_queue.cc:260] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.672575 5628 ts_tablet_manager.cc:1434] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:49.673076 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 20766b5a757e4a7e954c198f8c9ca41f (DEFAULT_TABLE table=default.Table_e2579c7764f14413988b3e9bfd6ae8d0 [id=e60348438be94e88be62039a5ac173b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.673377 5628 tablet_bootstrap.cc:492] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:49.673578 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20766b5a757e4a7e954c198f8c9ca41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.675025 5628 tablet_bootstrap.cc:654] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.676575 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 222) took 1068 ms. Trace:
I20260927 13:49:49.676676 5606 rpcz_store.cc:276] 0927 13:49:48.607682 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:48.607746 (+ 64us) service_pool.cc:224] Handling call
0927 13:49:49.676437 (+1068691us) ts_tablet_manager.cc:1151] Deleting tablet 80b1970a344045389709260c850adc07
0927 13:49:49.676446 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:49.676529 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1003515}
I20260927 13:49:49.677392 5606 tablet_replica.cc:333] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
W20260927 13:49:49.677527 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 80b1970a344045389709260c850adc07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80b1970a344045389709260c850adc07 already in progress: creating tablet
I20260927 13:49:49.677618 5606 raft_consensus.cc:2243] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:49.677772 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b8311ff24259477a9523355908ac14f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8311ff24259477a9523355908ac14f8 already in progress: creating tablet
I20260927 13:49:49.677809 5606 raft_consensus.cc:2272] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:49.678009 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 1f34f2d0f6e9420a8ad38d708b658b17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f34f2d0f6e9420a8ad38d708b658b17 already in progress: creating tablet
I20260927 13:49:49.678435 5606 ts_tablet_manager.cc:1916] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.680858 5626 tablet_bootstrap.cc:654] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.687776 5619 tablet_bootstrap.cc:654] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.688983 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 66b0c74e3ff84cc2889de29106c43350 (DEFAULT_TABLE table=default.Table_5f7db155b7014eeb9796b1896fa0319b [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.689500 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b0c74e3ff84cc2889de29106c43350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.689821 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 6aafbbdaa8ac48329ad422cb0c08e518 (DEFAULT_TABLE table=default.Table_a212266119b14cedb7576aff1e810ca4 [id=c35db2ada8d742c3a967191a6f539cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.690205 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aafbbdaa8ac48329ad422cb0c08e518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.691879 5606 ts_tablet_manager.cc:1929] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.692026 5606 log.cc:1199] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b0fd6fb92eb64e948e67f70c512376e2
I20260927 13:49:49.692414 5606 ts_tablet_manager.cc:1950] T b0fd6fb92eb64e948e67f70c512376e2 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.693394 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b0fd6fb92eb64e948e67f70c512376e2 (table default.Table_f3005f35fe3f408bac8f54c5a509d4ad [id=aa02060d09be44a7ad563c010ba2b274]) successfully deleted
I20260927 13:49:49.695274 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 6aafbbdaa8ac48329ad422cb0c08e518 (DEFAULT_TABLE table=default.Table_a212266119b14cedb7576aff1e810ca4 [id=c35db2ada8d742c3a967191a6f539cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.695925 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aafbbdaa8ac48329ad422cb0c08e518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.697734 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet f3e0e8d6bc744d69a9f41d45459d3b2b
I20260927 13:49:49.700014 6099 raft_consensus.cc:493] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.700268 6099 raft_consensus.cc:515] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.701414 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce1bbbe9dbb443c9f0c001107ffebdf" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:49.701617 5382 raft_consensus.cc:2468] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:49.687477 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 66b0c74e3ff84cc2889de29106c43350 (DEFAULT_TABLE table=default.Table_5f7db155b7014eeb9796b1896fa0319b [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.702064 5185 leader_election.cc:304] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:49.702310 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e0e8d6bc744d69a9f41d45459d3b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.702419 6094 raft_consensus.cc:2804] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:49.702503 6094 raft_consensus.cc:493] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:49.702538 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b0c74e3ff84cc2889de29106c43350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.702616 6094 raft_consensus.cc:3060] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:49.704406 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 129c2f99d5b143b3bd25731cfeb0009e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 129c2f99d5b143b3bd25731cfeb0009e already in progress: creating tablet
I20260927 13:49:49.705627 5606 tablet_replica.cc:333] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.705665 6094 raft_consensus.cc:515] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.705838 5606 raft_consensus.cc:2243] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.706043 5606 raft_consensus.cc:2272] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.706511 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e0e8d6bc744d69a9f41d45459d3b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.707049 5606 ts_tablet_manager.cc:1916] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:49.707762 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet f3e0e8d6bc744d69a9f41d45459d3b2b because the tablet was not found. No further retry: Not found: Tablet not found: f3e0e8d6bc744d69a9f41d45459d3b2b
I20260927 13:49:49.708630 6099 leader_election.cc:290] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:49.688534 5218 tablet_service.cc:1511] Processing CreateTablet for tablet 6aafbbdaa8ac48329ad422cb0c08e518 (DEFAULT_TABLE table=default.Table_a212266119b14cedb7576aff1e810ca4 [id=c35db2ada8d742c3a967191a6f539cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.695915 5214 tablet_service.cc:1511] Processing CreateTablet for tablet efd31e3dd142413c92fce2043e053d32 (DEFAULT_TABLE table=default.Table_5dfc30791e4347db940f164882d547d7 [id=4999b783a5ec458a8af3fbd21cf3ea5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.709117 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aafbbdaa8ac48329ad422cb0c08e518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.709333 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd31e3dd142413c92fce2043e053d32. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:49.710729 5184 leader_election.cc:343] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: dce1bbbe9dbb443c9f0c001107ffebdf
I20260927 13:49:49.714797 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce1bbbe9dbb443c9f0c001107ffebdf" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:49.715005 5382 raft_consensus.cc:3060] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:49.715426 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 66b0c74e3ff84cc2889de29106c43350 (DEFAULT_TABLE table=default.Table_5f7db155b7014eeb9796b1896fa0319b [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.716131 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b0c74e3ff84cc2889de29106c43350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.717876 5382 raft_consensus.cc:2468] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
W20260927 13:49:49.718469 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fa9d09ca7952499ba135e15cecb1143e consensus state has no leader
I20260927 13:49:49.719529 6094 leader_election.cc:290] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:49.720294 5184 leader_election.cc:343] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: dce1bbbe9dbb443c9f0c001107ffebdf
I20260927 13:49:49.720782 5185 leader_election.cc:304] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:49.721282 6094 raft_consensus.cc:2804] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:49.721498 6094 raft_consensus.cc:697] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:49.721498 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d47e75198129467fb676323164970dc6" } new_table_name: "default.Table_48a5fac9ec3d40c4a4b405f925a74326" modify_external_catalogs: true
I20260927 13:49:49.721871 6094 consensus_queue.cc:237] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.724831 5628 tablet_bootstrap.cc:492] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.724987 5628 ts_tablet_manager.cc:1403] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.052s user 0.009s sys 0.008s
I20260927 13:49:49.725375 6127 raft_consensus.cc:493] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.725585 6127 raft_consensus.cc:515] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.726922 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a305ad4c704bbd8d522515786100c0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:49.727541 5044 leader_election.cc:343] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.727801 6127 leader_election.cc:290] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.728478 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a305ad4c704bbd8d522515786100c0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:49.729079 5045 leader_election.cc:343] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.729282 5045 leader_election.cc:304] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:49.729748 6127 raft_consensus.cc:2749] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.731920 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 20766b5a757e4a7e954c198f8c9ca41f (DEFAULT_TABLE table=default.Table_e2579c7764f14413988b3e9bfd6ae8d0 [id=e60348438be94e88be62039a5ac173b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.735160 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_213d3c2f351b4190be9c4ff62131b280" } new_table_name: "default.Table_4ce714062e7c4acf8c4945dc787ca610" modify_external_catalogs: true
I20260927 13:49:49.735771 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20766b5a757e4a7e954c198f8c9ca41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.739240 5626 tablet_bootstrap.cc:492] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:49.739248 5606 ts_tablet_manager.cc:1929] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:49.739391 5606 log.cc:1199] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/c79b1f2962f44a23916bbfe4cf55a4bc
I20260927 13:49:49.739431 5626 ts_tablet_manager.cc:1403] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.000s
I20260927 13:49:49.740760 5606 ts_tablet_manager.cc:1950] T c79b1f2962f44a23916bbfe4cf55a4bc P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.740744 5626 raft_consensus.cc:359] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.740971 5626 raft_consensus.cc:385] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.741066 5626 raft_consensus.cc:740] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.741307 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e0e8d6bc744d69a9f41d45459d3b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.741927 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet c79b1f2962f44a23916bbfe4cf55a4bc (table default.Table_847c101270804f9f856b7e564cc9fbbe [id=d140ef61df2143d8bd6f44d8f92153c9]) successfully deleted
W20260927 13:49:49.742690 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 1f5dfa3e80454463908df19a49454764 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f5dfa3e80454463908df19a49454764 already in progress: creating tablet
W20260927 13:49:49.743719 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 6ce893441d5e4d9f89743e75eb762276 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ce893441d5e4d9f89743e75eb762276 already in progress: creating tablet
W20260927 13:49:49.744292 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 3b855dedb8d04145b0c4469b9ba79453 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b855dedb8d04145b0c4469b9ba79453 already in progress: creating tablet
I20260927 13:49:49.746281 4929 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 99da54ce95004e4eb3a0b4291552b951
I20260927 13:49:49.747120 5350 tablet_service.cc:1511] Processing CreateTablet for tablet efd31e3dd142413c92fce2043e053d32 (DEFAULT_TABLE table=default.Table_5dfc30791e4347db940f164882d547d7 [id=4999b783a5ec458a8af3fbd21cf3ea5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.747634 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd31e3dd142413c92fce2043e053d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.749454 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ba9eecef03ec466b97eab6b3720b265b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.750015 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba9eecef03ec466b97eab6b3720b265b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.725792 5628 raft_consensus.cc:359] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.752694 5628 raft_consensus.cc:385] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.752872 5628 raft_consensus.cc:740] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:49:49.754375 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet f3e0e8d6bc744d69a9f41d45459d3b2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3e0e8d6bc744d69a9f41d45459d3b2b already in progress: creating tablet
I20260927 13:49:49.754789 5628 consensus_queue.cc:260] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.755338 5628 ts_tablet_manager.cc:1434] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20260927 13:49:49.755728 5628 tablet_bootstrap.cc:492] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:49.758972 5626 consensus_queue.cc:260] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.759613 5626 ts_tablet_manager.cc:1434] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.020s user 0.002s sys 0.001s
I20260927 13:49:49.759940 5626 tablet_bootstrap.cc:492] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:49.770464 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet d6c46d0e50a44232a82d00c88d9f63b5
I20260927 13:49:49.771050 4927 catalog_manager.cc:6934] ReplaceTablet: tablet d6c46d0e50a44232a82d00c88d9f63b5 deleted and replaced by tablet 5ff575db41bf4ba9846b94502391dc60
I20260927 13:49:49.771255 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c46d0e50a44232a82d00c88d9f63b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ff575db41bf4ba9846b94502391dc60) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.771334 4927 master_service.cc:960] ReplaceTablet: received request to replace tablet 059afd48ac4a41569ed1d3556b7974f0 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:49.771754 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c46d0e50a44232a82d00c88d9f63b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ff575db41bf4ba9846b94502391dc60) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.772028 5623 tablet_replica.cc:333] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.772244 5623 raft_consensus.cc:2243] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:49.772619 5623 raft_consensus.cc:2272] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.773409 4926 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 74226753751a49fa8ce98eafb2ca1250 (table default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b]). Expected version 1 got 0
I20260927 13:49:49.773597 5623 ts_tablet_manager.cc:1916] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.774232 4921 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_977d1a0483e64f658c2eaead2cc16803 [id=59df0a1ee3ea43e8ac991b38717c1549] alter complete (version 5)
I20260927 13:49:49.782814 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_500153cc90d14773ba7a9cfdbcde81af" } new_table_name: "default.Table_0dc6b57a88cc433c8130f52ee6622be2" modify_external_catalogs: true
I20260927 13:49:49.783502 5626 tablet_bootstrap.cc:654] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.786434 5628 tablet_bootstrap.cc:654] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.787335 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c46d0e50a44232a82d00c88d9f63b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ff575db41bf4ba9846b94502391dc60) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.787643 6063 raft_consensus.cc:493] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.787588 6068 consensus_queue.cc:1048] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260927 13:49:49.792268 4749 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu with pid 4825
I20260927 13:49:49.793048 5623 ts_tablet_manager.cc:1929] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 13:49:49.793133 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a8c1b74943b9479e8b37969b2933c5a4
I20260927 13:49:49.793215 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 2cec272546cb4373bf69e3ab344c46e1 (DEFAULT_TABLE table=default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.793335 5623 log.cc:1199] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/d6c46d0e50a44232a82d00c88d9f63b5
I20260927 13:49:49.793627 4930 catalog_manager.cc:6934] ReplaceTablet: tablet a8c1b74943b9479e8b37969b2933c5a4 deleted and replaced by tablet 3933c0a2fd6547f28528fae7d443a2c1
I20260927 13:49:49.793982 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet a8c1b74943b9479e8b37969b2933c5a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3933c0a2fd6547f28528fae7d443a2c1) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.794314 5623 ts_tablet_manager.cc:1950] T d6c46d0e50a44232a82d00c88d9f63b5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:49.794703 5619 tablet_bootstrap.cc:492] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:49.794788 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cec272546cb4373bf69e3ab344c46e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.794621 6063 raft_consensus.cc:515] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.797560 6063 leader_election.cc:290] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.797997 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b1d54e4af0432f9d1ef9879d2ec4e9" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.798964 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet dff5992b27f049f5890e65d5a8dcc3cf with delete_type TABLET_DATA_DELETED (replaced by tablet 1f5dfa3e80454463908df19a49454764) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.799346 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet dce1bbbe9dbb443c9f0c001107ffebdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.799541 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 85805d532ffa4c79974ce25041a72205 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.799970 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b04383cb494f65be7ba507a0f0b441 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.800174 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 0018704e08254c2e8d30c7067df4420c with delete_type TABLET_DATA_DELETED (replaced by tablet 059afd48ac4a41569ed1d3556b7974f0) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.800482 5619 ts_tablet_manager.cc:1403] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.156s user 0.002s sys 0.002s
I20260927 13:49:49.800534 5606 tablet_replica.cc:333] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.800833 5606 raft_consensus.cc:2243] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.801152 5606 raft_consensus.cc:2272] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.801409 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet d2e0b4c217ca41b98013155b8d952fe6 with delete_type TABLET_DATA_DELETED (replaced by tablet 0361e3b244a1437b8e402dd8602528fe) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.801604 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.801753 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet b0fd6fb92eb64e948e67f70c512376e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.801644 5619 raft_consensus.cc:359] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.801882 5619 raft_consensus.cc:385] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.801923 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet a8c1b74943b9479e8b37969b2933c5a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3933c0a2fd6547f28528fae7d443a2c1) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.801971 5619 raft_consensus.cc:740] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.802060 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 2cec272546cb4373bf69e3ab344c46e1 (DEFAULT_TABLE table=default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.802268 5619 consensus_queue.cc:260] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.803050 5606 ts_tablet_manager.cc:1916] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.803181 5619 ts_tablet_manager.cc:1434] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 13:49:49.805166 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8ad96efd2222495a89b4620b74fdc2e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.805709 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ad96efd2222495a89b4620b74fdc2e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.806260 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 46537e1b33f24d50b705d53f6978da3c (DEFAULT_TABLE table=default.Table_22d5c80b2b5b4ee09361300740be2ab2 [id=f78659fb9203483aa74b05e453e1fa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.806773 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 03a1f13b31934baa8ce18fc499e94806 (DEFAULT_TABLE table=default.Table_393b924b35284f7ab739c7df3b388bf3 [id=ded13e9c993046cd891db043b1ff6a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.807175 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a1f13b31934baa8ce18fc499e94806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.807548 5626 tablet_bootstrap.cc:492] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:49.807729 5626 ts_tablet_manager.cc:1403] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.005s
I20260927 13:49:49.807829 5218 tablet_service.cc:1511] Processing CreateTablet for tablet 2885e0829d014765b54124a0eb23a4dc (DEFAULT_TABLE table=default.Table_c193f6d7a86a41b58650b5be4520226d [id=ed36c1596e8346f787aaa6271352fe40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.808236 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2885e0829d014765b54124a0eb23a4dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.808619 5626 raft_consensus.cc:359] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:49.808826 5626 raft_consensus.cc:385] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.808909 5626 raft_consensus.cc:740] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.809214 5626 consensus_queue.cc:260] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:49.809763 5626 ts_tablet_manager.cc:1434] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:49.810088 5626 tablet_bootstrap.cc:492] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:49.810421 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 03a1f13b31934baa8ce18fc499e94806 (DEFAULT_TABLE table=default.Table_393b924b35284f7ab739c7df3b388bf3 [id=ded13e9c993046cd891db043b1ff6a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.811733 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a1f13b31934baa8ce18fc499e94806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.812317 5626 tablet_bootstrap.cc:654] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.814548 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cec272546cb4373bf69e3ab344c46e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.814829 5619 tablet_bootstrap.cc:492] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:49.814646 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 46537e1b33f24d50b705d53f6978da3c (DEFAULT_TABLE table=default.Table_22d5c80b2b5b4ee09361300740be2ab2 [id=f78659fb9203483aa74b05e453e1fa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.815287 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46537e1b33f24d50b705d53f6978da3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.816839 5619 tablet_bootstrap.cc:654] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.822935 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46537e1b33f24d50b705d53f6978da3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.790380 5076 tablet_service.cc:1511] Processing CreateTablet for tablet efd31e3dd142413c92fce2043e053d32 (DEFAULT_TABLE table=default.Table_5dfc30791e4347db940f164882d547d7 [id=4999b783a5ec458a8af3fbd21cf3ea5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.793277 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 2cec272546cb4373bf69e3ab344c46e1 (DEFAULT_TABLE table=default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.794509 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet a8c1b74943b9479e8b37969b2933c5a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3933c0a2fd6547f28528fae7d443a2c1) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.800072 6127 raft_consensus.cc:493] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.802807 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 46537e1b33f24d50b705d53f6978da3c (DEFAULT_TABLE table=default.Table_22d5c80b2b5b4ee09361300740be2ab2 [id=f78659fb9203483aa74b05e453e1fa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.805830 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 03a1f13b31934baa8ce18fc499e94806 (DEFAULT_TABLE table=default.Table_393b924b35284f7ab739c7df3b388bf3 [id=ded13e9c993046cd891db043b1ff6a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.826087 6063 raft_consensus.cc:493] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.826262 6063 raft_consensus.cc:515] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:49.826545 5319 leader_election.cc:343] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a3b1d54e4af0432f9d1ef9879d2ec4e9
W20260927 13:49:49.826895 5319 leader_election.cc:343] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.826938 6063 leader_election.cc:290] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.825546 6127 raft_consensus.cc:515] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.827054 5319 leader_election.cc:304] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:49.828080 5360 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.828380 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7011125c78084deca83b1570d1c2d704" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.828408 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7011125c78084deca83b1570d1c2d704" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:49.828689 6068 raft_consensus.cc:2749] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:49.828992 5044 leader_election.cc:343] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.829192 6127 leader_election.cc:290] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.830052 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b04383cb494f65be7ba507a0f0b441" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.830341 5247 raft_consensus.cc:2468] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:49.831755 5319 leader_election.cc:304] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:49:49.832144 5319 leader_election.cc:343] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: d9b04383cb494f65be7ba507a0f0b441
W20260927 13:49:49.832566 5045 leader_election.cc:343] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.832677 5045 leader_election.cc:304] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:49.833786 6063 raft_consensus.cc:2804] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:49.833947 6063 raft_consensus.cc:493] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:49.834056 6063 raft_consensus.cc:3060] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:49.834513 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet fa9d09ca7952499ba135e15cecb1143e from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:49.835402 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd31e3dd142413c92fce2043e053d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.835966 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cec272546cb4373bf69e3ab344c46e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.836440 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46537e1b33f24d50b705d53f6978da3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.836973 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a1f13b31934baa8ce18fc499e94806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.837585 6063 raft_consensus.cc:515] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:49.843408 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5cc71e06eb743d2b63e056e88a6498f consensus state has no leader
I20260927 13:49:49.843693 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet 559ac90ef36d406881dc17ade0560044 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:49.844106 6127 raft_consensus.cc:2749] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:49.844545 5319 consensus_peers.cc:597] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:49:49.853114 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60de1c28618f4e478aae68ad07fbcf98 consensus state has no leader
I20260927 13:49:49.854496 6043 raft_consensus.cc:493] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.854612 6063 leader_election.cc:290] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.854672 6043 raft_consensus.cc:515] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.855301 6043 leader_election.cc:290] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.855456 6043 raft_consensus.cc:493] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.855579 6043 raft_consensus.cc:515] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:49.856091 6043 leader_election.cc:290] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:49.856832 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e680c915b7b546a7927c1795fa7f3ef4" } modify_external_catalogs: true
I20260927 13:49:49.856851 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6af9b33f0c464683e40adc28037bc8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.857034 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e680c915b7b546a7927c1795fa7f3ef4" } modify_external_catalogs: true
I20260927 13:49:49.856998 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e959f8c6fa74a1bbaf06d91c3e484bc" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.857381 5606 ts_tablet_manager.cc:1929] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 13:49:49.857496 5606 log.cc:1199] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/d6c46d0e50a44232a82d00c88d9f63b5
W20260927 13:49:49.857540 5044 leader_election.cc:343] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:49.857766 5044 leader_election.cc:343] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.858397 5606 ts_tablet_manager.cc:1950] T d6c46d0e50a44232a82d00c88d9f63b5 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.859412 5606 tablet_replica.cc:333] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.859565 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet d6c46d0e50a44232a82d00c88d9f63b5 (table default.Table_ba244e66b84a4e73978644722f0d7b09 [id=e65860898b9041118d5fbb8b5aef2df4]) successfully deleted
I20260927 13:49:49.859583 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b04383cb494f65be7ba507a0f0b441" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:49.859642 5606 raft_consensus.cc:2243] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.859760 5248 raft_consensus.cc:3060] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:49.859805 5606 raft_consensus.cc:2272] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.860316 5606 ts_tablet_manager.cc:1916] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.862624 5248 raft_consensus.cc:2468] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:49.863077 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6af9b33f0c464683e40adc28037bc8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:49.863289 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet d6c46d0e50a44232a82d00c88d9f63b5 (table default.Table_ba244e66b84a4e73978644722f0d7b09 [id=e65860898b9041118d5fbb8b5aef2df4]) successfully deleted
W20260927 13:49:49.863538 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a8c1b74943b9479e8b37969b2933c5a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8c1b74943b9479e8b37969b2933c5a4 already in progress: creating tablet
I20260927 13:49:49.863637 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e959f8c6fa74a1bbaf06d91c3e484bc" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:49.864081 5045 leader_election.cc:343] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.864198 5045 leader_election.cc:304] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:49.864828 5045 leader_election.cc:343] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.864957 5045 leader_election.cc:304] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:49.865329 6043 raft_consensus.cc:2749] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.865549 6043 raft_consensus.cc:2749] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.865926 5319 leader_election.cc:304] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:49.866251 6063 raft_consensus.cc:2804] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:49.866393 6063 raft_consensus.cc:697] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:49.866675 6063 consensus_queue.cc:237] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.867027 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6e0a2dbfabb64a0995f5d5a8878c1378" } modify_external_catalogs: true
I20260927 13:49:49.867203 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6e0a2dbfabb64a0995f5d5a8878c1378" } modify_external_catalogs: true
I20260927 13:49:49.867311 5625 ts_tablet_manager.cc:1929] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.867462 5625 log.cc:1199] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/24bf9abe277040078eb765728e3c52ef
I20260927 13:49:49.867821 5625 ts_tablet_manager.cc:1950] T 24bf9abe277040078eb765728e3c52ef P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:49.866257 5319 leader_election.cc:343] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: d9b04383cb494f65be7ba507a0f0b441
I20260927 13:49:49.871009 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 24bf9abe277040078eb765728e3c52ef (table default.Table_f3b7b12a18cd41dc98240136b5611848 [id=9e5e2ee15095486b815cf581c218a75c]) successfully deleted
I20260927 13:49:49.871342 5625 tablet_replica.cc:333] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:49.871544 5625 raft_consensus.cc:2243] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.871708 5625 raft_consensus.cc:2272] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.872208 5625 ts_tablet_manager.cc:1916] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.875306 4923 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_511b3463a96f497dade7a9c12509f338 [id=09f379b76b2f43c8853cd36c6b52e296] alter complete (version 1)
I20260927 13:49:49.877049 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f549f487ea4dbb8c7fceee6f8a6db0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:49.877048 4926 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 74226753751a49fa8ce98eafb2ca1250 (table default.Table_3511ad1c722940ca87a5e0807110230c [id=8c41592b4b4c4d4b9286336ed3c77b4b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 74226753751a49fa8ce98eafb2ca1250 consensus state has no leader
I20260927 13:49:49.877310 5623 tablet_replica.cc:333] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.877559 5623 raft_consensus.cc:2243] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:49.877312 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet dff5992b27f049f5890e65d5a8dcc3cf with delete_type TABLET_DATA_DELETED (replaced by tablet 1f5dfa3e80454463908df19a49454764) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.877774 5623 pending_rounds.cc:70] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:49.877844 5623 pending_rounds.cc:77] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957588907347968 op_type: NO_OP noop_request { }
I20260927 13:49:49.878386 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c46d0e50a44232a82d00c88d9f63b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ff575db41bf4ba9846b94502391dc60) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.878984 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 195ce37d4abf4b92af22b46654b86ba5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.877934 5623 raft_consensus.cc:2889] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:49.879251 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.879310 5623 raft_consensus.cc:2272] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.880120 5626 tablet_bootstrap.cc:492] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:49.880369 5623 ts_tablet_manager.cc:1916] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.880366 5626 ts_tablet_manager.cc:1403] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.070s user 0.009s sys 0.013s
I20260927 13:49:49.882143 5626 raft_consensus.cc:359] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.882340 5626 raft_consensus.cc:385] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.882436 5626 raft_consensus.cc:740] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.882664 5626 consensus_queue.cc:260] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.886570 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 2885e0829d014765b54124a0eb23a4dc (DEFAULT_TABLE table=default.Table_c193f6d7a86a41b58650b5be4520226d [id=ed36c1596e8346f787aaa6271352fe40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.886982 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2885e0829d014765b54124a0eb23a4dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.887188 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_0d2bf498389c4960ac0105ae0a6d0fcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.887742 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d2bf498389c4960ac0105ae0a6d0fcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.888981 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 081f18e00af74e5c811f774d29422351 (DEFAULT_TABLE table=default.Table_eb3c068026374d0ca946d3a8bd94db90 [id=5900f338a23b46e8a487ec9cfa08b8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.889040 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_b5cc5519bcfb41efacb0dab9a602c3d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:49.889369 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081f18e00af74e5c811f774d29422351. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:49.889523 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5cc5519bcfb41efacb0dab9a602c3d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.890090 5623 ts_tablet_manager.cc:1929] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:49.890259 5623 log.cc:1199] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/77f549f487ea4dbb8c7fceee6f8a6db0
I20260927 13:49:49.890770 5623 ts_tablet_manager.cc:1950] T 77f549f487ea4dbb8c7fceee6f8a6db0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:49.890704 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2f1b1efb4dbd43b8b3a3008a37acb490" } new_table_name: "default.Table_48f2011ba0d94370a858a7187bf55677" modify_external_catalogs: true
I20260927 13:49:49.891983 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 77f549f487ea4dbb8c7fceee6f8a6db0 (table default.Table_db24dbfc253c4e76ab35b8bb7770eb8b [id=3b60feafc4a7467b8e301307adaa8187]) successfully deleted
I20260927 13:49:49.892298 5623 tablet_replica.cc:333] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.892498 5623 raft_consensus.cc:2243] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.892647 5623 raft_consensus.cc:2272] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.893160 5623 ts_tablet_manager.cc:1916] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.894183 5626 ts_tablet_manager.cc:1434] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260927 13:49:49.894522 5626 tablet_bootstrap.cc:492] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:49.895035 5619 tablet_bootstrap.cc:492] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:49.895253 5619 ts_tablet_manager.cc:1403] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.081s user 0.002s sys 0.002s
I20260927 13:49:49.896099 5619 raft_consensus.cc:359] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.896286 5626 tablet_bootstrap.cc:654] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.896368 5619 raft_consensus.cc:385] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.896520 5619 raft_consensus.cc:740] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.896894 5619 consensus_queue.cc:260] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.897480 5619 ts_tablet_manager.cc:1434] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:49.897727 5218 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b04383cb494f65be7ba507a0f0b441 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.898078 5619 tablet_bootstrap.cc:492] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:49.900888 5606 ts_tablet_manager.cc:1929] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.901376 5606 log.cc:1199] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/dff5992b27f049f5890e65d5a8dcc3cf
I20260927 13:49:49.901785 5606 ts_tablet_manager.cc:1950] T dff5992b27f049f5890e65d5a8dcc3cf P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:49.902194 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 081f18e00af74e5c811f774d29422351 (DEFAULT_TABLE table=default.Table_eb3c068026374d0ca946d3a8bd94db90 [id=5900f338a23b46e8a487ec9cfa08b8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.902597 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081f18e00af74e5c811f774d29422351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.903056 5218 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3fa4870d5547a2bbffe1745b964504 (DEFAULT_TABLE table=default.Table_009df0f55a87479eab602a85d1503bf9 [id=1ea34fa23bae4ba88424a02d4e54a803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.903528 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3fa4870d5547a2bbffe1745b964504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.906378 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 059afd48ac4a41569ed1d3556b7974f0
I20260927 13:49:49.906876 4927 catalog_manager.cc:6934] ReplaceTablet: tablet 059afd48ac4a41569ed1d3556b7974f0 deleted and replaced by tablet b57886cc11a2423983c2b7bac79150a0
I20260927 13:49:49.907158 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 059afd48ac4a41569ed1d3556b7974f0 with delete_type TABLET_DATA_DELETED (replaced by tablet b57886cc11a2423983c2b7bac79150a0) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.907966 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 059afd48ac4a41569ed1d3556b7974f0 with delete_type TABLET_DATA_DELETED (replaced by tablet b57886cc11a2423983c2b7bac79150a0) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.908377 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3fa4870d5547a2bbffe1745b964504 (DEFAULT_TABLE table=default.Table_009df0f55a87479eab602a85d1503bf9 [id=1ea34fa23bae4ba88424a02d4e54a803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.908727 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3fa4870d5547a2bbffe1745b964504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.910251 5623 ts_tablet_manager.cc:1929] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.910391 5623 log.cc:1199] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/dff5992b27f049f5890e65d5a8dcc3cf
I20260927 13:49:49.910785 5623 ts_tablet_manager.cc:1950] T dff5992b27f049f5890e65d5a8dcc3cf P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:49.911839 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet dff5992b27f049f5890e65d5a8dcc3cf (table default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]) successfully deleted
I20260927 13:49:49.912503 5214 tablet_service.cc:1511] Processing CreateTablet for tablet bbb4f42522e84964aeb19358ee02dfc2 (DEFAULT_TABLE table=default.Table_5f2f268fd879476db40bf7a96885d2a5 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.912925 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb4f42522e84964aeb19358ee02dfc2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:49.915913 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet d6c46d0e50a44232a82d00c88d9f63b5 because the tablet was not found. No further retry: Not found: Tablet not found: d6c46d0e50a44232a82d00c88d9f63b5
I20260927 13:49:49.916078 5606 tablet_replica.cc:333] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:49.916278 5606 raft_consensus.cc:2243] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.916483 5606 raft_consensus.cc:2272] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.916667 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet dff5992b27f049f5890e65d5a8dcc3cf (table default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]) successfully deleted
I20260927 13:49:49.916884 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet 2efee56b495340baa6dd51f0f3e2aaa7 with delete_type TABLET_DATA_DELETED (replaced by tablet 5e3fa4870d5547a2bbffe1745b964504) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.917192 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 195ce37d4abf4b92af22b46654b86ba5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.917388 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ba244e66b84a4e73978644722f0d7b09" } modify_external_catalogs: true
I20260927 13:49:49.917554 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ba244e66b84a4e73978644722f0d7b09" } modify_external_catalogs: true
I20260927 13:49:49.918218 5606 ts_tablet_manager.cc:1916] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.918522 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet dce1bbbe9dbb443c9f0c001107ffebdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.920140 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a4b7500f05e4b63b4d79fabde88ebe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.920799 5623 tablet_replica.cc:333] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.920982 5623 raft_consensus.cc:2243] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.921150 5623 raft_consensus.cc:2272] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.922350 6127 raft_consensus.cc:493] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.922580 5619 tablet_bootstrap.cc:654] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:49.923352 5623 ts_tablet_manager.cc:1916] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.923744 6127 raft_consensus.cc:515] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.924633 6127 leader_election.cc:290] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.924765 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64d3aa052bf4c48b3802f6006cce9c9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:49.925040 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 081f18e00af74e5c811f774d29422351 (DEFAULT_TABLE table=default.Table_eb3c068026374d0ca946d3a8bd94db90 [id=5900f338a23b46e8a487ec9cfa08b8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.925446 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081f18e00af74e5c811f774d29422351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.925379 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64d3aa052bf4c48b3802f6006cce9c9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:49.926573 5045 leader_election.cc:343] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.926777 5078 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3fa4870d5547a2bbffe1745b964504 (DEFAULT_TABLE table=default.Table_009df0f55a87479eab602a85d1503bf9 [id=1ea34fa23bae4ba88424a02d4e54a803]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:49.927366 5044 leader_election.cc:343] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.927500 5044 leader_election.cc:304] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:49.928076 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3fa4870d5547a2bbffe1745b964504. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:49.929354 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2e30216e0487496f8efdb8a3b06deb5a consensus state has no leader
I20260927 13:49:49.929970 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 2885e0829d014765b54124a0eb23a4dc (DEFAULT_TABLE table=default.Table_c193f6d7a86a41b58650b5be4520226d [id=ed36c1596e8346f787aaa6271352fe40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.932958 6127 raft_consensus.cc:2749] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:49.935339 5356 tablet_service.cc:1511] Processing CreateTablet for tablet bbb4f42522e84964aeb19358ee02dfc2 (DEFAULT_TABLE table=default.Table_5f2f268fd879476db40bf7a96885d2a5 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.935649 5623 ts_tablet_manager.cc:1929] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:49.936581 5626 tablet_bootstrap.cc:492] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:49.936820 5626 ts_tablet_manager.cc:1403] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.004s
I20260927 13:49:49.937530 5626 raft_consensus.cc:359] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.937707 5626 raft_consensus.cc:385] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:49.937780 5626 raft_consensus.cc:740] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:49.938223 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.938062 5626 consensus_queue.cc:260] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:49.938931 5626 ts_tablet_manager.cc:1434] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:49.939045 5623 log.cc:1199] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/d9b04383cb494f65be7ba507a0f0b441
I20260927 13:49:49.939620 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 04d3c47755c94148a488782dbc379011 (DEFAULT_TABLE table=default.Table_fdf2135656604c40956e676bc740ab08 [id=90be47669a104900ba8e9d2f12cdb8de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.940207 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d3c47755c94148a488782dbc379011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.940114 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet 0004ef0b2dd841ac860798d804374dc1 with delete_type TABLET_DATA_DELETED (replaced by tablet bbb4f42522e84964aeb19358ee02dfc2) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.941154 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb4f42522e84964aeb19358ee02dfc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.941789 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 04d3c47755c94148a488782dbc379011 (DEFAULT_TABLE table=default.Table_fdf2135656604c40956e676bc740ab08 [id=90be47669a104900ba8e9d2f12cdb8de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.942137 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d3c47755c94148a488782dbc379011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.945166 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ffc1e524e9a84e0a87e674470c4370e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.945864 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffc1e524e9a84e0a87e674470c4370e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.947844 5626 tablet_bootstrap.cc:492] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:49.951419 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 60de1c28618f4e478aae68ad07fbcf98 (DEFAULT_TABLE table=default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.951848 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60de1c28618f4e478aae68ad07fbcf98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.952133 5623 ts_tablet_manager.cc:1950] T d9b04383cb494f65be7ba507a0f0b441 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:49.953449 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet d9b04383cb494f65be7ba507a0f0b441 (table default.Table_f2d64a3ffe674d5ebbab910acdf51b20 [id=d30e7ed235504af3a53544c14e35b456]) successfully deleted
I20260927 13:49:49.953869 5626 tablet_bootstrap.cc:654] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:49.955189 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 059afd48ac4a41569ed1d3556b7974f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 059afd48ac4a41569ed1d3556b7974f0 already in progress: creating tablet
I20260927 13:49:49.956099 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8bf79954c2429f886ac7afc9a8455f (DEFAULT_TABLE table=default.Table_7d190d6d35774a4f9f8ca7efceb00954 [id=8ac45fbdc31b499b9f246f5a1167281a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.956588 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8bf79954c2429f886ac7afc9a8455f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.958441 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8bf79954c2429f886ac7afc9a8455f (DEFAULT_TABLE table=default.Table_7d190d6d35774a4f9f8ca7efceb00954 [id=8ac45fbdc31b499b9f246f5a1167281a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.958724 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2885e0829d014765b54124a0eb23a4dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.958873 5623 tablet_replica.cc:333] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:49.959982 5623 raft_consensus.cc:2243] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:49.960155 5623 raft_consensus.cc:2272] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:49.960898 5623 ts_tablet_manager.cc:1916] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:49.961457 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 6817fb4caf6a445b899830c6702bf911 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bd182d7cb414f07944072b0c00ee35c) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.962535 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 04d3c47755c94148a488782dbc379011 (DEFAULT_TABLE table=default.Table_fdf2135656604c40956e676bc740ab08 [id=90be47669a104900ba8e9d2f12cdb8de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.962898 6127 raft_consensus.cc:493] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.962924 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet b64d3aa052bf4c48b3802f6006cce9c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 03a1f13b31934baa8ce18fc499e94806) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.963042 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 06c810fde988439c97a8445fc88626b3 (DEFAULT_TABLE table=default.Table_2bf1c8729308443bba92997d06f84e9e [id=861ae0d96dd54f1dac15e3cce0ed657a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.963306 6127 raft_consensus.cc:515] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:49.963568 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c810fde988439c97a8445fc88626b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.963709 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5c8ae4b5c0f54c9e8874b6a5633bd730"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:49.963903 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet b0fd6fb92eb64e948e67f70c512376e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:49.964237 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c8ae4b5c0f54c9e8874b6a5633bd730 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.964279 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet a6af740383384609a354d7f0fae2cd70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.964632 5077 tablet_service.cc:1511] Processing CreateTablet for tablet bbb4f42522e84964aeb19358ee02dfc2 (DEFAULT_TABLE table=default.Table_5f2f268fd879476db40bf7a96885d2a5 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.965144 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet c989f70385f64593a46f633c98267627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.965754 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb4f42522e84964aeb19358ee02dfc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.965874 5628 tablet_bootstrap.cc:492] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:49.965867 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c989f70385f64593a46f633c98267627" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.966301 6127 leader_election.cc:290] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:49.967160 5044 leader_election.cc:343] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.967795 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 60de1c28618f4e478aae68ad07fbcf98 (DEFAULT_TABLE table=default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.968303 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c989f70385f64593a46f633c98267627" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:49.968873 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8bf79954c2429f886ac7afc9a8455f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.969528 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d3c47755c94148a488782dbc379011. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:49.969524 5045 leader_election.cc:343] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.970501 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 059afd48ac4a41569ed1d3556b7974f0 with delete_type TABLET_DATA_DELETED (replaced by tablet b57886cc11a2423983c2b7bac79150a0) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:49.971931 6145 raft_consensus.cc:493] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:49.973152 6145 raft_consensus.cc:515] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:49.973503 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet fa9d09ca7952499ba135e15cecb1143e
I20260927 13:49:49.974143 4924 catalog_manager.cc:6934] ReplaceTablet: tablet fa9d09ca7952499ba135e15cecb1143e deleted and replaced by tablet 4211f338c6a648c5b3e36c6df0b3c510
I20260927 13:49:49.974368 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet fa9d09ca7952499ba135e15cecb1143e with delete_type TABLET_DATA_DELETED (replaced by tablet 4211f338c6a648c5b3e36c6df0b3c510) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.974857 6145 leader_election.cc:290] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:49.975066 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0018704e08254c2e8d30c7067df4420c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:49.975167 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet fa9d09ca7952499ba135e15cecb1143e with delete_type TABLET_DATA_DELETED (replaced by tablet 4211f338c6a648c5b3e36c6df0b3c510) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:49.975641 5319 leader_election.cc:343] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:49.975920 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 06c810fde988439c97a8445fc88626b3 (DEFAULT_TABLE table=default.Table_2bf1c8729308443bba92997d06f84e9e [id=861ae0d96dd54f1dac15e3cce0ed657a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.976954 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 2e30216e0487496f8efdb8a3b06deb5a (DEFAULT_TABLE table=default.Table_0dc6b57a88cc433c8130f52ee6622be2 [id=4997d0b27b0240959549e68dda2f9958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.977416 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e30216e0487496f8efdb8a3b06deb5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.977983 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c810fde988439c97a8445fc88626b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.978327 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8afed1bb46964731b195130b04104855"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:49.978943 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8afed1bb46964731b195130b04104855 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:49.980723 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 2e30216e0487496f8efdb8a3b06deb5a (DEFAULT_TABLE table=default.Table_0dc6b57a88cc433c8130f52ee6622be2 [id=4997d0b27b0240959549e68dda2f9958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.981113 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e30216e0487496f8efdb8a3b06deb5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.985616 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 559ac90ef36d406881dc17ade0560044
I20260927 13:49:49.986183 4922 catalog_manager.cc:6934] ReplaceTablet: tablet 559ac90ef36d406881dc17ade0560044 deleted and replaced by tablet 3afb800e7ff44aadaed8f8d85aa9efe2
I20260927 13:49:49.986498 5218 tablet_service.cc:1558] Processing DeleteTablet for tablet 559ac90ef36d406881dc17ade0560044 with delete_type TABLET_DATA_DELETED (replaced by tablet 3afb800e7ff44aadaed8f8d85aa9efe2) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:49.987092 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 559ac90ef36d406881dc17ade0560044 with delete_type TABLET_DATA_DELETED (replaced by tablet 3afb800e7ff44aadaed8f8d85aa9efe2) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:49.988080 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 730cd78c7b1a49d892a5ecb46fae0812 (DEFAULT_TABLE table=default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.988565 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730cd78c7b1a49d892a5ecb46fae0812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.992530 5628 ts_tablet_manager.cc:1403] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.210s user 0.006s sys 0.003s
I20260927 13:49:49.993439 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 60de1c28618f4e478aae68ad07fbcf98 (DEFAULT_TABLE table=default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.994868 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60de1c28618f4e478aae68ad07fbcf98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.996004 5218 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd182d7cb414f07944072b0c00ee35c (DEFAULT_TABLE table=default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b [id=48d90d1ed51f4b18b9ad5a1b7fc3cde4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.996438 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd182d7cb414f07944072b0c00ee35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.997112 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 3700a1f40c0644848da62392cb0c297f (DEFAULT_TABLE table=default.Table_22a8a2d3c05d409480ef5c85b521fa0d [id=9982cd84b23842e89881d5ba772f6b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.997498 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3700a1f40c0644848da62392cb0c297f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.998724 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd182d7cb414f07944072b0c00ee35c (DEFAULT_TABLE table=default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b [id=48d90d1ed51f4b18b9ad5a1b7fc3cde4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:49.999132 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd182d7cb414f07944072b0c00ee35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:49.999982 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b" } modify_external_catalogs: true
I20260927 13:49:50.000190 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b" } modify_external_catalogs: true
I20260927 13:49:50.002255 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8bf79954c2429f886ac7afc9a8455f (DEFAULT_TABLE table=default.Table_7d190d6d35774a4f9f8ca7efceb00954 [id=8ac45fbdc31b499b9f246f5a1167281a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.004364 5319 leader_election.cc:343] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 0018704e08254c2e8d30c7067df4420c
I20260927 13:49:50.004534 5319 leader_election.cc:304] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:50.005226 6145 raft_consensus.cc:2749] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:50.005872 5045 leader_election.cc:304] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:50.007969 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet d1f9ae430c414cdf9370388d51dd7c63
I20260927 13:49:50.008039 5623 ts_tablet_manager.cc:1929] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.008189 5623 log.cc:1199] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/195ce37d4abf4b92af22b46654b86ba5
I20260927 13:49:50.008890 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet d1f9ae430c414cdf9370388d51dd7c63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.008872 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_53d78eb35ded40078e11e532d5ed0d25" } new_table_name: "default.Table_25e6e013310e4ba18a969df5b8ae3901" modify_external_catalogs: true
I20260927 13:49:50.009708 5606 ts_tablet_manager.cc:1929] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.009958 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 (DEFAULT_TABLE table=default.Table_1644e061770e4453a64e74d48c0cd703 [id=ee0789e9d1f34c3791d35794473e2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.010388 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.010422 5623 ts_tablet_manager.cc:1950] T 195ce37d4abf4b92af22b46654b86ba5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:50.010473 5606 log.cc:1199] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/dce1bbbe9dbb443c9f0c001107ffebdf
I20260927 13:49:50.010919 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet d1f9ae430c414cdf9370388d51dd7c63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:50.011559 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 195ce37d4abf4b92af22b46654b86ba5 (table default.Table_34e3d06c06ed4b90b3444e8c803d2e07 [id=ce8690509c5c4110bf5dd62244aceb46]) successfully deleted
I20260927 13:49:50.012866 5623 tablet_replica.cc:333] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:50.013070 5623 raft_consensus.cc:2243] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:50.013095 5606 ts_tablet_manager.cc:1950] T dce1bbbe9dbb443c9f0c001107ffebdf P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:50.013373 5623 pending_rounds.cc:70] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:50.013441 5623 pending_rounds.cc:77] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957589905575936 op_type: NO_OP noop_request { }
I20260927 13:49:50.013588 5623 raft_consensus.cc:2889] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:50.013700 5623 raft_consensus.cc:2272] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.008136 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 3700a1f40c0644848da62392cb0c297f (DEFAULT_TABLE table=default.Table_22a8a2d3c05d409480ef5c85b521fa0d [id=9982cd84b23842e89881d5ba772f6b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.014914 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3700a1f40c0644848da62392cb0c297f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.015062 6127 raft_consensus.cc:2749] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:50.016291 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60de1c28618f4e478aae68ad07fbcf98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.020474 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 794da0992403462dbbce644134b8aab3 (DEFAULT_TABLE table=default.Table_e11854abc7164d67b4195185f22c8295 [id=49a148957d6b4260ab46333b2bc3ef5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.020884 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794da0992403462dbbce644134b8aab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.020807 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 794da0992403462dbbce644134b8aab3 (DEFAULT_TABLE table=default.Table_e11854abc7164d67b4195185f22c8295 [id=49a148957d6b4260ab46333b2bc3ef5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.021186 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794da0992403462dbbce644134b8aab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.021286 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 0361e3b244a1437b8e402dd8602528fe (DEFAULT_TABLE table=default.Table_268838ff93954800813c2850f8dbef43 [id=393d91e6e8194f008d5ef165bcfb6b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.021705 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0361e3b244a1437b8e402dd8602528fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.024791 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 0361e3b244a1437b8e402dd8602528fe (DEFAULT_TABLE table=default.Table_268838ff93954800813c2850f8dbef43 [id=393d91e6e8194f008d5ef165bcfb6b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.025206 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0361e3b244a1437b8e402dd8602528fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.027252 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 (DEFAULT_TABLE table=default.Table_1644e061770e4453a64e74d48c0cd703 [id=ee0789e9d1f34c3791d35794473e2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.027642 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.031574 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8bf79954c2429f886ac7afc9a8455f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.032667 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 730cd78c7b1a49d892a5ecb46fae0812 (DEFAULT_TABLE table=default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.033039 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730cd78c7b1a49d892a5ecb46fae0812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.034658 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet fa9d09ca7952499ba135e15cecb1143e with delete_type TABLET_DATA_DELETED (replaced by tablet 4211f338c6a648c5b3e36c6df0b3c510) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.034677 5628 raft_consensus.cc:359] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:50.035101 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 2e30216e0487496f8efdb8a3b06deb5a (DEFAULT_TABLE table=default.Table_0dc6b57a88cc433c8130f52ee6622be2 [id=4997d0b27b0240959549e68dda2f9958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.035516 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e30216e0487496f8efdb8a3b06deb5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.036538 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 06c810fde988439c97a8445fc88626b3 (DEFAULT_TABLE table=default.Table_2bf1c8729308443bba92997d06f84e9e [id=861ae0d96dd54f1dac15e3cce0ed657a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.037463 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 559ac90ef36d406881dc17ade0560044 with delete_type TABLET_DATA_DELETED (replaced by tablet 3afb800e7ff44aadaed8f8d85aa9efe2) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.039863 4929 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 9faf945b7752453eb32ff1ea8b9b30e0
I20260927 13:49:50.043218 5623 ts_tablet_manager.cc:1916] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.043928 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4042d06190ea4013bd48e6ffaa0aff6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.044525 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4042d06190ea4013bd48e6ffaa0aff6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.046445 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c810fde988439c97a8445fc88626b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.047197 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 3700a1f40c0644848da62392cb0c297f (DEFAULT_TABLE table=default.Table_22a8a2d3c05d409480ef5c85b521fa0d [id=9982cd84b23842e89881d5ba772f6b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.049360 5078 tablet_service.cc:1511] Processing CreateTablet for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 (DEFAULT_TABLE table=default.Table_1644e061770e4453a64e74d48c0cd703 [id=ee0789e9d1f34c3791d35794473e2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.049906 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 730cd78c7b1a49d892a5ecb46fae0812 (DEFAULT_TABLE table=default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.050735 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 0361e3b244a1437b8e402dd8602528fe (DEFAULT_TABLE table=default.Table_268838ff93954800813c2850f8dbef43 [id=393d91e6e8194f008d5ef165bcfb6b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.051751 5085 tablet_service.cc:1558] Processing DeleteTablet for tablet d1f9ae430c414cdf9370388d51dd7c63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.053309 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet dce1bbbe9dbb443c9f0c001107ffebdf (table default.Table_62b8129916de4fdeaddae3de476de360 [id=f6be2f3e0bb749108e056578f8d3cd75]) successfully deleted
W20260927 13:49:50.054327 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 85805d532ffa4c79974ce25041a72205 because the tablet was not found. No further retry: Not found: Tablet not found: 85805d532ffa4c79974ce25041a72205
I20260927 13:49:50.054919 5606 tablet_replica.cc:333] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:50.055449 5606 raft_consensus.cc:2243] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:50.056430 5606 pending_rounds.cc:70] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:50.056623 5625 ts_tablet_manager.cc:1929] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.056926 5625 log.cc:1199] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/8e959f8c6fa74a1bbaf06d91c3e484bc
I20260927 13:49:50.059939 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_55aa0cde9170428d848330642e3b171e" } modify_external_catalogs: true
I20260927 13:49:50.060149 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_55aa0cde9170428d848330642e3b171e" } modify_external_catalogs: true
I20260927 13:49:50.060575 5628 raft_consensus.cc:385] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.060745 5628 raft_consensus.cc:740] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.062247 5084 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd182d7cb414f07944072b0c00ee35c (DEFAULT_TABLE table=default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b [id=48d90d1ed51f4b18b9ad5a1b7fc3cde4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.062846 4915 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 60de1c28618f4e478aae68ad07fbcf98 (table default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 60de1c28618f4e478aae68ad07fbcf98 consensus state has no leader
I20260927 13:49:50.065052 5623 ts_tablet_manager.cc:1929] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:50.065208 5623 log.cc:1199] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/dce1bbbe9dbb443c9f0c001107ffebdf
I20260927 13:49:50.065639 5623 ts_tablet_manager.cc:1950] T dce1bbbe9dbb443c9f0c001107ffebdf P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:50.068297 5619 tablet_bootstrap.cc:492] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:50.074882 5619 ts_tablet_manager.cc:1403] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.177s user 0.007s sys 0.000s
I20260927 13:49:50.076557 5619 raft_consensus.cc:359] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.076979 5619 raft_consensus.cc:385] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.077195 5619 raft_consensus.cc:740] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.077553 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet dce1bbbe9dbb443c9f0c001107ffebdf (table default.Table_62b8129916de4fdeaddae3de476de360 [id=f6be2f3e0bb749108e056578f8d3cd75]) successfully deleted
I20260927 13:49:50.077735 5619 consensus_queue.cc:260] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.077992 5623 tablet_replica.cc:333] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:50.078279 5623 raft_consensus.cc:2243] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.078486 5623 raft_consensus.cc:2272] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.080464 5619 ts_tablet_manager.cc:1434] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:50.081215 5619 tablet_bootstrap.cc:492] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:50.085247 5606 pending_rounds.cc:77] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957590496190464 op_type: NO_OP noop_request { }
I20260927 13:49:50.085549 5606 raft_consensus.cc:2889] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:50.085824 5606 raft_consensus.cc:2272] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.086673 5623 ts_tablet_manager.cc:1916] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.089068 6094 consensus_queue.cc:1048] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:50.095423 5606 ts_tablet_manager.cc:1916] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.099807 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_42da0aba47fb44198e367fab1533d338"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.100517 5625 ts_tablet_manager.cc:1950] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:50.100522 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42da0aba47fb44198e367fab1533d338 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.101831 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 8e959f8c6fa74a1bbaf06d91c3e484bc (table default.Table_3ab0995080774a95967ee1d1ce7c9fdf [id=4dfd5d250a6f4ccd87ae40d6b0061394]) successfully deleted
W20260927 13:49:50.102124 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet f3e0e8d6bc744d69a9f41d45459d3b2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3e0e8d6bc744d69a9f41d45459d3b2b already in progress: creating tablet
I20260927 13:49:50.102432 5625 tablet_replica.cc:333] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:50.103096 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3700a1f40c0644848da62392cb0c297f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.104000 5625 raft_consensus.cc:2243] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.103825 5619 tablet_bootstrap.cc:654] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.104246 5625 raft_consensus.cc:2272] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.102700 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 794da0992403462dbbce644134b8aab3 (DEFAULT_TABLE table=default.Table_e11854abc7164d67b4195185f22c8295 [id=49a148957d6b4260ab46333b2bc3ef5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.104467 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd182d7cb414f07944072b0c00ee35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.104903 5623 ts_tablet_manager.cc:1929] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.105052 5623 log.cc:1199] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/7a4b7500f05e4b63b4d79fabde88ebe6
I20260927 13:49:50.105337 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0361e3b244a1437b8e402dd8602528fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.105409 5623 ts_tablet_manager.cc:1950] T 7a4b7500f05e4b63b4d79fabde88ebe6 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:50.106493 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 7a4b7500f05e4b63b4d79fabde88ebe6 (table default.Table_88c5377676df4e3fb778d2781ed7a546 [id=36caa6d3649b47efb7e95cab54ca2608]) successfully deleted
I20260927 13:49:50.102936 5628 consensus_queue.cc:260] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:50.110777 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.111510 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794da0992403462dbbce644134b8aab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.112682 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730cd78c7b1a49d892a5ecb46fae0812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.114984 5628 ts_tablet_manager.cc:1434] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.121s user 0.002s sys 0.001s
I20260927 13:49:50.115242 5623 tablet_replica.cc:333] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:50.115670 5623 raft_consensus.cc:2243] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.115878 5625 ts_tablet_manager.cc:1916] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.116245 5623 raft_consensus.cc:2272] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.117415 5628 tablet_bootstrap.cc:492] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:50.118032 5623 ts_tablet_manager.cc:1916] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.120645 5606 ts_tablet_manager.cc:1929] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:50.120790 5606 log.cc:1199] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/d9b04383cb494f65be7ba507a0f0b441
W20260927 13:49:50.121225 5183 connection.cc:573] client connection to 127.4.163.125:42239 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:49:50.121569 5318 connection.cc:573] client connection to 127.4.163.125:42239 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:49:50.128834 4915 connection.cc:573] client connection to 127.4.163.125:42239 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:49:50.129029 4915 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 10 similar messages]
I20260927 13:49:50.129345 4896 master_runner.cc:187] Error getting master registration for 127.4.163.125:42239: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107),
I20260927 13:49:50.129532 4896 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260927 13:49:50.129702 5606 ts_tablet_manager.cc:1950] T d9b04383cb494f65be7ba507a0f0b441 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:49:50.129981 5043 connection.cc:573] client connection to 127.4.163.125:42239 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:49:50.131641 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7011125c78084deca83b1570d1c2d704 consensus state has no leader
I20260927 13:49:50.133730 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet d9b04383cb494f65be7ba507a0f0b441 (table default.Table_f2d64a3ffe674d5ebbab910acdf51b20 [id=d30e7ed235504af3a53544c14e35b456]) successfully deleted
I20260927 13:49:50.134537 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet c7670d5f54df49f4a074588ab9269145 with delete_type TABLET_DATA_DELETED (replaced by tablet 1245334728994a60ad641c2e90f8d2df) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:50.135105 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ecc55f056cc941b8aa8dca7116d366bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.135774 5606 tablet_replica.cc:333] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:50.136082 5606 raft_consensus.cc:2243] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:50.136118 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecc55f056cc941b8aa8dca7116d366bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.136292 5606 raft_consensus.cc:2272] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.137957 5626 tablet_bootstrap.cc:492] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:50.138178 5626 ts_tablet_manager.cc:1403] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.198s user 0.010s sys 0.013s
I20260927 13:49:50.139103 5626 raft_consensus.cc:359] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.139408 5626 raft_consensus.cc:385] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.139555 5626 raft_consensus.cc:740] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.139917 5626 consensus_queue.cc:260] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.142210 5626 ts_tablet_manager.cc:1434] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:50.142786 5626 tablet_bootstrap.cc:492] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:50.145356 5626 tablet_bootstrap.cc:654] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.151930 4927 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 5ff575db41bf4ba9846b94502391dc60
I20260927 13:49:50.153280 5619 tablet_bootstrap.cc:492] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:50.153430 5619 ts_tablet_manager.cc:1403] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.072s user 0.010s sys 0.000s
I20260927 13:49:50.153749 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_393b924b35284f7ab739c7df3b388bf3" } new_table_name: "default.Table_cf1d80366a7743b3b4fea68ea5246139" modify_external_catalogs: true
I20260927 13:49:50.155611 5619 raft_consensus.cc:359] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.155807 5619 raft_consensus.cc:385] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.155891 5619 raft_consensus.cc:740] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.156287 5619 consensus_queue.cc:260] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.169273 5606 ts_tablet_manager.cc:1916] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.174175 5619 ts_tablet_manager.cc:1434] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260927 13:49:50.176254 5619 tablet_bootstrap.cc:492] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:50.177831 5619 tablet_bootstrap.cc:654] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.178944 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f0f1b6b8e509487daa886cd3ad6645f7" } new_table_name: "default.Table_f1bd6c5f7d1c40e4b4898befde87e9a0" modify_external_catalogs: true
I20260927 13:49:50.152561 6094 consensus_queue.cc:1048] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:50.166651 5623 ts_tablet_manager.cc:1929] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.182650 5623 log.cc:1199] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/a3b1d54e4af0432f9d1ef9879d2ec4e9
I20260927 13:49:50.166874 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 2efee56b495340baa6dd51f0f3e2aaa7 with delete_type TABLET_DATA_DELETED (replaced by tablet 5e3fa4870d5547a2bbffe1745b964504) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.182744 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7ac056af78a84ab9b807aaed0fcf7c6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.183156 5623 ts_tablet_manager.cc:1950] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
W20260927 13:49:50.183384 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ac056af78a84ab9b807aaed0fcf7c6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.184538 5623 tablet_replica.cc:333] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:50.184646 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 (table default.Table_87c2ff7de94d4663aebf61e88f2d5080 [id=c4c8708f397345919b0e8b06ab47b367]) successfully deleted
I20260927 13:49:50.184777 5623 raft_consensus.cc:2243] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.184955 5623 raft_consensus.cc:2272] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.185734 5623 ts_tablet_manager.cc:1916] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:50.189851 4915 consensus_peers.cc:597] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de -> Peer e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239): Couldn't send request to peer e421351a34d1463e9773dcebdeebae3c. Status: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260927 13:49:50.190212 6152 negotiation.cc:336] Failed RPC negotiation. Trace:
0927 13:49:50.122982 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.4.163.125:42239 (local address 127.4.163.66:47407)
0927 13:49:50.165980 (+ 42998us) negotiation.cc:107] Waiting for socket to connect
0927 13:49:50.166096 (+ 116us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":42827,"threads_started":1}
I20260927 13:49:50.195631 5623 ts_tablet_manager.cc:1929] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.197932 5623 log.cc:1199] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b0fd6fb92eb64e948e67f70c512376e2
I20260927 13:49:50.198454 5623 ts_tablet_manager.cc:1950] T b0fd6fb92eb64e948e67f70c512376e2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:50.199781 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b0fd6fb92eb64e948e67f70c512376e2 (table default.Table_f3005f35fe3f408bac8f54c5a509d4ad [id=aa02060d09be44a7ad563c010ba2b274]) successfully deleted
I20260927 13:49:50.202713 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 9bd182d7cb414f07944072b0c00ee35c
I20260927 13:49:50.204437 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bd182d7cb414f07944072b0c00ee35c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.205024 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bd182d7cb414f07944072b0c00ee35c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.206681 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bd182d7cb414f07944072b0c00ee35c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:50.211685 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet fa9d09ca7952499ba135e15cecb1143e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa9d09ca7952499ba135e15cecb1143e already in progress: creating tablet
W20260927 13:49:50.213557 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 559ac90ef36d406881dc17ade0560044 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 559ac90ef36d406881dc17ade0560044 already in progress: creating tablet
W20260927 13:49:50.225463 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet d1f9ae430c414cdf9370388d51dd7c63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1f9ae430c414cdf9370388d51dd7c63 already in progress: creating tablet
I20260927 13:49:50.226861 5623 tablet_replica.cc:333] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:50.227519 5625 ts_tablet_manager.cc:1929] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 13:49:50.227734 5625 log.cc:1199] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/d6c46d0e50a44232a82d00c88d9f63b5
I20260927 13:49:50.228300 5625 ts_tablet_manager.cc:1950] T d6c46d0e50a44232a82d00c88d9f63b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:50.231041 5628 tablet_bootstrap.cc:654] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.239166 5619 tablet_bootstrap.cc:492] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:50.239380 5619 ts_tablet_manager.cc:1403] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.063s user 0.000s sys 0.012s
I20260927 13:49:50.240221 5619 raft_consensus.cc:359] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.240437 5619 raft_consensus.cc:385] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.240496 5619 raft_consensus.cc:740] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.241122 5625 tablet_replica.cc:333] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:50.241396 5625 raft_consensus.cc:2243] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.241662 5625 raft_consensus.cc:2272] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.242450 5625 ts_tablet_manager.cc:1916] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.246799 5619 consensus_queue.cc:260] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.249625 5619 ts_tablet_manager.cc:1434] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20260927 13:49:50.253656 5619 tablet_bootstrap.cc:492] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:50.254076 5623 raft_consensus.cc:2243] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.257208 5623 raft_consensus.cc:2272] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.258548 5606 ts_tablet_manager.cc:1929] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.258677 5606 log.cc:1199] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/0018704e08254c2e8d30c7067df4420c
I20260927 13:49:50.258991 5606 ts_tablet_manager.cc:1950] T 0018704e08254c2e8d30c7067df4420c P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:50.259931 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 0018704e08254c2e8d30c7067df4420c (table default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
I20260927 13:49:50.263720 5623 ts_tablet_manager.cc:1916] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.269842 5619 tablet_bootstrap.cc:654] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.270184 6127 raft_consensus.cc:493] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:50.270394 6127 raft_consensus.cc:515] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.271209 6127 leader_election.cc:290] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:50.272225 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817fb4caf6a445b899830c6702bf911" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:50.272455 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817fb4caf6a445b899830c6702bf911" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:50.273063 5044 leader_election.cc:343] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:50.273226 5045 leader_election.cc:343] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:50.273418 5045 leader_election.cc:304] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:50.274073 6127 raft_consensus.cc:2749] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:50.275988 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_29868ee7e5ee42a78f9361cfba0334e4" } new_table_name: "default.Table_7fc8723712af4fb6bd672c3120727014" modify_external_catalogs: true
I20260927 13:49:50.277917 5628 tablet_bootstrap.cc:492] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:50.278065 5628 ts_tablet_manager.cc:1403] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.163s user 0.004s sys 0.008s
I20260927 13:49:50.282048 5628 raft_consensus.cc:359] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.282251 5628 raft_consensus.cc:385] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.282352 5628 raft_consensus.cc:740] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.283088 5619 tablet_bootstrap.cc:492] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:50.283069 5628 consensus_queue.cc:260] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.283259 5619 ts_tablet_manager.cc:1403] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.002s
W20260927 13:49:50.283519 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet d2e0b4c217ca41b98013155b8d952fe6 because the tablet was not found. No further retry: Not found: Tablet not found: d2e0b4c217ca41b98013155b8d952fe6
I20260927 13:49:50.283708 5628 ts_tablet_manager.cc:1434] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:50.284018 5628 tablet_bootstrap.cc:492] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:50.284017 5619 raft_consensus.cc:359] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.284710 5619 raft_consensus.cc:385] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.284821 5619 raft_consensus.cc:740] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.285091 5619 consensus_queue.cc:260] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:50.287192 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b3a305ad4c704bbd8d522515786100c0 consensus state has no leader
I20260927 13:49:50.288609 5606 tablet_replica.cc:333] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:50.288677 4928 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]). Expected version 1 got 0
I20260927 13:49:50.288779 5619 ts_tablet_manager.cc:1434] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260927 13:49:50.289455 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8442b904c41d4d39a56497c27763e7f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.290035 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8442b904c41d4d39a56497c27763e7f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.290351 5619 tablet_bootstrap.cc:492] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:50.291991 5606 raft_consensus.cc:2243] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.292186 5606 raft_consensus.cc:2272] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.292655 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet f70b70eb29cb4361a12ed393eabb82e1
I20260927 13:49:50.292718 5606 ts_tablet_manager.cc:1916] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.293330 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet b5cc71e06eb743d2b63e056e88a6498f from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:50.295099 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet f70b70eb29cb4361a12ed393eabb82e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:50.296609 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet f70b70eb29cb4361a12ed393eabb82e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.297067 5626 tablet_bootstrap.cc:492] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:50.297309 5626 ts_tablet_manager.cc:1403] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.155s user 0.009s sys 0.001s
I20260927 13:49:50.297324 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet f70b70eb29cb4361a12ed393eabb82e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.299976 6127 raft_consensus.cc:493] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:50.300143 6127 raft_consensus.cc:515] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.300750 6127 leader_election.cc:290] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:50.301066 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet 3b855dedb8d04145b0c4469b9ba79453 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:50.301481 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d35148d80b44fca9b39a4625d3e61c1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:50.302445 5044 leader_election.cc:343] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:50.302724 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 03a1f13b31934baa8ce18fc499e94806 consensus state has no leader
I20260927 13:49:50.303040 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d35148d80b44fca9b39a4625d3e61c1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:50.303457 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dae5f63f709f455b8eceb44771845a3f consensus state has no leader
W20260927 13:49:50.303624 5045 leader_election.cc:343] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:50.303752 5045 leader_election.cc:304] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:50.304193 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 6817fb4caf6a445b899830c6702bf911 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:50.304368 6127 raft_consensus.cc:2749] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:50.299765 5626 raft_consensus.cc:359] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.304768 5626 raft_consensus.cc:385] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.304886 5626 raft_consensus.cc:740] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.305248 5626 consensus_queue.cc:260] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.307651 5626 ts_tablet_manager.cc:1434] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260927 13:49:50.309515 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_009df0f55a87479eab602a85d1503bf9" } modify_external_catalogs: true
I20260927 13:49:50.309758 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_009df0f55a87479eab602a85d1503bf9" } modify_external_catalogs: true
I20260927 13:49:50.309820 5626 tablet_bootstrap.cc:492] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:50.310348 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f0ac9487c6b5426eaebbdbb92e46c3ea" } modify_external_catalogs: true
I20260927 13:49:50.310508 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f0ac9487c6b5426eaebbdbb92e46c3ea" } modify_external_catalogs: true
I20260927 13:49:50.311108 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet a7a97f4df3a84781bfcbdc768d518ef0 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:50.311434 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3c83565e14ba4bdf96fcfceb17acdff3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.311965 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c83565e14ba4bdf96fcfceb17acdff3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.312958 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_b22e5dfd0ffc497b87892eaf8b0c2fc1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.313252 5626 tablet_bootstrap.cc:654] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.313257 5619 tablet_bootstrap.cc:654] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:50.313453 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b22e5dfd0ffc497b87892eaf8b0c2fc1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.315796 5628 tablet_bootstrap.cc:654] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.316924 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet a8c1b74943b9479e8b37969b2933c5a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3933c0a2fd6547f28528fae7d443a2c1) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.320771 5626 tablet_bootstrap.cc:492] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
W20260927 13:49:50.321332 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 413d863d9a564e5d8325b4479346730d has no consensus state
I20260927 13:49:50.321517 5626 ts_tablet_manager.cc:1403] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.003s
I20260927 13:49:50.322286 5626 raft_consensus.cc:359] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:50.322541 5626 raft_consensus.cc:385] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.322654 5626 raft_consensus.cc:740] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.324299 5626 consensus_queue.cc:260] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:50.325795 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet 1245334728994a60ad641c2e90f8d2df from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:50.327109 5625 ts_tablet_manager.cc:1929] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:50.327260 5625 log.cc:1199] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a8c1b74943b9479e8b37969b2933c5a4
I20260927 13:49:50.327804 5626 ts_tablet_manager.cc:1434] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:49:50.328055 5619 tablet_bootstrap.cc:492] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:50.328277 5619 ts_tablet_manager.cc:1403] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260927 13:49:50.329128 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 0018704e08254c2e8d30c7067df4420c with delete_type TABLET_DATA_DELETED (replaced by tablet 059afd48ac4a41569ed1d3556b7974f0) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.329159 5619 raft_consensus.cc:359] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.329370 5619 raft_consensus.cc:385] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.329453 5619 raft_consensus.cc:740] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.329783 5619 consensus_queue.cc:260] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.330417 5619 ts_tablet_manager.cc:1434] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:50.331207 5626 tablet_bootstrap.cc:492] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:50.333621 5619 tablet_bootstrap.cc:492] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:50.335453 5626 tablet_bootstrap.cc:654] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.335721 5619 tablet_bootstrap.cc:654] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.338572 5606 ts_tablet_manager.cc:1929] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.338717 5606 log.cc:1199] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/77f549f487ea4dbb8c7fceee6f8a6db0
I20260927 13:49:50.339110 5606 ts_tablet_manager.cc:1950] T 77f549f487ea4dbb8c7fceee6f8a6db0 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:50.340281 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 77f549f487ea4dbb8c7fceee6f8a6db0 (table default.Table_db24dbfc253c4e76ab35b8bb7770eb8b [id=3b60feafc4a7467b8e301307adaa8187]) successfully deleted
I20260927 13:49:50.342588 5625 ts_tablet_manager.cc:1950] T a8c1b74943b9479e8b37969b2933c5a4 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:50.342801 5623 ts_tablet_manager.cc:1929] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.343051 5623 log.cc:1199] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/2efee56b495340baa6dd51f0f3e2aaa7
I20260927 13:49:50.346874 5625 tablet_replica.cc:333] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:50.347126 5625 raft_consensus.cc:2243] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.347102 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a8c1b74943b9479e8b37969b2933c5a4 (table default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]) successfully deleted
I20260927 13:49:50.347283 5625 raft_consensus.cc:2272] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.347716 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]). Expected version 1 got 0
I20260927 13:49:50.347844 5625 ts_tablet_manager.cc:1916] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.349639 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_298f6b42cb084ec7abaaea11e41d12b9" } new_table_name: "default.Table_c6bf40a827d4408d9436b87449f15866" modify_external_catalogs: true
I20260927 13:49:50.352850 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]). Expected version 1 got 0
I20260927 13:49:50.344905 5628 tablet_bootstrap.cc:492] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:50.354240 5628 ts_tablet_manager.cc:1403] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.070s user 0.001s sys 0.003s
I20260927 13:49:50.355420 5628 raft_consensus.cc:359] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:50.355597 5625 ts_tablet_manager.cc:1929] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.355952 5625 log.cc:1199] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/6817fb4caf6a445b899830c6702bf911
I20260927 13:49:50.358572 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]). Expected version 1 got 0
I20260927 13:49:50.358803 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b5cc71e06eb743d2b63e056e88a6498f (table default.Table_48a5fac9ec3d40c4a4b405f925a74326 [id=935f2e2df32c46e58760dba62709c181]). Expected version 1 got 0
I20260927 13:49:50.358950 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 825a73d47bff4246965be82eb482f7aa (table default.Table_de911651b6ff4188876ef1d412e041b7 [id=119de2adb4d24563b76c6099dec2d9a9]). Expected version 2 got 0
I20260927 13:49:50.360126 5223 tablet_service.cc:1511] Processing CreateTablet for tablet d0cf4234fa5e42469ba6b9bdee1e793f (DEFAULT_TABLE table=default.Table_8ad96efd2222495a89b4620b74fdc2e3 [id=6b95098ecd374cbf8614dc9197ffc0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.360627 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cf4234fa5e42469ba6b9bdee1e793f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.363467 5356 tablet_service.cc:1511] Processing CreateTablet for tablet d0cf4234fa5e42469ba6b9bdee1e793f (DEFAULT_TABLE table=default.Table_8ad96efd2222495a89b4620b74fdc2e3 [id=6b95098ecd374cbf8614dc9197ffc0b6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.365090 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b0fd6fb92eb64e948e67f70c512376e2 because the tablet was not found. No further retry: Not found: Tablet not found: b0fd6fb92eb64e948e67f70c512376e2
I20260927 13:49:50.365927 5619 tablet_bootstrap.cc:492] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:50.367594 5619 ts_tablet_manager.cc:1403] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260927 13:49:50.368788 5350 tablet_service.cc:1511] Processing CreateTablet for tablet a813939920244be781d546311fe8a33e (DEFAULT_TABLE table=default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.368731 5619 raft_consensus.cc:359] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.369004 5619 raft_consensus.cc:385] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.369129 5619 raft_consensus.cc:740] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.369413 5619 consensus_queue.cc:260] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.370158 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 0880140d99004eb1803d6b5dcf41af13 (DEFAULT_TABLE table=default.Table_8c3b2a8ae18e4aa0a1e71601ac62ea43 [id=4a7f10ca480d42bca8cd7d0e7fe8bd00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.371548 5606 tablet_replica.cc:333] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:50.371837 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 1245334728994a60ad641c2e90f8d2df
I20260927 13:49:50.371937 5619 ts_tablet_manager.cc:1434] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260927 13:49:50.372225 5606 raft_consensus.cc:2243] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:50.372296 4922 catalog_manager.cc:6934] ReplaceTablet: tablet 1245334728994a60ad641c2e90f8d2df deleted and replaced by tablet f46f45a0a13b4e05802a08880d7f6a01
I20260927 13:49:50.372642 5606 raft_consensus.cc:2272] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.375000 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a813939920244be781d546311fe8a33e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:50.375365 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec40378eb80c412198d5b66c02e975ef consensus state has no leader
I20260927 13:49:50.376400 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 3513663de6724b108adcb46cc151163c (DEFAULT_TABLE table=default.Table_dcdac8819c9b408fbef7c11fdd631090 [id=6b9a7948d0b34aa89f9f7c58a2cd2a0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.376807 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3513663de6724b108adcb46cc151163c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.378657 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cf4234fa5e42469ba6b9bdee1e793f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.380445 5360 tablet_service.cc:1558] Processing DeleteTablet for tablet 1245334728994a60ad641c2e90f8d2df with delete_type TABLET_DATA_DELETED (replaced by tablet f46f45a0a13b4e05802a08880d7f6a01) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:50.382905 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2f814bb9ff41ebab19e8c16cf4affa (DEFAULT_TABLE table=default.Table_e02f217077414076ab9e4f74fdd61b36 [id=578e09c772874fefab419fe01b8672b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.383288 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2f814bb9ff41ebab19e8c16cf4affa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.383822 6145 raft_consensus.cc:493] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:50.383996 6145 raft_consensus.cc:515] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.384696 6145 leader_election.cc:290] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:50.389295 4928 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]). Expected version 1 got 0
I20260927 13:49:50.389724 4928 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1cc174eab36b46fb8e276b3168fbfbcd (table default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe]). Expected version 3 got 0
I20260927 13:49:50.390393 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2ffaaab1360041dcb71d30bd031dda41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.390787 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4042d06190ea4013bd48e6ffaa0aff6b" } modify_external_catalogs: true
W20260927 13:49:50.390981 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ffaaab1360041dcb71d30bd031dda41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.390461 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f62fc7820ff54165afff30f8e47b56ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.391582 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f62fc7820ff54165afff30f8e47b56ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.390980 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4042d06190ea4013bd48e6ffaa0aff6b" } modify_external_catalogs: true
I20260927 13:49:50.396445 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 5e3fa4870d5547a2bbffe1745b964504
I20260927 13:49:50.397202 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet f75847513dcf4c84913a4073176f2507
I20260927 13:49:50.399989 5628 raft_consensus.cc:385] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.400149 5628 raft_consensus.cc:740] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.400486 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a7a97f4df3a84781bfcbdc768d518ef0
I20260927 13:49:50.400671 5628 consensus_queue.cc:260] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:50.401010 4926 catalog_manager.cc:6934] ReplaceTablet: tablet a7a97f4df3a84781bfcbdc768d518ef0 deleted and replaced by tablet b5a9f864e4274666a86baed43e1623cd
I20260927 13:49:50.401281 5628 ts_tablet_manager.cc:1434] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.047s user 0.002s sys 0.000s
I20260927 13:49:50.402603 5628 tablet_bootstrap.cc:492] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:50.402657 5623 ts_tablet_manager.cc:1950] T 2efee56b495340baa6dd51f0f3e2aaa7 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:50.407462 5078 tablet_service.cc:1511] Processing CreateTablet for tablet a813939920244be781d546311fe8a33e (DEFAULT_TABLE table=default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.408131 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a813939920244be781d546311fe8a33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.408815 5075 tablet_service.cc:1511] Processing CreateTablet for tablet d0cf4234fa5e42469ba6b9bdee1e793f (DEFAULT_TABLE table=default.Table_8ad96efd2222495a89b4620b74fdc2e3 [id=6b95098ecd374cbf8614dc9197ffc0b6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.408871 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 9bd182d7cb414f07944072b0c00ee35c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd182d7cb414f07944072b0c00ee35c already in progress: creating tablet
W20260927 13:49:50.409171 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet f70b70eb29cb4361a12ed393eabb82e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f70b70eb29cb4361a12ed393eabb82e1 already in progress: creating tablet
I20260927 13:49:50.409157 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 0880140d99004eb1803d6b5dcf41af13 (DEFAULT_TABLE table=default.Table_8c3b2a8ae18e4aa0a1e71601ac62ea43 [id=4a7f10ca480d42bca8cd7d0e7fe8bd00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.409464 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cf4234fa5e42469ba6b9bdee1e793f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.410354 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 0880140d99004eb1803d6b5dcf41af13 (DEFAULT_TABLE table=default.Table_8c3b2a8ae18e4aa0a1e71601ac62ea43 [id=4a7f10ca480d42bca8cd7d0e7fe8bd00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.412272 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 36181512a94c4702ae0a417665919faa (DEFAULT_TABLE table=default.Table_183efeacde2a430ba345a16786994e76 [id=ed3f5ac2c7fe4efeaa58e8a11100851b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.412668 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36181512a94c4702ae0a417665919faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.414302 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 3513663de6724b108adcb46cc151163c (DEFAULT_TABLE table=default.Table_dcdac8819c9b408fbef7c11fdd631090 [id=6b9a7948d0b34aa89f9f7c58a2cd2a0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.414652 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3513663de6724b108adcb46cc151163c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.415278 5226 tablet_service.cc:1558] Processing DeleteTablet for tablet a7a97f4df3a84781bfcbdc768d518ef0 with delete_type TABLET_DATA_DELETED (replaced by tablet b5a9f864e4274666a86baed43e1623cd) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.415351 5623 tablet_replica.cc:333] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:50.415452 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2f814bb9ff41ebab19e8c16cf4affa (DEFAULT_TABLE table=default.Table_e02f217077414076ab9e4f74fdd61b36 [id=578e09c772874fefab419fe01b8672b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.415561 5623 raft_consensus.cc:2243] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.415777 5623 raft_consensus.cc:2272] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.415896 5218 tablet_service.cc:1511] Processing CreateTablet for tablet a813939920244be781d546311fe8a33e (DEFAULT_TABLE table=default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.416575 5219 tablet_service.cc:1511] Processing CreateTablet for tablet 2b082227264e442a8b1db7a68fb0c3eb (DEFAULT_TABLE table=default.Table_967519598f9b4c999e93c6f358381116 [id=701057885bc4473193538947593d74e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.416613 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2f814bb9ff41ebab19e8c16cf4affa (DEFAULT_TABLE table=default.Table_e02f217077414076ab9e4f74fdd61b36 [id=578e09c772874fefab419fe01b8672b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.415975 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 3933c0a2fd6547f28528fae7d443a2c1 (DEFAULT_TABLE table=default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.416059 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0004ef0b2dd841ac860798d804374dc1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:50.417023 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 (DEFAULT_TABLE table=default.Table_b12c6e4211af4ab7b866815072339fe6 [id=3e30b8610f4c4406a115aaeee8abebdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.416222 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 3513663de6724b108adcb46cc151163c (DEFAULT_TABLE table=default.Table_dcdac8819c9b408fbef7c11fdd631090 [id=6b9a7948d0b34aa89f9f7c58a2cd2a0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.417313 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 (DEFAULT_TABLE table=default.Table_b12c6e4211af4ab7b866815072339fe6 [id=3e30b8610f4c4406a115aaeee8abebdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.416272 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 36181512a94c4702ae0a417665919faa (DEFAULT_TABLE table=default.Table_183efeacde2a430ba345a16786994e76 [id=ed3f5ac2c7fe4efeaa58e8a11100851b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.417402 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e3fa4870d5547a2bbffe1745b964504 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.417590 5225 tablet_service.cc:1558] Processing DeleteTablet for tablet f75847513dcf4c84913a4073176f2507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.416375 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0880140d99004eb1803d6b5dcf41af13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.417569 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 3933c0a2fd6547f28528fae7d443a2c1 (DEFAULT_TABLE table=default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.417835 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 2b082227264e442a8b1db7a68fb0c3eb (DEFAULT_TABLE table=default.Table_967519598f9b4c999e93c6f358381116 [id=701057885bc4473193538947593d74e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.416452 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 1245334728994a60ad641c2e90f8d2df with delete_type TABLET_DATA_DELETED (replaced by tablet f46f45a0a13b4e05802a08880d7f6a01) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.418023 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b082227264e442a8b1db7a68fb0c3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.418226 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36181512a94c4702ae0a417665919faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.418445 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2657276c4b2f43c1ad64a8c1fd58ada9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.418510 5076 tablet_service.cc:1511] Processing CreateTablet for tablet b57886cc11a2423983c2b7bac79150a0 (DEFAULT_TABLE table=default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.419031 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet 1245334728994a60ad641c2e90f8d2df with delete_type TABLET_DATA_DELETED (replaced by tablet f46f45a0a13b4e05802a08880d7f6a01) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.419226 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e3fa4870d5547a2bbffe1745b964504 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.419266 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3933c0a2fd6547f28528fae7d443a2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.420073 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0880140d99004eb1803d6b5dcf41af13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.420845 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet f75847513dcf4c84913a4073176f2507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.421155 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57886cc11a2423983c2b7bac79150a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.422227 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3513663de6724b108adcb46cc151163c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.422446 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2f814bb9ff41ebab19e8c16cf4affa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.426215 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3933c0a2fd6547f28528fae7d443a2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.426241 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a813939920244be781d546311fe8a33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.432976 5606 ts_tablet_manager.cc:1916] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.432910 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 36181512a94c4702ae0a417665919faa (DEFAULT_TABLE table=default.Table_183efeacde2a430ba345a16786994e76 [id=ed3f5ac2c7fe4efeaa58e8a11100851b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.433205 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 2b082227264e442a8b1db7a68fb0c3eb (DEFAULT_TABLE table=default.Table_967519598f9b4c999e93c6f358381116 [id=701057885bc4473193538947593d74e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.433902 5619 tablet_bootstrap.cc:492] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:50.434302 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0880140d99004eb1803d6b5dcf41af13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.434561 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet a7a97f4df3a84781bfcbdc768d518ef0 with delete_type TABLET_DATA_DELETED (replaced by tablet b5a9f864e4274666a86baed43e1623cd) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:50.435014 5319 leader_election.cc:343] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 0004ef0b2dd841ac860798d804374dc1
I20260927 13:49:50.435124 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2657276c4b2f43c1ad64a8c1fd58ada9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.435323 6145 raft_consensus.cc:493] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:50.436348 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2f814bb9ff41ebab19e8c16cf4affa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.437429 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b082227264e442a8b1db7a68fb0c3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.437479 5623 ts_tablet_manager.cc:1916] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.439878 5628 tablet_bootstrap.cc:654] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.445015 5223 tablet_service.cc:1511] Processing CreateTablet for tablet b57886cc11a2423983c2b7bac79150a0 (DEFAULT_TABLE table=default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.445881 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.447788 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_9fd82aceaf6d491facc37c309420e9ed" } modify_external_catalogs: true
I20260927 13:49:50.447997 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_9fd82aceaf6d491facc37c309420e9ed" } modify_external_catalogs: true
I20260927 13:49:50.445873 5626 tablet_bootstrap.cc:492] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:50.450026 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 (DEFAULT_TABLE table=default.Table_b12c6e4211af4ab7b866815072339fe6 [id=3e30b8610f4c4406a115aaeee8abebdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.451376 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet bc8f6354c1034814af3cc20df25ddb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:50.452131 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7a48c16d7a32465cbc86892633257ea3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.452332 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b082227264e442a8b1db7a68fb0c3eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:50.452709 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a48c16d7a32465cbc86892633257ea3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.453951 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afb800e7ff44aadaed8f8d85aa9efe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.455143 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 860aa52d44ad494594c73707e6ef98e2 (DEFAULT_TABLE table=default.Table_68a7db0e7ab24bd9b8e401ef348959ca [id=4f3cc928d2114af692215b91d4377656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.455163 5225 tablet_service.cc:1511] Processing CreateTablet for tablet bb25bb5ee153494d803130f1ad4f7c2e (DEFAULT_TABLE table=default.Table_cb8208423d374903b009adbf0c2cbe9d [id=7aabe4ef709d4722a07adc668a50b9de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.453598 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.457728 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 860aa52d44ad494594c73707e6ef98e2 (DEFAULT_TABLE table=default.Table_68a7db0e7ab24bd9b8e401ef348959ca [id=4f3cc928d2114af692215b91d4377656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.458305 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 3933c0a2fd6547f28528fae7d443a2c1 (DEFAULT_TABLE table=default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.459597 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 413d863d9a564e5d8325b4479346730d (DEFAULT_TABLE table=default.Table_7fc8723712af4fb6bd672c3120727014 [id=f03beab934924c65bd71d31d91c0f5cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.459944 5228 tablet_service.cc:1511] Processing CreateTablet for tablet 64c7919f5076406186000cd4077aadaf (DEFAULT_TABLE table=default.Table_6697aa5e44b143bd8c7c394f45b4ba7a [id=5dfc4daab06e4be5846fc9be88d222f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.460403 6145 raft_consensus.cc:515] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.460593 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57886cc11a2423983c2b7bac79150a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.461323 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c7919f5076406186000cd4077aadaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.461553 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e3fa4870d5547a2bbffe1745b964504 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:50.461664 5319 leader_election.cc:343] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:50.461778 5319 leader_election.cc:304] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:50.459324 5084 tablet_service.cc:1511] Processing CreateTablet for tablet bb25bb5ee153494d803130f1ad4f7c2e (DEFAULT_TABLE table=default.Table_cb8208423d374903b009adbf0c2cbe9d [id=7aabe4ef709d4722a07adc668a50b9de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.462459 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b5cc71e06eb743d2b63e056e88a6498f
I20260927 13:49:50.462455 5226 tablet_service.cc:1511] Processing CreateTablet for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 (DEFAULT_TABLE table=default.Table_88984f1568c54b4398964528d6e45861 [id=661c2995cafa41669d92b0b4549f0cce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.462931 4923 catalog_manager.cc:6934] ReplaceTablet: tablet b5cc71e06eb743d2b63e056e88a6498f deleted and replaced by tablet cbacda63c0d3427aabf3332b278576c5
I20260927 13:49:50.467757 5216 tablet_service.cc:1511] Processing CreateTablet for tablet 4211f338c6a648c5b3e36c6df0b3c510 (DEFAULT_TABLE table=default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.470268 4922 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 16e1edd884ea462eb41a9895319b5b60
I20260927 13:49:50.470330 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860aa52d44ad494594c73707e6ef98e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.470818 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 72711f14f26a479c9699b172b41b1db0
I20260927 13:49:50.474619 5220 tablet_service.cc:1511] Processing CreateTablet for tablet 52050d7e35dc4fbab3c7c079d07478e8 (DEFAULT_TABLE table=default.Table_8bd375289d574bfeba1cc363b93ad32f [id=77004a3da7944e7a9b9a4d2fa36021c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.476372 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet f75847513dcf4c84913a4073176f2507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:50.477741 6145 leader_election.cc:290] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:50.478619 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 413d863d9a564e5d8325b4479346730d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.478809 6145 raft_consensus.cc:2749] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:50.478983 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb25bb5ee153494d803130f1ad4f7c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.479238 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52050d7e35dc4fbab3c7c079d07478e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.479229 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36181512a94c4702ae0a417665919faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.479815 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.480419 5626 ts_tablet_manager.cc:1403] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.118s user 0.024s sys 0.038s
I20260927 13:49:50.480862 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860aa52d44ad494594c73707e6ef98e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.481081 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3933c0a2fd6547f28528fae7d443a2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.481362 5626 raft_consensus.cc:359] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.481578 5626 raft_consensus.cc:385] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.481657 5626 raft_consensus.cc:740] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.481978 5626 consensus_queue.cc:260] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.483755 5626 ts_tablet_manager.cc:1434] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:50.484083 5626 tablet_bootstrap.cc:492] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:50.485733 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2657276c4b2f43c1ad64a8c1fd58ada9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.487056 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet a7a97f4df3a84781bfcbdc768d518ef0 with delete_type TABLET_DATA_DELETED (replaced by tablet b5a9f864e4274666a86baed43e1623cd) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:50.488561 5088 tablet_service.cc:1511] Processing CreateTablet for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 (DEFAULT_TABLE table=default.Table_88984f1568c54b4398964528d6e45861 [id=661c2995cafa41669d92b0b4549f0cce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.490808 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb25bb5ee153494d803130f1ad4f7c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.491112 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.491266 5085 tablet_service.cc:1511] Processing CreateTablet for tablet 64c7919f5076406186000cd4077aadaf (DEFAULT_TABLE table=default.Table_6697aa5e44b143bd8c7c394f45b4ba7a [id=5dfc4daab06e4be5846fc9be88d222f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.491683 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c7919f5076406186000cd4077aadaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.493813 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afb800e7ff44aadaed8f8d85aa9efe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.495172 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d" } new_table_name: "default.Table_e60c3a05c2a7437db426cc486086ff0a" modify_external_catalogs: true
I20260927 13:49:50.495714 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7ac056af78a84ab9b807aaed0fcf7c6a" } modify_external_catalogs: true
I20260927 13:49:50.495939 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7ac056af78a84ab9b807aaed0fcf7c6a" } modify_external_catalogs: true
I20260927 13:49:50.496186 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_114b4e4e5a834c1bb0468e42edf6cb6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.496775 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_114b4e4e5a834c1bb0468e42edf6cb6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.498903 5350 tablet_service.cc:1511] Processing CreateTablet for tablet b57886cc11a2423983c2b7bac79150a0 (DEFAULT_TABLE table=default.Table_fe692db7c30e4c4eb14c8bd5c748bd1d [id=c2bdd45c34a24472b95b237d46efe194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.499693 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57886cc11a2423983c2b7bac79150a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.500309 5355 tablet_service.cc:1511] Processing CreateTablet for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.500691 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afb800e7ff44aadaed8f8d85aa9efe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.500577 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_48319d13c4f549a7997788187d90c91b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.500638 5359 tablet_service.cc:1511] Processing CreateTablet for tablet bb25bb5ee153494d803130f1ad4f7c2e (DEFAULT_TABLE table=default.Table_cb8208423d374903b009adbf0c2cbe9d [id=7aabe4ef709d4722a07adc668a50b9de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.501070 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb25bb5ee153494d803130f1ad4f7c2e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:50.501147 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48319d13c4f549a7997788187d90c91b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.502209 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 860aa52d44ad494594c73707e6ef98e2 (DEFAULT_TABLE table=default.Table_68a7db0e7ab24bd9b8e401ef348959ca [id=4f3cc928d2114af692215b91d4377656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.502542 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860aa52d44ad494594c73707e6ef98e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.502542 5364 tablet_service.cc:1511] Processing CreateTablet for tablet 4211f338c6a648c5b3e36c6df0b3c510 (DEFAULT_TABLE table=default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.502828 5354 tablet_service.cc:1511] Processing CreateTablet for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 (DEFAULT_TABLE table=default.Table_88984f1568c54b4398964528d6e45861 [id=661c2995cafa41669d92b0b4549f0cce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.502985 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4211f338c6a648c5b3e36c6df0b3c510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.503192 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.503974 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 413d863d9a564e5d8325b4479346730d (DEFAULT_TABLE table=default.Table_7fc8723712af4fb6bd672c3120727014 [id=f03beab934924c65bd71d31d91c0f5cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.504351 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 413d863d9a564e5d8325b4479346730d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.504297 5348 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc140bba42a43758fa0c6540d728275 (DEFAULT_TABLE table=default.Table_d19f692aecb1401a8f49d2595a038ce8 [id=b16ea2e5189e45a3a195694fdcd8d218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.504427 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 52050d7e35dc4fbab3c7c079d07478e8 (DEFAULT_TABLE table=default.Table_8bd375289d574bfeba1cc363b93ad32f [id=77004a3da7944e7a9b9a4d2fa36021c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.504774 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc140bba42a43758fa0c6540d728275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.504835 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 64c7919f5076406186000cd4077aadaf (DEFAULT_TABLE table=default.Table_6697aa5e44b143bd8c7c394f45b4ba7a [id=5dfc4daab06e4be5846fc9be88d222f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.504987 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52050d7e35dc4fbab3c7c079d07478e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.505198 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c7919f5076406186000cd4077aadaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.505990 5347 tablet_service.cc:1511] Processing CreateTablet for tablet f75847513dcf4c84913a4073176f2507 (DEFAULT_TABLE table=default.Table_f0ac9487c6b5426eaebbdbb92e46c3ea [id=505fcecda93b407f9f10ee4dbc60a3f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.506069 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 3a07adcd33414d18ae9720e7a307548a (DEFAULT_TABLE table=default.Table_c470b14844004302969f3c3a0802ace8 [id=0a8e61eac14b4098a290333fcc01204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.506590 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f75847513dcf4c84913a4073176f2507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.506793 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a07adcd33414d18ae9720e7a307548a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.506697 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8544e332ec664166b8e0096ab40a19d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.506821 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5c8ae4b5c0f54c9e8874b6a5633bd730" } new_table_name: "default.Table_16dc00b04267495ea0bf7b352b433889" modify_external_catalogs: true
W20260927 13:49:50.507233 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8544e332ec664166b8e0096ab40a19d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.508368 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_add07d0ee556457283038281d97f840b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.508849 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_add07d0ee556457283038281d97f840b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.510015 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7d190d6d35774a4f9f8ca7efceb00954" } new_table_name: "default.Table_ca51e0504d9b40158ce597c8d0d12830" modify_external_catalogs: true
I20260927 13:49:50.510293 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4211f338c6a648c5b3e36c6df0b3c510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.513299 5606 ts_tablet_manager.cc:1929] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:50.513476 5606 log.cc:1199] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/a8c1b74943b9479e8b37969b2933c5a4
I20260927 13:49:50.513913 5606 ts_tablet_manager.cc:1950] T a8c1b74943b9479e8b37969b2933c5a4 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:50.515076 5606 tablet_replica.cc:333] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:50.515367 5606 raft_consensus.cc:2243] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.517539 5606 raft_consensus.cc:2272] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.518160 5606 ts_tablet_manager.cc:1916] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.520918 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 0d54e51b5c104c75b938aba55cecf890 (DEFAULT_TABLE table=default.Table_00a670601e1d4a509989647bb84ca8cd [id=0c14f160c8ab4321b14a35fc5f8d3b56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.521314 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d54e51b5c104c75b938aba55cecf890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.509765 5211 tablet_service.cc:1511] Processing CreateTablet for tablet f75847513dcf4c84913a4073176f2507 (DEFAULT_TABLE table=default.Table_f0ac9487c6b5426eaebbdbb92e46c3ea [id=505fcecda93b407f9f10ee4dbc60a3f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.523278 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc140bba42a43758fa0c6540d728275 (DEFAULT_TABLE table=default.Table_d19f692aecb1401a8f49d2595a038ce8 [id=b16ea2e5189e45a3a195694fdcd8d218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.524986 5619 tablet_bootstrap.cc:654] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.524976 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_daa900fd6e014a39b47ad6cba895d79f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.525575 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daa900fd6e014a39b47ad6cba895d79f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.527688 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 51e1acd618fc44be9169fa1d56fa510a (DEFAULT_TABLE table=default.Table_73693476f4564e2e8e0f60b0f7e3d474 [id=90f057f5064842a19916355825eb7129]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.533946 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_444ab715a6674d1d9088f289fbb20fb6" } new_table_name: "default.Table_3d333d5b90954af4a67360576d58d113" modify_external_catalogs: true
I20260927 13:49:50.539155 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet a8c1b74943b9479e8b37969b2933c5a4 (table default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]) successfully deleted
I20260927 13:49:50.541083 6127 raft_consensus.cc:493] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:50.543285 5782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "802b83f09d3445359cfac825cd87c9de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:50.543708 5782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: This master's current role is: LEADER
I20260927 13:49:50.547932 5625 ts_tablet_manager.cc:1950] T 6817fb4caf6a445b899830c6702bf911 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:50.551154 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b57886cc11a2423983c2b7bac79150a0 consensus state has no leader
I20260927 13:49:50.551687 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_12c2d12d8eda427d96a28d5d701aeb49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.552306 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3540d8e89c9c46c393a438ad3c0439b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.552451 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12c2d12d8eda427d96a28d5d701aeb49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:50.552830 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3540d8e89c9c46c393a438ad3c0439b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.553831 5218 tablet_service.cc:1511] Processing CreateTablet for tablet 0d54e51b5c104c75b938aba55cecf890 (DEFAULT_TABLE table=default.Table_00a670601e1d4a509989647bb84ca8cd [id=0c14f160c8ab4321b14a35fc5f8d3b56]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.554400 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8e8bf79954c2429f886ac7afc9a8455f consensus state has no leader
I20260927 13:49:50.557404 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc140bba42a43758fa0c6540d728275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.523677 5210 tablet_service.cc:1511] Processing CreateTablet for tablet 3a07adcd33414d18ae9720e7a307548a (DEFAULT_TABLE table=default.Table_c470b14844004302969f3c3a0802ace8 [id=0a8e61eac14b4098a290333fcc01204e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.561808 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 50bc839e0fc54839a5d06c176760f618 consensus state has no leader
I20260927 13:49:50.563393 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d54e51b5c104c75b938aba55cecf890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.531277 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet b5cc71e06eb743d2b63e056e88a6498f with delete_type TABLET_DATA_DELETED (replaced by tablet cbacda63c0d3427aabf3332b278576c5) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:50.527698 5351 tablet_service.cc:1511] Processing CreateTablet for tablet da75a470ec0c4ec9afa7c18a51cd7276 (DEFAULT_TABLE table=default.Table_ba9eecef03ec466b97eab6b3720b265b [id=77f35cbefeec4875839aadb06d0d0238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.567788 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 72711f14f26a479c9699b172b41b1db0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:50.568950 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 51e1acd618fc44be9169fa1d56fa510a (DEFAULT_TABLE table=default.Table_73693476f4564e2e8e0f60b0f7e3d474 [id=90f057f5064842a19916355825eb7129]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.569530 5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f75847513dcf4c84913a4073176f2507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.560360 6127 raft_consensus.cc:515] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:50.572921 5074 tablet_service.cc:1511] Processing CreateTablet for tablet 4211f338c6a648c5b3e36c6df0b3c510 (DEFAULT_TABLE table=default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.573444 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 111964us
I20260927 13:49:50.577147 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7fc8723712af4fb6bd672c3120727014" } new_table_name: "default.Table_fbec3d960eb2415280ee9b1e7171392a" modify_external_catalogs: true
I20260927 13:49:50.578893 5626 tablet_bootstrap.cc:654] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:50.574960 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 84d9c94ee0af46e8aea12adac57829f7 (DEFAULT_TABLE table=default.Table_7ac056af78a84ab9b807aaed0fcf7c6a [id=4d64253f01f048778ee2ff75d95535ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.580379 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4211f338c6a648c5b3e36c6df0b3c510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.581103 5210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a07adcd33414d18ae9720e7a307548a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.581753 6127 leader_election.cc:290] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:50.578140 5072 tablet_service.cc:1511] Processing CreateTablet for tablet 52050d7e35dc4fbab3c7c079d07478e8 (DEFAULT_TABLE table=default.Table_8bd375289d574bfeba1cc363b93ad32f [id=77004a3da7944e7a9b9a4d2fa36021c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.578264 5070 tablet_service.cc:1511] Processing CreateTablet for tablet f75847513dcf4c84913a4073176f2507 (DEFAULT_TABLE table=default.Table_f0ac9487c6b5426eaebbdbb92e46c3ea [id=505fcecda93b407f9f10ee4dbc60a3f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.582942 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a73d47bff4246965be82eb482f7aa" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:50.573300 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc140bba42a43758fa0c6540d728275 (DEFAULT_TABLE table=default.Table_d19f692aecb1401a8f49d2595a038ce8 [id=b16ea2e5189e45a3a195694fdcd8d218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.586596 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e1acd618fc44be9169fa1d56fa510a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.586948 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 3a07adcd33414d18ae9720e7a307548a (DEFAULT_TABLE table=default.Table_c470b14844004302969f3c3a0802ace8 [id=0a8e61eac14b4098a290333fcc01204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.588315 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a73d47bff4246965be82eb482f7aa" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:50.587143 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet b5cc71e06eb743d2b63e056e88a6498f with delete_type TABLET_DATA_DELETED (replaced by tablet cbacda63c0d3427aabf3332b278576c5) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.578593 5219 tablet_service.cc:1511] Processing CreateTablet for tablet da75a470ec0c4ec9afa7c18a51cd7276 (DEFAULT_TABLE table=default.Table_ba9eecef03ec466b97eab6b3720b265b [id=77f35cbefeec4875839aadb06d0d0238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.578344 5073 tablet_service.cc:1511] Processing CreateTablet for tablet 413d863d9a564e5d8325b4479346730d (DEFAULT_TABLE table=default.Table_7fc8723712af4fb6bd672c3120727014 [id=f03beab934924c65bd71d31d91c0f5cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.593822 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da75a470ec0c4ec9afa7c18a51cd7276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.596930 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 72711f14f26a479c9699b172b41b1db0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.598587 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet c7670d5f54df49f4a074588ab9269145 with delete_type TABLET_DATA_DELETED (replaced by tablet 1245334728994a60ad641c2e90f8d2df) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.598995 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 95726f690a71433ca63f95da4ee750e5 (DEFAULT_TABLE table=default.Table_b22e5dfd0ffc497b87892eaf8b0c2fc1 [id=95a6abdb5a6549af8eefae7eb121672e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.601162 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c470b14844004302969f3c3a0802ace8" } modify_external_catalogs: true
I20260927 13:49:50.601365 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c470b14844004302969f3c3a0802ace8" } modify_external_catalogs: true
I20260927 13:49:50.603401 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f1bd6c5f7d1c40e4b4898befde87e9a0" } modify_external_catalogs: true
I20260927 13:49:50.603567 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f1bd6c5f7d1c40e4b4898befde87e9a0" } modify_external_catalogs: true
I20260927 13:49:50.607757 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95726f690a71433ca63f95da4ee750e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:50.609130 5044 leader_election.cc:343] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:50.609417 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc140bba42a43758fa0c6540d728275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.614336 5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52050d7e35dc4fbab3c7c079d07478e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.615103 5623 ts_tablet_manager.cc:1929] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.615936 5625 tablet_replica.cc:333] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:50.615898 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5dfa3e80454463908df19a49454764 with delete_type TABLET_DATA_DELETED (replaced by tablet a813939920244be781d546311fe8a33e) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.617208 5625 raft_consensus.cc:2243] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.620386 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 0d54e51b5c104c75b938aba55cecf890 (DEFAULT_TABLE table=default.Table_00a670601e1d4a509989647bb84ca8cd [id=0c14f160c8ab4321b14a35fc5f8d3b56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.622211 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f75847513dcf4c84913a4073176f2507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.624612 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 51e1acd618fc44be9169fa1d56fa510a (DEFAULT_TABLE table=default.Table_73693476f4564e2e8e0f60b0f7e3d474 [id=90f057f5064842a19916355825eb7129]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.624845 5623 log.cc:1199] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/a8c1b74943b9479e8b37969b2933c5a4
I20260927 13:49:50.624910 5625 raft_consensus.cc:2272] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.625586 5625 ts_tablet_manager.cc:1916] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.627803 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a07adcd33414d18ae9720e7a307548a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:50.634828 5319 leader_election.cc:343] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 195ce37d4abf4b92af22b46654b86ba5
I20260927 13:49:50.638895 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 84d9c94ee0af46e8aea12adac57829f7
I20260927 13:49:50.642414 5623 ts_tablet_manager.cc:1950] T a8c1b74943b9479e8b37969b2933c5a4 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:50.644224 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet dae5f63f709f455b8eceb44771845a3f
W20260927 13:49:50.647835 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 413d863d9a564e5d8325b4479346730d consensus state has no leader
I20260927 13:49:50.648026 5228 tablet_service.cc:1511] Processing CreateTablet for tablet e26a3a50396940cf826442e4ba7356a8 (DEFAULT_TABLE table=default.Table_3c83565e14ba4bdf96fcfceb17acdff3 [id=5f94649e22074c50b31b2156366e8993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.648209 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 3a07adcd33414d18ae9720e7a307548a
W20260927 13:49:50.649384 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17153df5ba20458aa0a5c0297e959810 consensus state has no leader
I20260927 13:49:50.650346 6127 raft_consensus.cc:493] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:50.650528 6127 raft_consensus.cc:515] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.654678 5623 tablet_replica.cc:333] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:50.656383 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26a3a50396940cf826442e4ba7356a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.659528 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d54e51b5c104c75b938aba55cecf890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.661794 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 84d9c94ee0af46e8aea12adac57829f7 (DEFAULT_TABLE table=default.Table_7ac056af78a84ab9b807aaed0fcf7c6a [id=4d64253f01f048778ee2ff75d95535ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.663543 5623 raft_consensus.cc:2243] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:50.663805 5079 tablet_service.cc:1511] Processing CreateTablet for tablet da75a470ec0c4ec9afa7c18a51cd7276 (DEFAULT_TABLE table=default.Table_ba9eecef03ec466b97eab6b3720b265b [id=77f35cbefeec4875839aadb06d0d0238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.667220 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da75a470ec0c4ec9afa7c18a51cd7276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.670864 6127 leader_election.cc:290] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:50.672609 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet b5cc71e06eb743d2b63e056e88a6498f with delete_type TABLET_DATA_DELETED (replaced by tablet cbacda63c0d3427aabf3332b278576c5) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.673269 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 95726f690a71433ca63f95da4ee750e5 (DEFAULT_TABLE table=default.Table_b22e5dfd0ffc497b87892eaf8b0c2fc1 [id=95a6abdb5a6549af8eefae7eb121672e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.673705 5623 raft_consensus.cc:2272] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.674638 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet 72711f14f26a479c9699b172b41b1db0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.677354 5084 tablet_service.cc:1511] Processing CreateTablet for tablet e26a3a50396940cf826442e4ba7356a8 (DEFAULT_TABLE table=default.Table_3c83565e14ba4bdf96fcfceb17acdff3 [id=5f94649e22074c50b31b2156366e8993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.678823 5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 413d863d9a564e5d8325b4479346730d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.680840 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2f83c545334d4bc995f6afb456fb190b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.681525 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f83c545334d4bc995f6afb456fb190b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.684458 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c35f0f666c6d4a5ca35fbe71a9d02c70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.684973 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c35f0f666c6d4a5ca35fbe71a9d02c70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.689551 4749 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
/tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.125:42239
--webserver_interface=127.4.163.125
--webserver_port=43209
--builtin_ntp_servers=127.4.163.84:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260927 13:49:50.705212 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8f56db43a65c4bd5a295fc1966c944a2" } modify_external_catalogs: true
I20260927 13:49:50.705649 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8f56db43a65c4bd5a295fc1966c944a2" } modify_external_catalogs: true
I20260927 13:49:50.706024 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6af740383384609a354d7f0fae2cd70" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:50.707091 6165 raft_consensus.cc:493] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:50.707238 6165 raft_consensus.cc:515] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.707388 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c6bf40a827d4408d9436b87449f15866" } modify_external_catalogs: true
I20260927 13:49:50.708751 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c6bf40a827d4408d9436b87449f15866" } modify_external_catalogs: true
I20260927 13:49:50.709414 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d9c94ee0af46e8aea12adac57829f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.710458 5089 tablet_service.cc:1511] Processing CreateTablet for tablet e730a00ad2e646a4ba594ba9434c3b50 (DEFAULT_TABLE table=default.Table_ecc55f056cc941b8aa8dca7116d366bc [id=31cf8c2030814300a2b39d7ecccda6aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.710930 6165 leader_election.cc:290] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:50.712952 5623 ts_tablet_manager.cc:1916] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.718041 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet a8c1b74943b9479e8b37969b2933c5a4 (table default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]) successfully deleted
I20260927 13:49:50.720516 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (DEFAULT_TABLE table=default.Table_42da0aba47fb44198e367fab1533d338 [id=fe64adff124845c0b35692c8e48f8759]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.720714 5184 leader_election.cc:343] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: c7670d5f54df49f4a074588ab9269145
I20260927 13:49:50.721737 5352 tablet_service.cc:1511] Processing CreateTablet for tablet e26a3a50396940cf826442e4ba7356a8 (DEFAULT_TABLE table=default.Table_3c83565e14ba4bdf96fcfceb17acdff3 [id=5f94649e22074c50b31b2156366e8993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.721807 6175 raft_consensus.cc:493] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:50.722029 6175 raft_consensus.cc:515] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.722988 6175 leader_election.cc:290] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:50.722185 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 95726f690a71433ca63f95da4ee750e5 (DEFAULT_TABLE table=default.Table_b22e5dfd0ffc497b87892eaf8b0c2fc1 [id=95a6abdb5a6549af8eefae7eb121672e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.718257 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 84d9c94ee0af46e8aea12adac57829f7 (DEFAULT_TABLE table=default.Table_7ac056af78a84ab9b807aaed0fcf7c6a [id=4d64253f01f048778ee2ff75d95535ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.730456 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.725757 5229 tablet_service.cc:1511] Processing CreateTablet for tablet a0e14fd01a9141cdb2df030ee0dd05db (DEFAULT_TABLE table=default.Table_8442b904c41d4d39a56497c27763e7f4 [id=6bf215680ef94518ae98737c9e63301d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.726274 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c0f38fe9743e42a2a400176803567039"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.733819 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0f38fe9743e42a2a400176803567039 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.735404 5226 tablet_service.cc:1511] Processing CreateTablet for tablet 50fb1288684c45f6a778d809a5e2c160 (DEFAULT_TABLE table=default.Table_8afed1bb46964731b195130b04104855 [id=d472fc89c3d9450c85f175d6443a76f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.734797 5619 tablet_bootstrap.cc:492] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:50.735795 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50fb1288684c45f6a778d809a5e2c160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.736860 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a (DEFAULT_TABLE table=default.Table_0d2bf498389c4960ac0105ae0a6d0fcf [id=bfd622f425d94088a9bb3afb7475021e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.736979 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a (DEFAULT_TABLE table=default.Table_0d2bf498389c4960ac0105ae0a6d0fcf [id=bfd622f425d94088a9bb3afb7475021e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.738298 5214 tablet_service.cc:1511] Processing CreateTablet for tablet f46f45a0a13b4e05802a08880d7f6a01 (DEFAULT_TABLE table=default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.738569 5213 tablet_service.cc:1511] Processing CreateTablet for tablet b5a9f864e4274666a86baed43e1623cd (DEFAULT_TABLE table=default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.738945 5227 tablet_service.cc:1511] Processing CreateTablet for tablet e730a00ad2e646a4ba594ba9434c3b50 (DEFAULT_TABLE table=default.Table_ecc55f056cc941b8aa8dca7116d366bc [id=31cf8c2030814300a2b39d7ecccda6aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.739084 5619 ts_tablet_manager.cc:1403] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.350s user 0.011s sys 0.000s
I20260927 13:49:50.740445 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e14fd01a9141cdb2df030ee0dd05db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.741305 5347 tablet_service.cc:1511] Processing CreateTablet for tablet 715b9af057f6425eb664e2399677890f (DEFAULT_TABLE table=default.Table_b5cc5519bcfb41efacb0dab9a602c3d9 [id=388161c7724e4e4f8f6e95f05a284fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.742596 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46f45a0a13b4e05802a08880d7f6a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.744844 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 715b9af057f6425eb664e2399677890f (DEFAULT_TABLE table=default.Table_b5cc5519bcfb41efacb0dab9a602c3d9 [id=388161c7724e4e4f8f6e95f05a284fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.745894 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 50bc839e0fc54839a5d06c176760f618 (DEFAULT_TABLE table=default.Table_16dc00b04267495ea0bf7b352b433889 [id=02b943faad65425ba6058acef5bff0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.746238 5365 tablet_service.cc:1511] Processing CreateTablet for tablet a0e14fd01a9141cdb2df030ee0dd05db (DEFAULT_TABLE table=default.Table_8442b904c41d4d39a56497c27763e7f4 [id=6bf215680ef94518ae98737c9e63301d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.746964 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.752493 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 78c4bbb0512c4411916eb4c48731f32f (DEFAULT_TABLE table=default.Table_ffc1e524e9a84e0a87e674470c4370e9 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.756263 5364 tablet_service.cc:1511] Processing CreateTablet for tablet f46f45a0a13b4e05802a08880d7f6a01 (DEFAULT_TABLE table=default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.759240 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715b9af057f6425eb664e2399677890f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.760838 5216 tablet_service.cc:1558] Processing DeleteTablet for tablet 84d9c94ee0af46e8aea12adac57829f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.764132 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_eb3c068026374d0ca946d3a8bd94db90" } new_table_name: "default.Table_6ed68a36591741168f587e896e3fd4d7" modify_external_catalogs: true
I20260927 13:49:50.766448 5220 tablet_service.cc:1558] Processing DeleteTablet for tablet dae5f63f709f455b8eceb44771845a3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.766986 5210 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a07adcd33414d18ae9720e7a307548a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:50.767195 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a9f864e4274666a86baed43e1623cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.768033 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e730a00ad2e646a4ba594ba9434c3b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.769076 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bc839e0fc54839a5d06c176760f618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.769785 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ca51e0504d9b40158ce597c8d0d12830" } new_table_name: "default.Table_13ce227af9d24669b442822fd4067b7c" modify_external_catalogs: true
I20260927 13:49:50.770046 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c4bbb0512c4411916eb4c48731f32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.770947 5628 tablet_bootstrap.cc:492] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:50.771116 5628 ts_tablet_manager.cc:1403] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.370s user 0.008s sys 0.012s
I20260927 13:49:50.771224 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ad5920def77f4a54aca3bcd967e12202"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.771755 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad5920def77f4a54aca3bcd967e12202 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.772931 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_177a9f16ad5342eb81daa361585e3154"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.772954 5350 tablet_service.cc:1511] Processing CreateTablet for tablet b5a9f864e4274666a86baed43e1623cd (DEFAULT_TABLE table=default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.772935 5628 raft_consensus.cc:359] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.773118 5628 raft_consensus.cc:385] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 13:49:50.773394 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_177a9f16ad5342eb81daa361585e3154 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.773528 5628 raft_consensus.cc:740] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.773794 5628 consensus_queue.cc:260] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.774626 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4683c7ce10d24c28964cc8268a92ce52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.775096 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4683c7ce10d24c28964cc8268a92ce52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.776156 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_932aaeb81340447295ee63cd2d68f1a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.776592 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_932aaeb81340447295ee63cd2d68f1a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.777184 5628 ts_tablet_manager.cc:1434] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:49:50.777510 5628 tablet_bootstrap.cc:492] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:50.777681 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3905bc395f754c2d93037c9b56a09515"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.778199 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3905bc395f754c2d93037c9b56a09515 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.782626 5355 tablet_service.cc:1511] Processing CreateTablet for tablet 50bc839e0fc54839a5d06c176760f618 (DEFAULT_TABLE table=default.Table_16dc00b04267495ea0bf7b352b433889 [id=02b943faad65425ba6058acef5bff0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.786226 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 78c4bbb0512c4411916eb4c48731f32f (DEFAULT_TABLE table=default.Table_ffc1e524e9a84e0a87e674470c4370e9 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.788446 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 081f18e00af74e5c811f774d29422351 consensus state has no leader
I20260927 13:49:50.790401 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 84d9c94ee0af46e8aea12adac57829f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:50.792150 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8e8bf79954c2429f886ac7afc9a8455f consensus state has no leader
I20260927 13:49:50.793692 5626 tablet_bootstrap.cc:492] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:50.794312 5626 ts_tablet_manager.cc:1403] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.310s user 0.007s sys 0.008s
I20260927 13:49:50.795504 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_0d2bf498389c4960ac0105ae0a6d0fcf" } new_table_name: "default.Table_42fee70b5ead49929314182670a6aa7e" modify_external_catalogs: true
I20260927 13:49:50.789000 5619 raft_consensus.cc:359] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.800648 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet dae5f63f709f455b8eceb44771845a3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:50.801234 5619 raft_consensus.cc:385] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.804138 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a07adcd33414d18ae9720e7a307548a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:50.802780 5619 raft_consensus.cc:740] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.800308 5626 raft_consensus.cc:359] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.806620 6175 raft_consensus.cc:493] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:50.806815 6175 raft_consensus.cc:515] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:50.807493 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 51899.2us
I20260927 13:49:50.807525 6175 leader_election.cc:290] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:50.807600 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e1acd618fc44be9169fa1d56fa510a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:50.808149 5319 leader_election.cc:343] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 195ce37d4abf4b92af22b46654b86ba5
I20260927 13:49:50.808236 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95726f690a71433ca63f95da4ee750e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.809139 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effce815011d47df960df2c79d41aa1f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:50.810340 5319 leader_election.cc:304] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:50.810602 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (DEFAULT_TABLE table=default.Table_42da0aba47fb44198e367fab1533d338 [id=fe64adff124845c0b35692c8e48f8759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.811280 5360 tablet_service.cc:1511] Processing CreateTablet for tablet e730a00ad2e646a4ba594ba9434c3b50 (DEFAULT_TABLE table=default.Table_ecc55f056cc941b8aa8dca7116d366bc [id=31cf8c2030814300a2b39d7ecccda6aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.811762 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 50fb1288684c45f6a778d809a5e2c160 (DEFAULT_TABLE table=default.Table_8afed1bb46964731b195130b04104855 [id=d472fc89c3d9450c85f175d6443a76f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.812139 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715b9af057f6425eb664e2399677890f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.812644 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7670d5f54df49f4a074588ab9269145" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:50.812858 5385 raft_consensus.cc:2468] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:50.813380 5185 leader_election.cc:304] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:50.814002 6165 raft_consensus.cc:2804] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:50.814131 6165 raft_consensus.cc:493] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:50.814231 6165 raft_consensus.cc:3060] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:50.817299 6165 raft_consensus.cc:515] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.818622 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 50fb1288684c45f6a778d809a5e2c160 (DEFAULT_TABLE table=default.Table_8afed1bb46964731b195130b04104855 [id=d472fc89c3d9450c85f175d6443a76f0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.818931 5044 leader_election.cc:343] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:50.818989 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7670d5f54df49f4a074588ab9269145" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
W20260927 13:49:50.819080 5044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 100973us
I20260927 13:49:50.819168 5385 raft_consensus.cc:3060] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:50.819577 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (DEFAULT_TABLE table=default.Table_42da0aba47fb44198e367fab1533d338 [id=fe64adff124845c0b35692c8e48f8759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.824862 6165 leader_election.cc:290] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:50.827890 6127 raft_consensus.cc:493] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:49:50.828091 5045 leader_election.cc:343] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:50.829053 5385 raft_consensus.cc:2468] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:50.830549 5185 leader_election.cc:304] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:50.831141 6175 raft_consensus.cc:2749] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:50.831615 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46f45a0a13b4e05802a08880d7f6a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.832113 6127 raft_consensus.cc:515] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.832651 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d9c94ee0af46e8aea12adac57829f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.832782 6127 leader_election.cc:290] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:50.833096 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e1acd618fc44be9169fa1d56fa510a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.834249 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5cc71e06eb743d2b63e056e88a6498f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:50.834998 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6af740383384609a354d7f0fae2cd70" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:50.836479 5044 leader_election.cc:343] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:50.837071 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:50.838387 5319 leader_election.cc:343] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:50.838761 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a9f864e4274666a86baed43e1623cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.839332 5045 leader_election.cc:304] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:50.839406 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a (DEFAULT_TABLE table=default.Table_0d2bf498389c4960ac0105ae0a6d0fcf [id=bfd622f425d94088a9bb3afb7475021e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.840027 5319 leader_election.cc:343] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 2efee56b495340baa6dd51f0f3e2aaa7
I20260927 13:49:50.839866 6165 raft_consensus.cc:2804] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:50.841282 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effce815011d47df960df2c79d41aa1f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:50.841506 5107 raft_consensus.cc:2468] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:50.841979 6165 raft_consensus.cc:697] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
W20260927 13:49:50.841284 5045 leader_election.cc:343] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:50.843201 5085 tablet_service.cc:1511] Processing CreateTablet for tablet f46f45a0a13b4e05802a08880d7f6a01 (DEFAULT_TABLE table=default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.843717 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5cc71e06eb743d2b63e056e88a6498f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:50.844038 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26a3a50396940cf826442e4ba7356a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.844278 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da75a470ec0c4ec9afa7c18a51cd7276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.844483 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50fb1288684c45f6a778d809a5e2c160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.846074 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d9c94ee0af46e8aea12adac57829f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.848120 5319 leader_election.cc:304] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:50.849212 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:50.850414 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a consensus state has no leader
I20260927 13:49:50.850852 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e14fd01a9141cdb2df030ee0dd05db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.853574 6175 raft_consensus.cc:2804] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:50.854635 6175 raft_consensus.cc:493] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:50.854765 6175 raft_consensus.cc:3060] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:50.855327 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bc839e0fc54839a5d06c176760f618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.856011 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c4bbb0512c4411916eb4c48731f32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.856596 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e730a00ad2e646a4ba594ba9434c3b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.859701 6145 raft_consensus.cc:493] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:50.860452 6145 raft_consensus.cc:515] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.861086 6145 leader_election.cc:290] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:50.861594 5623 ts_tablet_manager.cc:1929] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:50.861747 5623 log.cc:1199] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/0018704e08254c2e8d30c7067df4420c
I20260927 13:49:50.862154 5623 ts_tablet_manager.cc:1950] T 0018704e08254c2e8d30c7067df4420c P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:50.863266 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76add3b9ef254ece958121a336e87936" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:50.866032 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fc8409c9830e42a48adddfcc3ca09d5d" } modify_external_catalogs: true
I20260927 13:49:50.866051 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a5e2dce7a50147989daaa5bcd02f11da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.866291 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fc8409c9830e42a48adddfcc3ca09d5d" } modify_external_catalogs: true
W20260927 13:49:50.866701 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5e2dce7a50147989daaa5bcd02f11da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.868156 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_063d9cdaf0c040d0b5c9f25481a960bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.868678 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_063d9cdaf0c040d0b5c9f25481a960bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.869148 5082 tablet_service.cc:1511] Processing CreateTablet for tablet a0e14fd01a9141cdb2df030ee0dd05db (DEFAULT_TABLE table=default.Table_8442b904c41d4d39a56497c27763e7f4 [id=6bf215680ef94518ae98737c9e63301d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.869758 5087 tablet_service.cc:1511] Processing CreateTablet for tablet b5a9f864e4274666a86baed43e1623cd (DEFAULT_TABLE table=default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.871012 6165 consensus_queue.cc:237] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.876500 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ecc55f056cc941b8aa8dca7116d366bc" } modify_external_catalogs: true
I20260927 13:49:50.876699 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ecc55f056cc941b8aa8dca7116d366bc" } modify_external_catalogs: true
I20260927 13:49:50.877302 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7dacecf959774572955f40d737467ebd" } new_table_name: "default.Table_3d7781d4f12941689327daa8fc4c7ae0" modify_external_catalogs: true
I20260927 13:49:50.877491 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95726f690a71433ca63f95da4ee750e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.878819 4921 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d895a1f615604afdb91fa57dc9ef7d10" } modify_external_catalogs: true
I20260927 13:49:50.879016 4921 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d895a1f615604afdb91fa57dc9ef7d10" } modify_external_catalogs: true
I20260927 13:49:50.885020 4927 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (table default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]). Expected version 1 got 0
I20260927 13:49:50.885864 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_03c0639b89c9428091f98822abc5f438" } new_table_name: "default.Table_43b89b55155b4b51ab4b271a93f30d59" modify_external_catalogs: true
I20260927 13:49:50.902097 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 5a3f40a2da8649e0898c0e09b6e14a61 (DEFAULT_TABLE table=default.Table_daa900fd6e014a39b47ad6cba895d79f [id=cf68b449acf14948a708664840631845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.805852 5626 raft_consensus.cc:385] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:50.902016 5623 tablet_replica.cc:333] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:50.907172 5623 raft_consensus.cc:2243] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:50.907742 5623 pending_rounds.cc:70] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:50.908015 5623 pending_rounds.cc:77] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957594611384320 op_type: NO_OP noop_request { }
I20260927 13:49:50.908366 5623 raft_consensus.cc:2889] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:50.908396 4926 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]). Expected version 1 got 0
I20260927 13:49:50.908668 5623 raft_consensus.cc:2272] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:50.910408 5623 ts_tablet_manager.cc:1916] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:50.903047 5349 tablet_service.cc:1511] Processing CreateTablet for tablet b044fbc166e848f39d17b63db69f63a4 (DEFAULT_TABLE table=default.Table_8544e332ec664166b8e0096ab40a19d5 [id=a34447e359784bba9f7b44e0e2968a1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.913262 6127 raft_consensus.cc:2749] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:50.905627 5354 tablet_service.cc:1511] Processing CreateTablet for tablet e5b04acc39f3436384fbb69cebdc35cd (DEFAULT_TABLE table=default.Table_2ffaaab1360041dcb71d30bd031dda41 [id=9822148965e74084941bcd0c04bfa009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.907568 5348 tablet_service.cc:1511] Processing CreateTablet for tablet cbacda63c0d3427aabf3332b278576c5 (DEFAULT_TABLE table=default.Table_48a5fac9ec3d40c4a4b405f925a74326 [id=935f2e2df32c46e58760dba62709c181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.908710 5358 tablet_service.cc:1511] Processing CreateTablet for tablet c48ca4b429294782a9e6ed496c6dfb72 (DEFAULT_TABLE table=default.Table_7a48c16d7a32465cbc86892633257ea3 [id=49b35f9188a141e4af0afc5b3d2fd897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.911978 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 80fe8af2068948c78feac4641a7525be (DEFAULT_TABLE table=default.Table_114b4e4e5a834c1bb0468e42edf6cb6f [id=73340bb48c8e4ef890b4fab3a86e2e53]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.913954 5184 leader_election.cc:343] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: c7670d5f54df49f4a074588ab9269145
I20260927 13:49:50.914381 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46f45a0a13b4e05802a08880d7f6a01. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:50.914456 5319 leader_election.cc:343] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2efee56b495340baa6dd51f0f3e2aaa7
I20260927 13:49:50.914933 5045 leader_election.cc:304] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:50.915874 5045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 74503.7us
I20260927 13:49:50.915889 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 84d9c94ee0af46e8aea12adac57829f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.916800 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76add3b9ef254ece958121a336e87936" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:50.917022 5107 raft_consensus.cc:2468] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:50.916082 5626 raft_consensus.cc:740] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:50.915920 5078 tablet_service.cc:1511] Processing CreateTablet for tablet 78c4bbb0512c4411916eb4c48731f32f (DEFAULT_TABLE table=default.Table_ffc1e524e9a84e0a87e674470c4370e9 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:50.918809 4916 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 45298.8us
I20260927 13:49:50.920584 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a9f864e4274666a86baed43e1623cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.920545 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet dae5f63f709f455b8eceb44771845a3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:50.921203 6127 raft_consensus.cc:2749] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:50.921829 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b044fbc166e848f39d17b63db69f63a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.921881 5623 ts_tablet_manager.cc:1929] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:50.922008 5623 log.cc:1199] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/c7670d5f54df49f4a074588ab9269145
I20260927 13:49:50.922070 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbacda63c0d3427aabf3332b278576c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.922402 5623 ts_tablet_manager.cc:1950] T c7670d5f54df49f4a074588ab9269145 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:50.923108 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a07adcd33414d18ae9720e7a307548a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:50.925675 5045 leader_election.cc:343] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:50.925707 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c4bbb0512c4411916eb4c48731f32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.925933 5045 leader_election.cc:304] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:50.930660 5319 leader_election.cc:304] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:50.930987 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50fb1288684c45f6a778d809a5e2c160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.932272 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80fe8af2068948c78feac4641a7525be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.934310 6127 raft_consensus.cc:2749] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:50.935912 5072 tablet_service.cc:1511] Processing CreateTablet for tablet 50bc839e0fc54839a5d06c176760f618 (DEFAULT_TABLE table=default.Table_16dc00b04267495ea0bf7b352b433889 [id=02b943faad65425ba6058acef5bff0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.938238 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e14fd01a9141cdb2df030ee0dd05db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.940390 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48ca4b429294782a9e6ed496c6dfb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.940999 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b04acc39f3436384fbb69cebdc35cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.942330 5364 tablet_service.cc:1511] Processing CreateTablet for tablet 334b0349bfaa4a9c8b7d280177f1ecae (DEFAULT_TABLE table=default.Table_add07d0ee556457283038281d97f840b [id=28c3b0590cd643b988ee77d18c7afaec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.949086 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 715b9af057f6425eb664e2399677890f (DEFAULT_TABLE table=default.Table_b5cc5519bcfb41efacb0dab9a602c3d9 [id=388161c7724e4e4f8f6e95f05a284fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.954414 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.956501 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.919965 5626 consensus_queue.cc:260] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:50.959913 5247 raft_consensus.cc:2468] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:50.965273 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26a3a50396940cf826442e4ba7356a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.929438 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_13777f8bd8dc43b6b1da8868bbdc5e40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:50.971096 5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bc839e0fc54839a5d06c176760f618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.972805 5626 ts_tablet_manager.cc:1434] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.178s user 0.004s sys 0.002s
I20260927 13:49:50.978222 5626 tablet_bootstrap.cc:492] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:50.979156 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 0018704e08254c2e8d30c7067df4420c (table default.Table_e60c3a05c2a7437db426cc486086ff0a [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
I20260927 13:49:50.980849 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715b9af057f6425eb664e2399677890f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:50.985410 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a7a97f4df3a84781bfcbdc768d518ef0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7a97f4df3a84781bfcbdc768d518ef0 already in progress: creating tablet
W20260927 13:49:50.985785 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 5e3fa4870d5547a2bbffe1745b964504 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e3fa4870d5547a2bbffe1745b964504 already in progress: creating tablet
W20260927 13:49:50.986033 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet f75847513dcf4c84913a4073176f2507 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f75847513dcf4c84913a4073176f2507 already in progress: creating tablet
W20260927 13:49:50.986382 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 1245334728994a60ad641c2e90f8d2df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1245334728994a60ad641c2e90f8d2df already in progress: creating tablet
W20260927 13:49:50.986622 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b5cc71e06eb743d2b63e056e88a6498f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5cc71e06eb743d2b63e056e88a6498f already in progress: creating tablet
W20260927 13:49:50.986866 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 72711f14f26a479c9699b172b41b1db0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72711f14f26a479c9699b172b41b1db0 already in progress: creating tablet
I20260927 13:49:50.987157 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet c7670d5f54df49f4a074588ab9269145 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]) successfully deleted
W20260927 13:49:50.987385 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 84d9c94ee0af46e8aea12adac57829f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84d9c94ee0af46e8aea12adac57829f7 already in progress: creating tablet
W20260927 13:49:50.987622 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet dae5f63f709f455b8eceb44771845a3f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dae5f63f709f455b8eceb44771845a3f already in progress: creating tablet
W20260927 13:49:50.987836 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 3a07adcd33414d18ae9720e7a307548a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a07adcd33414d18ae9720e7a307548a already in progress: creating tablet
I20260927 13:49:50.988674 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 5a3f40a2da8649e0898c0e09b6e14a61 (DEFAULT_TABLE table=default.Table_daa900fd6e014a39b47ad6cba895d79f [id=cf68b449acf14948a708664840631845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:50.989123 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a3f40a2da8649e0898c0e09b6e14a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:50.992827 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7675c4eea2d04c06b01cf0466c4ed466"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:50.993486 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7675c4eea2d04c06b01cf0466c4ed466 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:50.997881 5626 tablet_bootstrap.cc:654] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.000164 5225 tablet_service.cc:1511] Processing CreateTablet for tablet b044fbc166e848f39d17b63db69f63a4 (DEFAULT_TABLE table=default.Table_8544e332ec664166b8e0096ab40a19d5 [id=a34447e359784bba9f7b44e0e2968a1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.000605 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b044fbc166e848f39d17b63db69f63a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.006919 5227 tablet_service.cc:1511] Processing CreateTablet for tablet e5b04acc39f3436384fbb69cebdc35cd (DEFAULT_TABLE table=default.Table_2ffaaab1360041dcb71d30bd031dda41 [id=9822148965e74084941bcd0c04bfa009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.007326 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b04acc39f3436384fbb69cebdc35cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.010820 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b5a9f864e4274666a86baed43e1623cd
W20260927 13:49:51.012072 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d35148d80b44fca9b39a4625d3e61c1 consensus state has no leader
I20260927 13:49:51.012473 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_06ee1270c5734798871c56d5e91a8a1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:51.012738 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_268838ff93954800813c2850f8dbef43" } new_table_name: "default.Table_2aca6646f7534f72b84c2aba10508d48" modify_external_catalogs: true
W20260927 13:49:51.013073 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06ee1270c5734798871c56d5e91a8a1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.014577 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet e730a00ad2e646a4ba594ba9434c3b50
I20260927 13:49:51.015388 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_daa900fd6e014a39b47ad6cba895d79f" } new_table_name: "default.Table_e5be80b901124d33921a36b696b7fc26" modify_external_catalogs: true
I20260927 13:49:51.016439 5227 tablet_service.cc:1511] Processing CreateTablet for tablet cbacda63c0d3427aabf3332b278576c5 (DEFAULT_TABLE table=default.Table_48a5fac9ec3d40c4a4b405f925a74326 [id=935f2e2df32c46e58760dba62709c181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.016834 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet ec40378eb80c412198d5b66c02e975ef
I20260927 13:49:51.016896 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbacda63c0d3427aabf3332b278576c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.017830 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_eff6033580e94f2bac135304b3786335"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.018365 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eff6033580e94f2bac135304b3786335 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.019405 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 3933c0a2fd6547f28528fae7d443a2c1
I20260927 13:49:51.019821 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet b5a9f864e4274666a86baed43e1623cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.020059 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d60c38242e1e4cd58bfa63d7e986be02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.020541 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d60c38242e1e4cd58bfa63d7e986be02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.023461 5224 tablet_service.cc:1511] Processing CreateTablet for tablet c48ca4b429294782a9e6ed496c6dfb72 (DEFAULT_TABLE table=default.Table_7a48c16d7a32465cbc86892633257ea3 [id=49b35f9188a141e4af0afc5b3d2fd897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.023907 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48ca4b429294782a9e6ed496c6dfb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.027371 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 56b9612ffea543b9b0779c46533d91ab
I20260927 13:49:51.028192 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_cb2cdf43d4eb4fc1b302363907f746a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.028726 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb2cdf43d4eb4fc1b302363907f746a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:51.030853 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a443f65eba384b998fdc57ec57e37d87 consensus state has no leader
I20260927 13:49:51.031322 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a5b94f165eff40f3826437ed44404e55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:51.031617 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 80fe8af2068948c78feac4641a7525be (DEFAULT_TABLE table=default.Table_114b4e4e5a834c1bb0468e42edf6cb6f [id=73340bb48c8e4ef890b4fab3a86e2e53]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:51.031908 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5b94f165eff40f3826437ed44404e55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.032061 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80fe8af2068948c78feac4641a7525be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.033074 6175 raft_consensus.cc:515] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.033816 6175 leader_election.cc:290] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:51.036828 5619 consensus_queue.cc:260] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.037441 5619 ts_tablet_manager.cc:1434] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.297s user 0.006s sys 0.000s
I20260927 13:49:51.038177 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334b0349bfaa4a9c8b7d280177f1ecae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.038439 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a3f40a2da8649e0898c0e09b6e14a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.042218 6145 raft_consensus.cc:2749] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:51.042505 5606 ts_tablet_manager.cc:1929] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.042476 5319 leader_election.cc:304] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:51.042629 5606 log.cc:1199] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/7a4b7500f05e4b63b4d79fabde88ebe6
I20260927 13:49:51.042762 6145 raft_consensus.cc:2804] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:51.042878 6145 raft_consensus.cc:493] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:51.042984 6145 raft_consensus.cc:3060] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:51.043098 5606 ts_tablet_manager.cc:1950] T 7a4b7500f05e4b63b4d79fabde88ebe6 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:51.043916 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 261) took 1245 ms. Trace:
I20260927 13:49:51.044052 5606 rpcz_store.cc:276] 0927 13:49:49.798256 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.799232 (+ 976us) service_pool.cc:224] Handling call
0927 13:49:50.514976 (+715744us) ts_tablet_manager.cc:1151] Deleting tablet 7a4b7500f05e4b63b4d79fabde88ebe6
0927 13:49:50.514985 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:50.521905 (+ 6920us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:50.963001 (+441096us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.043873 (+ 80872us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":686734}
I20260927 13:49:51.044476 5606 tablet_replica.cc:333] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:51.044706 5606 raft_consensus.cc:2243] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.044881 5606 raft_consensus.cc:2272] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.045413 5606 ts_tablet_manager.cc:1916] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.045861 6145 raft_consensus.cc:515] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:51.046206 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 92003.5us
I20260927 13:49:51.046973 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effce815011d47df960df2c79d41aa1f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:51.048067 6145 leader_election.cc:290] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:51.048605 5319 leader_election.cc:343] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.049296 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76add3b9ef254ece958121a336e87936" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:51.049484 5247 raft_consensus.cc:3060] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:51.050371 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 7a4b7500f05e4b63b4d79fabde88ebe6 (table default.Table_88c5377676df4e3fb778d2781ed7a546 [id=36caa6d3649b47efb7e95cab54ca2608]) successfully deleted
I20260927 13:49:51.052596 5247 raft_consensus.cc:2468] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:51.053056 5319 leader_election.cc:304] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:51.053380 6145 raft_consensus.cc:2804] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
W20260927 13:49:51.054546 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0361e3b244a1437b8e402dd8602528fe consensus state has no leader
I20260927 13:49:51.055029 5606 ts_tablet_manager.cc:1929] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.055190 5606 log.cc:1199] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/195ce37d4abf4b92af22b46654b86ba5
I20260927 13:49:51.055639 5606 ts_tablet_manager.cc:1950] T 195ce37d4abf4b92af22b46654b86ba5 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:51.058068 5347 tablet_service.cc:1511] Processing CreateTablet for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (DEFAULT_TABLE table=default.Table_48319d13c4f549a7997788187d90c91b [id=6ab6358c2ecd4fa2a31e5b591639d1c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.058346 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_dfa3b09930634e67ba11591b71147d46" } new_table_name: "default.Table_3f7e50c133694889a2ff545f1123eae9" modify_external_catalogs: true
I20260927 13:49:51.058355 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3aa8c52bbcea4bdd9b268b8dce338b4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:51.058712 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:51.058966 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3aa8c52bbcea4bdd9b268b8dce338b4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.059518 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 272) took 1180 ms. Trace:
I20260927 13:49:51.059616 5606 rpcz_store.cc:276] 0927 13:49:49.878837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.878889 (+ 52us) service_pool.cc:224] Handling call
0927 13:49:51.044403 (+1165514us) ts_tablet_manager.cc:1151] Deleting tablet 195ce37d4abf4b92af22b46654b86ba5
0927 13:49:51.044417 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.048650 (+ 4233us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.054939 (+ 6289us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.059456 (+ 4517us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1165278}
W20260927 13:49:51.060190 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a3f40a2da8649e0898c0e09b6e14a61 consensus state has no leader
I20260927 13:49:51.060254 5606 tablet_replica.cc:333] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:51.060276 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 195ce37d4abf4b92af22b46654b86ba5 (table default.Table_34e3d06c06ed4b90b3444e8c803d2e07 [id=ce8690509c5c4110bf5dd62244aceb46]) successfully deleted
I20260927 13:49:51.060452 5606 raft_consensus.cc:2243] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.060655 5606 raft_consensus.cc:2272] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.061218 5606 ts_tablet_manager.cc:1916] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.061748 6145 raft_consensus.cc:697] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:51.062076 6145 consensus_queue.cc:237] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.063113 5359 tablet_service.cc:1511] Processing CreateTablet for tablet f702b0a6380543a8ac539125d4334cd5 (DEFAULT_TABLE table=default.Table_f62fc7820ff54165afff30f8e47b56ab [id=779da161cdef4cec9d98cfa465f747d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.063548 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f702b0a6380543a8ac539125d4334cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.066192 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 3933c0a2fd6547f28528fae7d443a2c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.066411 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet ec40378eb80c412198d5b66c02e975ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.067894 5606 ts_tablet_manager.cc:1929] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.068007 5606 log.cc:1199] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/a3b1d54e4af0432f9d1ef9879d2ec4e9
I20260927 13:49:51.068367 5606 ts_tablet_manager.cc:1950] T a3b1d54e4af0432f9d1ef9879d2ec4e9 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:51.070173 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 273) took 1191 ms. Trace:
I20260927 13:49:51.070298 5606 rpcz_store.cc:276] 0927 13:49:49.879014 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.879152 (+ 138us) service_pool.cc:224] Handling call
0927 13:49:51.060157 (+1181005us) ts_tablet_manager.cc:1151] Deleting tablet a3b1d54e4af0432f9d1ef9879d2ec4e9
0927 13:49:51.060171 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.064505 (+ 4334us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.067813 (+ 3308us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.070092 (+ 2279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1180796}
W20260927 13:49:51.070627 4917 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 1efaf62692c545dcaa5175fcd826785a (table default.Table_b76c0a83f3804d4fa4fab07460d3b61f [id=27d4534550fd49038bcf9101064bfeb6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1efaf62692c545dcaa5175fcd826785a consensus state has no leader
I20260927 13:49:51.070817 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet a3b1d54e4af0432f9d1ef9879d2ec4e9 (table default.Table_87c2ff7de94d4663aebf61e88f2d5080 [id=c4c8708f397345919b0e8b06ab47b367]) successfully deleted
I20260927 13:49:51.070873 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 276) took 1163 ms. Trace:
I20260927 13:49:51.070976 5606 rpcz_store.cc:276] 0927 13:49:49.907823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.907873 (+ 50us) service_pool.cc:224] Handling call
0927 13:49:51.070711 (+1162838us) ts_tablet_manager.cc:1151] Deleting tablet 059afd48ac4a41569ed1d3556b7974f0
0927 13:49:51.070720 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.070840 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1162617}
I20260927 13:49:51.071563 5606 tablet_replica.cc:333] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:51.071779 5606 raft_consensus.cc:2243] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.072089 5606 raft_consensus.cc:2272] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.072585 5606 ts_tablet_manager.cc:1916] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.071570 5346 tablet_service.cc:1558] Processing DeleteTablet for tablet e730a00ad2e646a4ba594ba9434c3b50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:51.074965 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 059afd48ac4a41569ed1d3556b7974f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 059afd48ac4a41569ed1d3556b7974f0 already in progress: creating tablet
I20260927 13:49:51.076879 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 1087ad60dade46bb9d38f52a94dd536b (DEFAULT_TABLE table=default.Table_177a9f16ad5342eb81daa361585e3154 [id=5c18a5a9f69148d7824d38061b9afd07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.077287 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1087ad60dade46bb9d38f52a94dd536b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.079656 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 4b13c629908a47368846770c697aebd8 (DEFAULT_TABLE table=default.Table_932aaeb81340447295ee63cd2d68f1a1 [id=b6aa56ef149348aaa266a4ea12e61c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.080096 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b13c629908a47368846770c697aebd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.081099 4927 catalog_manager.cc:5838] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:51.081634 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 992bf643dee64bccaa993a08027aa5fc (DEFAULT_TABLE table=default.Table_3540d8e89c9c46c393a438ad3c0439b0 [id=00fdc87b0cbf4bc091a92db3004b4397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.082026 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992bf643dee64bccaa993a08027aa5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.082392 5351 tablet_service.cc:1511] Processing CreateTablet for tablet c44dc61b4003469e8f404b73f22f7291 (DEFAULT_TABLE table=default.Table_c35f0f666c6d4a5ca35fbe71a9d02c70 [id=2308ec26e62146738552b7667770d5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.082774 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44dc61b4003469e8f404b73f22f7291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.086432 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 449e6bf85bf1434ab6ce42e751d31c6f (DEFAULT_TABLE table=default.Table_4683c7ce10d24c28964cc8268a92ce52 [id=378ab630e5534a0b9210c3a1d08ad912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.086830 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449e6bf85bf1434ab6ce42e751d31c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.089978 5606 ts_tablet_manager.cc:1929] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.090237 5606 log.cc:1199] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/2efee56b495340baa6dd51f0f3e2aaa7
W20260927 13:49:51.090443 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 931a48792f4c4525bd563a4dd1062e35 consensus state has no leader
I20260927 13:49:51.090541 5363 tablet_service.cc:1511] Processing CreateTablet for tablet b54cf8c485324f798d59edf65d52d7b5 (DEFAULT_TABLE table=default.Table_12c2d12d8eda427d96a28d5d701aeb49 [id=8afc172cdb804d42b8bd6b15d829da61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.090703 5606 ts_tablet_manager.cc:1950] T 2efee56b495340baa6dd51f0f3e2aaa7 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:51.090906 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54cf8c485324f798d59edf65d52d7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.091603 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 278) took 1175 ms. Trace:
I20260927 13:49:51.091715 5606 rpcz_store.cc:276] 0927 13:49:49.916595 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.916641 (+ 46us) service_pool.cc:224] Handling call
0927 13:49:51.071393 (+1154752us) ts_tablet_manager.cc:1151] Deleting tablet 2efee56b495340baa6dd51f0f3e2aaa7
0927 13:49:51.071497 (+ 104us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.077117 (+ 5620us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.089907 (+ 12790us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.091541 (+ 1634us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1154393}
I20260927 13:49:51.092249 5606 tablet_replica.cc:333] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:51.092459 5606 raft_consensus.cc:2243] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.092650 5606 raft_consensus.cc:2272] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.093220 5606 ts_tablet_manager.cc:1916] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.098438 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 5c69163fb77442be9215f8f285b904ef (DEFAULT_TABLE table=default.Table_3905bc395f754c2d93037c9b56a09515 [id=f5627b57c0564716bd5a2011827bb666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.098951 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c69163fb77442be9215f8f285b904ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.101794 5360 tablet_service.cc:1511] Processing CreateTablet for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (DEFAULT_TABLE table=default.Table_c0f38fe9743e42a2a400176803567039 [id=ae170bbebc4e460fb58beb7f95f013a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.102284 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e8ae1a0ce2496cb2eed2066eb37a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.105191 5619 tablet_bootstrap.cc:492] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:51.105170 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13777f8bd8dc43b6b1da8868bbdc5e40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.105748 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effce815011d47df960df2c79d41aa1f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:51.105962 5107 raft_consensus.cc:3060] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:51.106331 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc69551c99942b09862904266572471 (DEFAULT_TABLE table=default.Table_ad5920def77f4a54aca3bcd967e12202 [id=6fa735ecdafb4f40b5f41de307eb13d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.106690 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc69551c99942b09862904266572471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.111300 5085 tablet_service.cc:1511] Processing CreateTablet for tablet cbacda63c0d3427aabf3332b278576c5 (DEFAULT_TABLE table=default.Table_48a5fac9ec3d40c4a4b405f925a74326 [id=935f2e2df32c46e58760dba62709c181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.113238 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76add3b9ef254ece958121a336e87936" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:51.115990 5070 tablet_service.cc:1511] Processing CreateTablet for tablet c48ca4b429294782a9e6ed496c6dfb72 (DEFAULT_TABLE table=default.Table_7a48c16d7a32465cbc86892633257ea3 [id=49b35f9188a141e4af0afc5b3d2fd897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.116117 5106 raft_consensus.cc:3060] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:51.116590 5619 tablet_bootstrap.cc:654] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.118022 5073 tablet_service.cc:1511] Processing CreateTablet for tablet 5a3f40a2da8649e0898c0e09b6e14a61 (DEFAULT_TABLE table=default.Table_daa900fd6e014a39b47ad6cba895d79f [id=cf68b449acf14948a708664840631845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.118506 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet 56b9612ffea543b9b0779c46533d91ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.119324 5626 tablet_bootstrap.cc:492] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:51.119510 5626 ts_tablet_manager.cc:1403] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.142s user 0.005s sys 0.000s
I20260927 13:49:51.120396 5088 tablet_service.cc:1511] Processing CreateTablet for tablet b044fbc166e848f39d17b63db69f63a4 (DEFAULT_TABLE table=default.Table_8544e332ec664166b8e0096ab40a19d5 [id=a34447e359784bba9f7b44e0e2968a1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.120378 5626 raft_consensus.cc:359] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.120580 5626 raft_consensus.cc:385] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.120645 5626 raft_consensus.cc:740] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.120893 5626 consensus_queue.cc:260] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.121555 5626 ts_tablet_manager.cc:1434] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:51.126374 5626 tablet_bootstrap.cc:492] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:51.133041 5356 tablet_service.cc:1511] Processing CreateTablet for tablet a9503dd46ccf472581d1a667eea300ed (DEFAULT_TABLE table=default.Table_06ee1270c5734798871c56d5e91a8a1d [id=4837357d958c4b8c8669d79813ef1a2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.133667 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9503dd46ccf472581d1a667eea300ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.134346 5355 tablet_service.cc:1511] Processing CreateTablet for tablet b6985779674646f4abe18cdf7c063c90 (DEFAULT_TABLE table=default.Table_d60c38242e1e4cd58bfa63d7e986be02 [id=c8fc51d181554744b841aa4829281293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.135764 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6985779674646f4abe18cdf7c063c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.137565 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 334b0349bfaa4a9c8b7d280177f1ecae (DEFAULT_TABLE table=default.Table_add07d0ee556457283038281d97f840b [id=28c3b0590cd643b988ee77d18c7afaec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.138007 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334b0349bfaa4a9c8b7d280177f1ecae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.139992 5215 tablet_service.cc:1511] Processing CreateTablet for tablet f702b0a6380543a8ac539125d4334cd5 (DEFAULT_TABLE table=default.Table_f62fc7820ff54165afff30f8e47b56ab [id=779da161cdef4cec9d98cfa465f747d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.140334 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f702b0a6380543a8ac539125d4334cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.142575 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (DEFAULT_TABLE table=default.Table_48319d13c4f549a7997788187d90c91b [id=6ab6358c2ecd4fa2a31e5b591639d1c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.143013 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.143858 5626 tablet_bootstrap.cc:654] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.154500 5352 tablet_service.cc:1511] Processing CreateTablet for tablet b0827a26334c42728545a9eaa006fae0 (DEFAULT_TABLE table=default.Table_cb2cdf43d4eb4fc1b302363907f746a2 [id=a2e5f425d1494b40a9b253e6b2d4c86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.155824 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0827a26334c42728545a9eaa006fae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.160210 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet ec40378eb80c412198d5b66c02e975ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.160506 5225 tablet_service.cc:1558] Processing DeleteTablet for tablet e730a00ad2e646a4ba594ba9434c3b50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.160709 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet b5a9f864e4274666a86baed43e1623cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.163635 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 5c69163fb77442be9215f8f285b904ef (DEFAULT_TABLE table=default.Table_3905bc395f754c2d93037c9b56a09515 [id=f5627b57c0564716bd5a2011827bb666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.163846 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 1087ad60dade46bb9d38f52a94dd536b (DEFAULT_TABLE table=default.Table_177a9f16ad5342eb81daa361585e3154 [id=5c18a5a9f69148d7824d38061b9afd07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.164063 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c69163fb77442be9215f8f285b904ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.164410 5626 tablet_bootstrap.cc:492] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:51.164373 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 449e6bf85bf1434ab6ce42e751d31c6f (DEFAULT_TABLE table=default.Table_4683c7ce10d24c28964cc8268a92ce52 [id=378ab630e5534a0b9210c3a1d08ad912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.164599 5626 ts_tablet_manager.cc:1403] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20260927 13:49:51.164706 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449e6bf85bf1434ab6ce42e751d31c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.165763 5626 raft_consensus.cc:359] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.166025 5626 raft_consensus.cc:385] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.166170 5626 raft_consensus.cc:740] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.166472 5626 consensus_queue.cc:260] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.169569 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1087ad60dade46bb9d38f52a94dd536b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.171653 5626 ts_tablet_manager.cc:1434] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260927 13:49:51.173061 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff7d501f7704e69b696053cb1b1ffe5 (DEFAULT_TABLE table=default.Table_eff6033580e94f2bac135304b3786335 [id=8d27d076ff4b448c8c752d8ac6146b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.173513 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff7d501f7704e69b696053cb1b1ffe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.175678 5626 tablet_bootstrap.cc:492] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:51.178153 5626 tablet_bootstrap.cc:654] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.178449 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 008516a474cc40f2b9de77b2f3e762cf (DEFAULT_TABLE table=default.Table_a5e2dce7a50147989daaa5bcd02f11da [id=de5e7f4beb904151afa92b9e3f1151b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.179342 5353 tablet_service.cc:1511] Processing CreateTablet for tablet bf557ac29964453583f224b46178c7dd (DEFAULT_TABLE table=default.Table_2f83c545334d4bc995f6afb456fb190b [id=00aa74ea071b484daf2c9854a1e87728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.180768 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 3add644bb1f544e1b3c91fecfd6a541b (DEFAULT_TABLE table=default.Table_a5b94f165eff40f3826437ed44404e55 [id=caf6214f83fd4d19b26a6f39ef349629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.181481 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008516a474cc40f2b9de77b2f3e762cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.182617 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3add644bb1f544e1b3c91fecfd6a541b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.178174 5225 tablet_service.cc:1558] Processing DeleteTablet for tablet 56b9612ffea543b9b0779c46533d91ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.193847 5348 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 (DEFAULT_TABLE table=default.Table_7675c4eea2d04c06b01cf0466c4ed466 [id=c58f2a8e5acf483d89fb782663512587]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.194392 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.198421 5349 tablet_service.cc:1511] Processing CreateTablet for tablet f3f6a9c5e4be480796f433a68945dd72 (DEFAULT_TABLE table=default.Table_063d9cdaf0c040d0b5c9f25481a960bc [id=4538e58c268d44b59999b80f295c321d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.198921 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f6a9c5e4be480796f433a68945dd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.200256 6175 raft_consensus.cc:493] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:51.200451 6175 raft_consensus.cc:515] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.201179 6175 leader_election.cc:290] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:51.202098 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8f6354c1034814af3cc20df25ddb47" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:51.202857 5319 leader_election.cc:343] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.210242 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 334b0349bfaa4a9c8b7d280177f1ecae (DEFAULT_TABLE table=default.Table_add07d0ee556457283038281d97f840b [id=28c3b0590cd643b988ee77d18c7afaec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.210901 5074 tablet_service.cc:1511] Processing CreateTablet for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (DEFAULT_TABLE table=default.Table_48319d13c4f549a7997788187d90c91b [id=6ab6358c2ecd4fa2a31e5b591639d1c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.211388 5081 tablet_service.cc:1511] Processing CreateTablet for tablet f702b0a6380543a8ac539125d4334cd5 (DEFAULT_TABLE table=default.Table_f62fc7820ff54165afff30f8e47b56ab [id=779da161cdef4cec9d98cfa465f747d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.214790 5075 tablet_service.cc:1511] Processing CreateTablet for tablet e5b04acc39f3436384fbb69cebdc35cd (DEFAULT_TABLE table=default.Table_2ffaaab1360041dcb71d30bd031dda41 [id=9822148965e74084941bcd0c04bfa009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.223539 5350 tablet_service.cc:1511] Processing CreateTablet for tablet e25f5898369f46fba32b7df27b334b28 (DEFAULT_TABLE table=default.Table_13777f8bd8dc43b6b1da8868bbdc5e40 [id=248111d3c564489c80ec8b9d1629f49a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.224138 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25f5898369f46fba32b7df27b334b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.228531 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 80fe8af2068948c78feac4641a7525be (DEFAULT_TABLE table=default.Table_114b4e4e5a834c1bb0468e42edf6cb6f [id=73340bb48c8e4ef890b4fab3a86e2e53]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:51.244290 5319 leader_election.cc:343] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bc8f6354c1034814af3cc20df25ddb47
I20260927 13:49:51.244606 5319 leader_election.cc:304] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:51.245153 6175 raft_consensus.cc:2749] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:51.250758 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e730a00ad2e646a4ba594ba9434c3b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.254284 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80fe8af2068948c78feac4641a7525be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.264701 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.266610 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334b0349bfaa4a9c8b7d280177f1ecae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.268194 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f702b0a6380543a8ac539125d4334cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.270919 5625 ts_tablet_manager.cc:1929] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.272927 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48ca4b429294782a9e6ed496c6dfb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.273980 5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a3f40a2da8649e0898c0e09b6e14a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.277503 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf557ac29964453583f224b46178c7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.277938 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbacda63c0d3427aabf3332b278576c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.278565 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b044fbc166e848f39d17b63db69f63a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.281548 5625 log.cc:1199] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b64d3aa052bf4c48b3802f6006cce9c9
I20260927 13:49:51.285445 5625 ts_tablet_manager.cc:1950] T b64d3aa052bf4c48b3802f6006cce9c9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:51.287763 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 76a397300cdd44eb899f2ef5b9fe8c09 (DEFAULT_TABLE table=default.Table_3aa8c52bbcea4bdd9b268b8dce338b4b [id=5308278b9daf4308a52aede42b353b64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.288638 5628 tablet_bootstrap.cc:654] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.289775 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b04acc39f3436384fbb69cebdc35cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.292002 5107 raft_consensus.cc:2468] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:51.293816 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 280) took 1372 ms. Trace:
I20260927 13:49:51.294023 5625 rpcz_store.cc:276] 0927 13:49:49.921575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.922919 (+ 1344us) service_pool.cc:224] Handling call
0927 13:49:50.590501 (+667582us) ts_tablet_manager.cc:1151] Deleting tablet b64d3aa052bf4c48b3802f6006cce9c9
0927 13:49:50.614611 (+ 24110us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:50.738355 (+123744us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.231532 (+493177us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.293767 (+ 62235us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":627458}
I20260927 13:49:51.294776 5625 tablet_replica.cc:333] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:51.295065 5625 raft_consensus.cc:2243] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.295346 5625 raft_consensus.cc:2272] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.296311 5625 ts_tablet_manager.cc:1916] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.297708 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet b5a9f864e4274666a86baed43e1623cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.298075 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet e730a00ad2e646a4ba594ba9434c3b50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.298503 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet ec40378eb80c412198d5b66c02e975ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.298799 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet 3933c0a2fd6547f28528fae7d443a2c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.299050 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet 56b9612ffea543b9b0779c46533d91ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.299582 5078 tablet_service.cc:1511] Processing CreateTablet for tablet 5c69163fb77442be9215f8f285b904ef (DEFAULT_TABLE table=default.Table_3905bc395f754c2d93037c9b56a09515 [id=f5627b57c0564716bd5a2011827bb666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.300136 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c69163fb77442be9215f8f285b904ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.314041 5106 raft_consensus.cc:2468] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:51.315713 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 3933c0a2fd6547f28528fae7d443a2c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.317777 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 1087ad60dade46bb9d38f52a94dd536b (DEFAULT_TABLE table=default.Table_177a9f16ad5342eb81daa361585e3154 [id=5c18a5a9f69148d7824d38061b9afd07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.318986 6127 raft_consensus.cc:493] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:51.291247 6175 raft_consensus.cc:493] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:51.291718 6186 raft_consensus.cc:493] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:51.292600 5319 leader_election.cc:304] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:51.319321 6186 raft_consensus.cc:515] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.320173 6186 leader_election.cc:290] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:51.320370 6186 raft_consensus.cc:2804] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:51.320544 6186 raft_consensus.cc:697] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:51.320811 6186 consensus_queue.cc:237] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.322175 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 449e6bf85bf1434ab6ce42e751d31c6f (DEFAULT_TABLE table=default.Table_4683c7ce10d24c28964cc8268a92ce52 [id=378ab630e5534a0b9210c3a1d08ad912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.322510 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc174eab36b46fb8e276b3168fbfbcd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:51.323062 6175 raft_consensus.cc:515] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.323751 6175 leader_election.cc:290] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:51.323864 6127 raft_consensus.cc:515] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:51.324543 6127 leader_election.cc:290] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:51.323083 5319 leader_election.cc:343] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.325580 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bf9ba5d857421ebc783d4c567f411c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:51.325786 5248 raft_consensus.cc:2468] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:51.325994 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1087ad60dade46bb9d38f52a94dd536b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.326406 5319 leader_election.cc:304] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:51.326756 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc174eab36b46fb8e276b3168fbfbcd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:51.326973 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5dfa3e80454463908df19a49454764" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:51.327549 5106 raft_consensus.cc:2468] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:51.327633 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5dfa3e80454463908df19a49454764" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:51.328027 6145 raft_consensus.cc:2804] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:51.328174 6145 raft_consensus.cc:493] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:51.328286 6145 raft_consensus.cc:3060] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:51.328492 5319 leader_election.cc:304] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:51.329211 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449e6bf85bf1434ab6ce42e751d31c6f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:51.329177 5045 leader_election.cc:343] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:51.329389 5044 leader_election.cc:343] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.329411 6175 raft_consensus.cc:493] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:51.329644 6175 raft_consensus.cc:515] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.329859 5044 leader_election.cc:304] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:51.330458 6175 leader_election.cc:290] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:51.330577 6127 raft_consensus.cc:2749] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:51.330681 6175 raft_consensus.cc:2804] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:51.332204 6175 raft_consensus.cc:493] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:51.332353 6175 raft_consensus.cc:3060] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:51.335596 6175 raft_consensus.cc:515] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.337773 6145 raft_consensus.cc:515] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.338652 6145 leader_election.cc:290] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:51.339103 6175 leader_election.cc:290] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:51.341730 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a397300cdd44eb899f2ef5b9fe8c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.358319 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet f5bf9ba5d857421ebc783d4c567f411c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.360162 5070 tablet_service.cc:1511] Processing CreateTablet for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (DEFAULT_TABLE table=default.Table_c0f38fe9743e42a2a400176803567039 [id=ae170bbebc4e460fb58beb7f95f013a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.360613 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e8ae1a0ce2496cb2eed2066eb37a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.361950 5227 tablet_service.cc:1511] Processing CreateTablet for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (DEFAULT_TABLE table=default.Table_c0f38fe9743e42a2a400176803567039 [id=ae170bbebc4e460fb58beb7f95f013a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.362489 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e8ae1a0ce2496cb2eed2066eb37a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.364440 5224 tablet_service.cc:1511] Processing CreateTablet for tablet bf557ac29964453583f224b46178c7dd (DEFAULT_TABLE table=default.Table_2f83c545334d4bc995f6afb456fb190b [id=00aa74ea071b484daf2c9854a1e87728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.365981 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b8d6958e6f44d3a98ed96d89d4c1b4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:51.366236 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc174eab36b46fb8e276b3168fbfbcd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:51.366320 5107 raft_consensus.cc:2468] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:51.366472 5108 raft_consensus.cc:3060] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:51.366696 5319 leader_election.cc:343] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f5bf9ba5d857421ebc783d4c567f411c
W20260927 13:49:51.367080 5319 leader_election.cc:343] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f5bf9ba5d857421ebc783d4c567f411c
I20260927 13:49:51.367273 5319 leader_election.cc:304] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:51.368367 6199 raft_consensus.cc:2804] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:51.368531 6199 raft_consensus.cc:493] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:51.368743 6199 raft_consensus.cc:3060] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:51.374553 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf557ac29964453583f224b46178c7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.365830 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b8d6958e6f44d3a98ed96d89d4c1b4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:51.367945 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc174eab36b46fb8e276b3168fbfbcd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:51.368186 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bf9ba5d857421ebc783d4c567f411c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:51.378598 5248 raft_consensus.cc:3060] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:51.381448 5248 raft_consensus.cc:2468] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:49:51.381610 4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.125:42239, user_credentials={real_user=slave}} blocked reactor thread for 224268us
W20260927 13:49:51.382329 5319 leader_election.cc:343] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:51.382611 5319 leader_election.cc:343] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.383006 5319 leader_election.cc:304] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:51.303078 5606 ts_tablet_manager.cc:1929] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.386510 5606 log.cc:1199] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/0004ef0b2dd841ac860798d804374dc1
I20260927 13:49:51.387018 5606 ts_tablet_manager.cc:1950] T 0004ef0b2dd841ac860798d804374dc1 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:51.387995 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 280) took 1448 ms. Trace:
I20260927 13:49:51.388129 5606 rpcz_store.cc:276] 0927 13:49:49.939975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.940036 (+ 61us) service_pool.cc:224] Handling call
0927 13:49:51.092163 (+1152127us) ts_tablet_manager.cc:1151] Deleting tablet 0004ef0b2dd841ac860798d804374dc1
0927 13:49:51.092172 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.096988 (+ 4816us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.302987 (+205999us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.387945 (+ 84958us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1151673}
I20260927 13:49:51.388651 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 0004ef0b2dd841ac860798d804374dc1 (table default.Table_5f2f268fd879476db40bf7a96885d2a5 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]) successfully deleted
I20260927 13:49:51.389626 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3539bb21635f41688c4f65412b92c4a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.390375 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3539bb21635f41688c4f65412b92c4a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.393869 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_de911651b6ff4188876ef1d412e041b7" } modify_external_catalogs: true
I20260927 13:49:51.394079 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_de911651b6ff4188876ef1d412e041b7" } modify_external_catalogs: true
I20260927 13:49:51.394604 6175 raft_consensus.cc:2804] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:51.394801 6175 raft_consensus.cc:697] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:51.395084 6175 consensus_queue.cc:237] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.403589 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3511ad1c722940ca87a5e0807110230c" } new_table_name: "default.Table_000065d7fd1245df945d5c14cf4b881b" modify_external_catalogs: true
I20260927 13:49:51.408313 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 825a73d47bff4246965be82eb482f7aa
I20260927 13:49:51.409204 5108 raft_consensus.cc:2468] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:51.410331 5319 leader_election.cc:304] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:51.410714 6145 raft_consensus.cc:2804] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:51.411005 6145 raft_consensus.cc:697] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:51.411470 6145 consensus_queue.cc:237] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:51.416561 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74226753751a49fa8ce98eafb2ca1250 consensus state has no leader
I20260927 13:49:51.422392 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cb8208423d374903b009adbf0c2cbe9d" } modify_external_catalogs: true
I20260927 13:49:51.422747 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet 825a73d47bff4246965be82eb482f7aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.423300 5363 tablet_service.cc:1511] Processing CreateTablet for tablet a82284e3fd1f4a2f95c7e47320abb30c (DEFAULT_TABLE table=default.Table_3539bb21635f41688c4f65412b92c4a6 [id=c25e04914c284d7593821643decbbbe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.423604 5628 tablet_bootstrap.cc:492] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:51.423784 5628 ts_tablet_manager.cc:1403] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.646s user 0.011s sys 0.000s
I20260927 13:49:51.423965 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82284e3fd1f4a2f95c7e47320abb30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.424614 5628 raft_consensus.cc:359] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.424819 5628 raft_consensus.cc:385] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.424913 5628 raft_consensus.cc:740] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.425163 5628 consensus_queue.cc:260] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.424970 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cb8208423d374903b009adbf0c2cbe9d" } modify_external_catalogs: true
I20260927 13:49:51.425909 5628 ts_tablet_manager.cc:1434] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:51.432263 5076 tablet_service.cc:1511] Processing CreateTablet for tablet bf557ac29964453583f224b46178c7dd (DEFAULT_TABLE table=default.Table_2f83c545334d4bc995f6afb456fb190b [id=00aa74ea071b484daf2c9854a1e87728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.441804 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet bb25bb5ee153494d803130f1ad4f7c2e
I20260927 13:49:51.442317 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc69551c99942b09862904266572471 (DEFAULT_TABLE table=default.Table_ad5920def77f4a54aca3bcd967e12202 [id=6fa735ecdafb4f40b5f41de307eb13d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.442378 5213 tablet_service.cc:1511] Processing CreateTablet for tablet b54cf8c485324f798d59edf65d52d7b5 (DEFAULT_TABLE table=default.Table_12c2d12d8eda427d96a28d5d701aeb49 [id=8afc172cdb804d42b8bd6b15d829da61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.442798 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc69551c99942b09862904266572471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.442975 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 992bf643dee64bccaa993a08027aa5fc (DEFAULT_TABLE table=default.Table_3540d8e89c9c46c393a438ad3c0439b0 [id=00fdc87b0cbf4bc091a92db3004b4397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.443354 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992bf643dee64bccaa993a08027aa5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.443328 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_eff6033580e94f2bac135304b3786335" } modify_external_catalogs: true
I20260927 13:49:51.443521 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_eff6033580e94f2bac135304b3786335" } modify_external_catalogs: true
I20260927 13:49:51.445047 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b76c0a83f3804d4fa4fab07460d3b61f" } modify_external_catalogs: true
I20260927 13:49:51.445191 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b76c0a83f3804d4fa4fab07460d3b61f" } modify_external_catalogs: true
I20260927 13:49:51.446504 5212 tablet_service.cc:1511] Processing CreateTablet for tablet c44dc61b4003469e8f404b73f22f7291 (DEFAULT_TABLE table=default.Table_c35f0f666c6d4a5ca35fbe71a9d02c70 [id=2308ec26e62146738552b7667770d5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.446574 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_22a8a2d3c05d409480ef5c85b521fa0d" } modify_external_catalogs: true
I20260927 13:49:51.446702 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54cf8c485324f798d59edf65d52d7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.446733 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_22a8a2d3c05d409480ef5c85b521fa0d" } modify_external_catalogs: true
I20260927 13:49:51.446934 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44dc61b4003469e8f404b73f22f7291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.448235 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6ed68a36591741168f587e896e3fd4d7" } new_table_name: "default.Table_92bf3a9fa895485597b7f5cda3251baf" modify_external_catalogs: true
I20260927 13:49:51.448909 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 992bf643dee64bccaa993a08027aa5fc (DEFAULT_TABLE table=default.Table_3540d8e89c9c46c393a438ad3c0439b0 [id=00fdc87b0cbf4bc091a92db3004b4397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.449023 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 4b13c629908a47368846770c697aebd8 (DEFAULT_TABLE table=default.Table_932aaeb81340447295ee63cd2d68f1a1 [id=b6aa56ef149348aaa266a4ea12e61c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.449612 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6ca18492261b4eac898eb7838d59e717"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:51.449712 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc69551c99942b09862904266572471 (DEFAULT_TABLE table=default.Table_ad5920def77f4a54aca3bcd967e12202 [id=6fa735ecdafb4f40b5f41de307eb13d0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:51.450171 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ca18492261b4eac898eb7838d59e717 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.450565 5087 tablet_service.cc:1511] Processing CreateTablet for tablet b54cf8c485324f798d59edf65d52d7b5 (DEFAULT_TABLE table=default.Table_12c2d12d8eda427d96a28d5d701aeb49 [id=8afc172cdb804d42b8bd6b15d829da61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.452103 6199 raft_consensus.cc:515] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.453639 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b8d6958e6f44d3a98ed96d89d4c1b4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:51.453753 5628 tablet_bootstrap.cc:492] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:51.453871 5109 raft_consensus.cc:3060] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:51.454041 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf557ac29964453583f224b46178c7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.454319 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992bf643dee64bccaa993a08027aa5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.454939 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54cf8c485324f798d59edf65d52d7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.455996 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet f5bf9ba5d857421ebc783d4c567f411c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.456104 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b13c629908a47368846770c697aebd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.456820 5623 tablet_replica.cc:333] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:51.457034 5623 raft_consensus.cc:2243] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.457382 5109 raft_consensus.cc:2468] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:51.460044 5623 raft_consensus.cc:2272] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.460171 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc69551c99942b09862904266572471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.460649 5085 tablet_service.cc:1511] Processing CreateTablet for tablet c44dc61b4003469e8f404b73f22f7291 (DEFAULT_TABLE table=default.Table_c35f0f666c6d4a5ca35fbe71a9d02c70 [id=2308ec26e62146738552b7667770d5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.460794 5623 ts_tablet_manager.cc:1916] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.461174 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 284) took 1486 ms. Trace:
I20260927 13:49:51.461347 5606 rpcz_store.cc:276] 0927 13:49:49.975047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.975104 (+ 57us) service_pool.cc:224] Handling call
0927 13:49:51.461003 (+1485899us) ts_tablet_manager.cc:1151] Deleting tablet fa9d09ca7952499ba135e15cecb1143e
0927 13:49:51.461014 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.461134 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1485721}
W20260927 13:49:51.461997 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet fa9d09ca7952499ba135e15cecb1143e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa9d09ca7952499ba135e15cecb1143e already in progress: creating tablet
I20260927 13:49:51.462072 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 288) took 1475 ms. Trace:
I20260927 13:49:51.462236 5606 rpcz_store.cc:276] 0927 13:49:49.986940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.987006 (+ 66us) service_pool.cc:224] Handling call
0927 13:49:51.461857 (+1474851us) ts_tablet_manager.cc:1151] Deleting tablet 559ac90ef36d406881dc17ade0560044
0927 13:49:51.461867 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.462029 (+ 162us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1474641}
I20260927 13:49:51.462826 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 291) took 1452 ms. Trace:
W20260927 13:49:51.463016 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 559ac90ef36d406881dc17ade0560044 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 559ac90ef36d406881dc17ade0560044 already in progress: creating tablet
I20260927 13:49:51.462986 5606 rpcz_store.cc:276] 0927 13:49:50.010638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.010696 (+ 58us) service_pool.cc:224] Handling call
0927 13:49:51.462705 (+1452009us) ts_tablet_manager.cc:1151] Deleting tablet d1f9ae430c414cdf9370388d51dd7c63
0927 13:49:51.462713 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.462794 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1451611}
I20260927 13:49:51.463428 5606 tablet_replica.cc:333] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
W20260927 13:49:51.463435 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet d1f9ae430c414cdf9370388d51dd7c63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1f9ae430c414cdf9370388d51dd7c63 already in progress: creating tablet
I20260927 13:49:51.463508 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff7d501f7704e69b696053cb1b1ffe5 (DEFAULT_TABLE table=default.Table_eff6033580e94f2bac135304b3786335 [id=8d27d076ff4b448c8c752d8ac6146b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.463639 5606 raft_consensus.cc:2243] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.463798 5606 raft_consensus.cc:2272] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.463883 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff7d501f7704e69b696053cb1b1ffe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.464373 5319 leader_election.cc:304] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:51.465716 5228 tablet_service.cc:1511] Processing CreateTablet for tablet a9503dd46ccf472581d1a667eea300ed (DEFAULT_TABLE table=default.Table_06ee1270c5734798871c56d5e91a8a1d [id=4837357d958c4b8c8669d79813ef1a2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.466470 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9503dd46ccf472581d1a667eea300ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.466521 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff7d501f7704e69b696053cb1b1ffe5 (DEFAULT_TABLE table=default.Table_eff6033580e94f2bac135304b3786335 [id=8d27d076ff4b448c8c752d8ac6146b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.466854 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff7d501f7704e69b696053cb1b1ffe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.464697 6175 raft_consensus.cc:2804] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:51.467736 6175 raft_consensus.cc:697] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:51.468390 5619 tablet_bootstrap.cc:492] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:51.468566 5223 tablet_service.cc:1511] Processing CreateTablet for tablet b6985779674646f4abe18cdf7c063c90 (DEFAULT_TABLE table=default.Table_d60c38242e1e4cd58bfa63d7e986be02 [id=c8fc51d181554744b841aa4829281293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.468658 5619 ts_tablet_manager.cc:1403] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.363s user 0.005s sys 0.003s
I20260927 13:49:51.469134 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6985779674646f4abe18cdf7c063c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.469516 5619 raft_consensus.cc:359] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:51.469691 5619 raft_consensus.cc:385] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.469771 5619 raft_consensus.cc:740] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.470037 5619 consensus_queue.cc:260] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:51.470628 5619 ts_tablet_manager.cc:1434] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:51.471007 5619 tablet_bootstrap.cc:492] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:51.471662 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 081f18e00af74e5c811f774d29422351 consensus state has no leader
I20260927 13:49:51.472153 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 3700a1f40c0644848da62392cb0c297f
I20260927 13:49:51.472857 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 4b13c629908a47368846770c697aebd8 (DEFAULT_TABLE table=default.Table_932aaeb81340447295ee63cd2d68f1a1 [id=b6aa56ef149348aaa266a4ea12e61c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.473503 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b13c629908a47368846770c697aebd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.473863 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 1efaf62692c545dcaa5175fcd826785a
I20260927 13:49:51.474277 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet 3700a1f40c0644848da62392cb0c297f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.474916 6175 consensus_queue.cc:237] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.475227 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet 1efaf62692c545dcaa5175fcd826785a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.476078 6208 tablet.cc:1751] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:51.476814 5360 tablet_service.cc:1558] Processing DeleteTablet for tablet bb25bb5ee153494d803130f1ad4f7c2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.477758 5075 tablet_service.cc:1511] Processing CreateTablet for tablet a9503dd46ccf472581d1a667eea300ed (DEFAULT_TABLE table=default.Table_06ee1270c5734798871c56d5e91a8a1d [id=4837357d958c4b8c8669d79813ef1a2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.478271 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9503dd46ccf472581d1a667eea300ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.478852 5226 tablet_service.cc:1511] Processing CreateTablet for tablet b0827a26334c42728545a9eaa006fae0 (DEFAULT_TABLE table=default.Table_cb2cdf43d4eb4fc1b302363907f746a2 [id=a2e5f425d1494b40a9b253e6b2d4c86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.478946 5606 ts_tablet_manager.cc:1916] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.479697 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0827a26334c42728545a9eaa006fae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.480788 5082 tablet_service.cc:1511] Processing CreateTablet for tablet b0827a26334c42728545a9eaa006fae0 (DEFAULT_TABLE table=default.Table_cb2cdf43d4eb4fc1b302363907f746a2 [id=a2e5f425d1494b40a9b253e6b2d4c86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.481712 5079 tablet_service.cc:1511] Processing CreateTablet for tablet b6985779674646f4abe18cdf7c063c90 (DEFAULT_TABLE table=default.Table_d60c38242e1e4cd58bfa63d7e986be02 [id=c8fc51d181554744b841aa4829281293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.481786 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 6ff7d501f7704e69b696053cb1b1ffe5
I20260927 13:49:51.482324 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_932aaeb81340447295ee63cd2d68f1a1" } new_table_name: "default.Table_1731298f7d9c4e41bfe89acaa4624028" modify_external_catalogs: true
I20260927 13:49:51.484543 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 3add644bb1f544e1b3c91fecfd6a541b (DEFAULT_TABLE table=default.Table_a5b94f165eff40f3826437ed44404e55 [id=caf6214f83fd4d19b26a6f39ef349629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.484925 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3add644bb1f544e1b3c91fecfd6a541b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:51.486370 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet ec40378eb80c412198d5b66c02e975ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec40378eb80c412198d5b66c02e975ef already in progress: creating tablet
I20260927 13:49:51.486541 5606 ts_tablet_manager.cc:1929] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.482894 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_01b5b7db6ed64c46907e0527b4ccede2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:51.486685 5606 log.cc:1199] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/c7670d5f54df49f4a074588ab9269145
W20260927 13:49:51.486959 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet e730a00ad2e646a4ba594ba9434c3b50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e730a00ad2e646a4ba594ba9434c3b50 already in progress: creating tablet
I20260927 13:49:51.487066 5606 ts_tablet_manager.cc:1950] T c7670d5f54df49f4a074588ab9269145 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:49:51.487124 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01b5b7db6ed64c46907e0527b4ccede2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:51.487517 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b5a9f864e4274666a86baed43e1623cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5a9f864e4274666a86baed43e1623cd already in progress: creating tablet
I20260927 13:49:51.487941 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 295) took 1353 ms. Trace:
W20260927 13:49:51.487986 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 56b9612ffea543b9b0779c46533d91ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56b9612ffea543b9b0779c46533d91ab already in progress: creating tablet
I20260927 13:49:51.483322 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet 06c810fde988439c97a8445fc88626b3 from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:51.488597 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 3933c0a2fd6547f28528fae7d443a2c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3933c0a2fd6547f28528fae7d443a2c1 already in progress: creating tablet
I20260927 13:49:51.489540 5619 tablet_bootstrap.cc:654] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.489799 5084 tablet_service.cc:1511] Processing CreateTablet for tablet f3f6a9c5e4be480796f433a68945dd72 (DEFAULT_TABLE table=default.Table_063d9cdaf0c040d0b5c9f25481a960bc [id=4538e58c268d44b59999b80f295c321d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.489913 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 3add644bb1f544e1b3c91fecfd6a541b (DEFAULT_TABLE table=default.Table_a5b94f165eff40f3826437ed44404e55 [id=caf6214f83fd4d19b26a6f39ef349629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.490239 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f6a9c5e4be480796f433a68945dd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.491245 5222 tablet_service.cc:1511] Processing CreateTablet for tablet f3f6a9c5e4be480796f433a68945dd72 (DEFAULT_TABLE table=default.Table_063d9cdaf0c040d0b5c9f25481a960bc [id=4538e58c268d44b59999b80f295c321d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.491631 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c976a667e7c4b948b3aa176b13b7d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.491816 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3add644bb1f544e1b3c91fecfd6a541b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.488057 5606 rpcz_store.cc:276] 0927 13:49:50.134359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.134421 (+ 62us) service_pool.cc:224] Handling call
0927 13:49:51.463369 (+1328948us) ts_tablet_manager.cc:1151] Deleting tablet c7670d5f54df49f4a074588ab9269145
0927 13:49:51.463377 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.483326 (+ 19949us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.486473 (+ 3147us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.487874 (+ 1401us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1328584}
W20260927 13:49:51.493631 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b13c629908a47368846770c697aebd8 consensus state has no leader
I20260927 13:49:51.493989 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet c7670d5f54df49f4a074588ab9269145 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]) successfully deleted
I20260927 13:49:51.494175 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44dc61b4003469e8f404b73f22f7291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.495527 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_473c4114525b4bea85fd83367cd4c376"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.496130 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_473c4114525b4bea85fd83367cd4c376 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.498075 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f6a9c5e4be480796f433a68945dd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.499271 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_063d9cdaf0c040d0b5c9f25481a960bc" } new_table_name: "default.Table_273d137820cd406fb25a9d5d6f1a53bc" modify_external_catalogs: true
I20260927 13:49:51.504369 5628 tablet_bootstrap.cc:654] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.506559 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 06c810fde988439c97a8445fc88626b3
I20260927 13:49:51.507030 4930 catalog_manager.cc:6934] ReplaceTablet: tablet 06c810fde988439c97a8445fc88626b3 deleted and replaced by tablet 0191cfad4e7a4b088b2ecdc246bfa58a
I20260927 13:49:51.507299 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0827a26334c42728545a9eaa006fae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.508930 4929 master_service.cc:960] ReplaceTablet: received request to replace tablet efd31e3dd142413c92fce2043e053d32 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:51.483810 5070 tablet_service.cc:1511] Processing CreateTablet for tablet 008516a474cc40f2b9de77b2f3e762cf (DEFAULT_TABLE table=default.Table_a5e2dce7a50147989daaa5bcd02f11da [id=de5e7f4beb904151afa92b9e3f1151b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.509686 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008516a474cc40f2b9de77b2f3e762cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.511839 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_97f900bc6c8b4b829da15d428de9e4ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.512399 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97f900bc6c8b4b829da15d428de9e4ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:51.517781 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3f6a9c5e4be480796f433a68945dd72 consensus state has no leader
I20260927 13:49:51.518162 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b8d6958e6f44d3a98ed96d89d4c1b4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:49:51.518811 5319 leader_election.cc:343] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.522810 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e60c3a05c2a7437db426cc486086ff0a" } new_table_name: "default.Table_020de70ec7bc4e119d5c6a3e22d8d32d" modify_external_catalogs: true
I20260927 13:49:51.524994 5623 ts_tablet_manager.cc:1929] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.525126 5623 log.cc:1199] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f5bf9ba5d857421ebc783d4c567f411c
I20260927 13:49:51.526032 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_0fb429f4425443cf828065d29ef97f10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:51.526726 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f467eb34e5ed44eaa26bde85eded8dac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.527525 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f467eb34e5ed44eaa26bde85eded8dac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.529745 5623 ts_tablet_manager.cc:1950] T f5bf9ba5d857421ebc783d4c567f411c P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:51.530180 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_1331333f8b0a40f9961974e3407260ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.530638 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1331333f8b0a40f9961974e3407260ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.532858 5625 ts_tablet_manager.cc:1929] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.533157 5625 log.cc:1199] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a6af740383384609a354d7f0fae2cd70
I20260927 13:49:51.533622 5625 ts_tablet_manager.cc:1950] T a6af740383384609a354d7f0fae2cd70 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:51.534431 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet efd31e3dd142413c92fce2043e053d32
I20260927 13:49:51.534901 4929 catalog_manager.cc:6934] ReplaceTablet: tablet efd31e3dd142413c92fce2043e053d32 deleted and replaced by tablet 11d48db9b20a41419d5be703190fadd8
I20260927 13:49:51.536587 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3f1356fe7e4340d99b696cace4f9a6a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.537081 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f1356fe7e4340d99b696cace4f9a6a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.538224 6199 leader_election.cc:290] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:51.538270 5360 tablet_service.cc:1558] Processing DeleteTablet for tablet efd31e3dd142413c92fce2043e053d32 with delete_type TABLET_DATA_DELETED (replaced by tablet 11d48db9b20a41419d5be703190fadd8) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.541332 6127 raft_consensus.cc:493] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:51.541507 6127 raft_consensus.cc:515] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.542248 6127 leader_election.cc:290] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:51.543164 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ff32095a554784b91e74012ad8e020" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:51.543774 5044 leader_election.cc:343] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.544134 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff7d501f7704e69b696053cb1b1ffe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.544551 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6985779674646f4abe18cdf7c063c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.544490 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ff32095a554784b91e74012ad8e020" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:51.529783 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fb429f4425443cf828065d29ef97f10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:51.545030 5045 leader_election.cc:343] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.546438 5045 leader_election.cc:304] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:51.546417 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 008516a474cc40f2b9de77b2f3e762cf (DEFAULT_TABLE table=default.Table_a5e2dce7a50147989daaa5bcd02f11da [id=de5e7f4beb904151afa92b9e3f1151b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.546842 6127 raft_consensus.cc:2749] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:51.546873 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008516a474cc40f2b9de77b2f3e762cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.549103 6206 tablet.cc:1751] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:51.549279 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet cd4c568b96084baeb7438a4857adadc1 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:51.549978 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3614a1889eea43b39d1d94a3211a5473"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.550536 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3614a1889eea43b39d1d94a3211a5473 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.553144 5623 tablet_replica.cc:333] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:51.553401 5623 raft_consensus.cc:2243] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.553568 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 9f080b4ca9894eae8305d1548010a6cb from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:51.553699 5623 raft_consensus.cc:2272] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.554469 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 (DEFAULT_TABLE table=default.Table_7675c4eea2d04c06b01cf0466c4ed466 [id=c58f2a8e5acf483d89fb782663512587]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.554495 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 (DEFAULT_TABLE table=default.Table_7675c4eea2d04c06b01cf0466c4ed466 [id=c58f2a8e5acf483d89fb782663512587]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.554806 5623 ts_tablet_manager.cc:1916] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.554917 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.556032 5085 tablet_service.cc:1511] Processing CreateTablet for tablet e25f5898369f46fba32b7df27b334b28 (DEFAULT_TABLE table=default.Table_13777f8bd8dc43b6b1da8868bbdc5e40 [id=248111d3c564489c80ec8b9d1629f49a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.556286 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 825a73d47bff4246965be82eb482f7aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.556927 5222 tablet_service.cc:1511] Processing CreateTablet for tablet e25f5898369f46fba32b7df27b334b28 (DEFAULT_TABLE table=default.Table_13777f8bd8dc43b6b1da8868bbdc5e40 [id=248111d3c564489c80ec8b9d1629f49a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.557364 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25f5898369f46fba32b7df27b334b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.557363 5080 tablet_service.cc:1511] Processing CreateTablet for tablet a82284e3fd1f4a2f95c7e47320abb30c (DEFAULT_TABLE table=default.Table_3539bb21635f41688c4f65412b92c4a6 [id=c25e04914c284d7593821643decbbbe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.558238 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 76a397300cdd44eb899f2ef5b9fe8c09 (DEFAULT_TABLE table=default.Table_3aa8c52bbcea4bdd9b268b8dce338b4b [id=5308278b9daf4308a52aede42b353b64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.560073 5223 tablet_service.cc:1511] Processing CreateTablet for tablet a82284e3fd1f4a2f95c7e47320abb30c (DEFAULT_TABLE table=default.Table_3539bb21635f41688c4f65412b92c4a6 [id=c25e04914c284d7593821643decbbbe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.560428 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82284e3fd1f4a2f95c7e47320abb30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.555855 6207 tablet.cc:1751] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:51.562556 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25f5898369f46fba32b7df27b334b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.562932 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.562925 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 825a73d47bff4246965be82eb482f7aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.563462 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82284e3fd1f4a2f95c7e47320abb30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.563925 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a397300cdd44eb899f2ef5b9fe8c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.569442 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet bb25bb5ee153494d803130f1ad4f7c2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.570012 5226 tablet_service.cc:1558] Processing DeleteTablet for tablet 3700a1f40c0644848da62392cb0c297f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.570443 5226 tablet_service.cc:1558] Processing DeleteTablet for tablet 1efaf62692c545dcaa5175fcd826785a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.570446 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b64d3aa052bf4c48b3802f6006cce9c9 (table default.Table_cf1d80366a7743b3b4fea68ea5246139 [id=ded13e9c993046cd891db043b1ff6a95]) successfully deleted
I20260927 13:49:51.570904 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 76a397300cdd44eb899f2ef5b9fe8c09 (DEFAULT_TABLE table=default.Table_3aa8c52bbcea4bdd9b268b8dce338b4b [id=5308278b9daf4308a52aede42b353b64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.571470 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a397300cdd44eb899f2ef5b9fe8c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.573945 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff7d501f7704e69b696053cb1b1ffe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.577474 5226 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff7d501f7704e69b696053cb1b1ffe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:51.578521 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b57886cc11a2423983c2b7bac79150a0 consensus state has no leader
I20260927 13:49:51.586830 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 288) took 1623 ms. Trace:
I20260927 13:49:51.586962 5625 rpcz_store.cc:276] 0927 13:49:49.963147 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.963205 (+ 58us) service_pool.cc:224] Handling call
0927 13:49:51.294698 (+1331493us) ts_tablet_manager.cc:1151] Deleting tablet a6af740383384609a354d7f0fae2cd70
0927 13:49:51.294708 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.476175 (+181467us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.532786 (+ 56611us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.586766 (+ 53980us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21546,"tablet-delete.queue_time_us":1330288}
I20260927 13:49:51.587409 5625 tablet_replica.cc:333] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:51.587608 5625 raft_consensus.cc:2243] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.587811 5625 raft_consensus.cc:2272] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.588346 5625 ts_tablet_manager.cc:1916] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.590272 5070 tablet_service.cc:1558] Processing DeleteTablet for tablet 1efaf62692c545dcaa5175fcd826785a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.591065 5626 tablet_bootstrap.cc:492] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:51.592545 5626 ts_tablet_manager.cc:1403] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.416s user 0.038s sys 0.066s
I20260927 13:49:51.593233 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 3700a1f40c0644848da62392cb0c297f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.593485 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet bb25bb5ee153494d803130f1ad4f7c2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.594269 5626 raft_consensus.cc:359] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.595130 5626 raft_consensus.cc:385] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.595238 5626 raft_consensus.cc:740] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.595798 5626 consensus_queue.cc:260] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.597199 5626 ts_tablet_manager.cc:1434] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:49:51.600733 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet cd4c568b96084baeb7438a4857adadc1
I20260927 13:49:51.601239 4924 catalog_manager.cc:6934] ReplaceTablet: tablet cd4c568b96084baeb7438a4857adadc1 deleted and replaced by tablet bb7b3a35b2e94bbea6be4b4a8f158593
I20260927 13:49:51.601447 5625 ts_tablet_manager.cc:1929] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.601580 5625 log.cc:1199] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/c989f70385f64593a46f633c98267627
I20260927 13:49:51.601728 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 9f080b4ca9894eae8305d1548010a6cb
I20260927 13:49:51.601958 5625 ts_tablet_manager.cc:1950] T c989f70385f64593a46f633c98267627 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:51.602146 4921 catalog_manager.cc:6934] ReplaceTablet: tablet 9f080b4ca9894eae8305d1548010a6cb deleted and replaced by tablet da5d9bda857f467da6930a6c64266f3a
I20260927 13:49:51.594081 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 06c810fde988439c97a8445fc88626b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 0191cfad4e7a4b088b2ecdc246bfa58a) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.603288 5628 tablet_bootstrap.cc:492] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:51.603492 5628 ts_tablet_manager.cc:1403] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.176s user 0.003s sys 0.006s
I20260927 13:49:51.603907 5623 ts_tablet_manager.cc:1929] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.604388 5628 raft_consensus.cc:359] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.604592 5628 raft_consensus.cc:385] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.604686 5628 raft_consensus.cc:740] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.604966 5628 consensus_queue.cc:260] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.605381 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f080b4ca9894eae8305d1548010a6cb with delete_type TABLET_DATA_DELETED (replaced by tablet da5d9bda857f467da6930a6c64266f3a) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.605923 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet cd4c568b96084baeb7438a4857adadc1 with delete_type TABLET_DATA_DELETED (replaced by tablet bb7b3a35b2e94bbea6be4b4a8f158593) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.607003 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 79514522a9d142438fd6aecc91f0463e from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:51.607419 5628 ts_tablet_manager.cc:1434] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260927 13:49:51.607725 5628 tablet_bootstrap.cc:492] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:51.607905 4926 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 1cc174eab36b46fb8e276b3168fbfbcd (table default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe]). Expected version 3 got 0
I20260927 13:49:51.610208 5628 tablet_bootstrap.cc:654] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.611079 5623 log.cc:1199] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/2c976a667e7c4b948b3aa176b13b7d0d
I20260927 13:49:51.612172 5623 ts_tablet_manager.cc:1950] T 2c976a667e7c4b948b3aa176b13b7d0d P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:51.614841 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 281) took 1693 ms. Trace:
I20260927 13:49:51.614974 5625 rpcz_store.cc:276] 0927 13:49:49.921682 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.922882 (+ 1200us) service_pool.cc:224] Handling call
0927 13:49:51.587318 (+1664436us) ts_tablet_manager.cc:1151] Deleting tablet c989f70385f64593a46f633c98267627
0927 13:49:51.587328 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.598055 (+ 10727us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.601366 (+ 3311us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.614804 (+ 13438us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1622026}
I20260927 13:49:51.615167 4929 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 1cc174eab36b46fb8e276b3168fbfbcd (table default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe]). Expected version 3 got 0
I20260927 13:49:51.615547 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 284) took 1693 ms. Trace:
I20260927 13:49:51.615653 5625 rpcz_store.cc:276] 0927 13:49:49.921993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:49.933938 (+ 11945us) service_pool.cc:224] Handling call
0927 13:49:51.615398 (+1681460us) ts_tablet_manager.cc:1151] Deleting tablet 059afd48ac4a41569ed1d3556b7974f0
0927 13:49:51.615407 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.615518 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1644748}
I20260927 13:49:51.618206 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 291) took 1615 ms. Trace:
I20260927 13:49:51.618330 5625 rpcz_store.cc:276] 0927 13:49:50.002951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.003668 (+ 717us) service_pool.cc:224] Handling call
0927 13:49:51.618035 (+1614367us) ts_tablet_manager.cc:1151] Deleting tablet fa9d09ca7952499ba135e15cecb1143e
0927 13:49:51.618045 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.618173 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1581433}
I20260927 13:49:51.619490 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 294) took 1605 ms. Trace:
I20260927 13:49:51.619607 5625 rpcz_store.cc:276] 0927 13:49:50.014273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.014396 (+ 123us) service_pool.cc:224] Handling call
0927 13:49:51.619362 (+1604966us) ts_tablet_manager.cc:1151] Deleting tablet 559ac90ef36d406881dc17ade0560044
0927 13:49:51.619371 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.619451 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1581777}
I20260927 13:49:51.620608 5626 tablet_bootstrap.cc:492] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:51.621101 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 299) took 1583 ms. Trace:
I20260927 13:49:51.621207 5625 rpcz_store.cc:276] 0927 13:49:50.037532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.037891 (+ 359us) service_pool.cc:224] Handling call
0927 13:49:51.620976 (+1583085us) ts_tablet_manager.cc:1151] Deleting tablet d1f9ae430c414cdf9370388d51dd7c63
0927 13:49:51.620985 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.621070 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1562013}
I20260927 13:49:51.622239 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 302) took 1417 ms. Trace:
I20260927 13:49:51.622372 5625 rpcz_store.cc:276] 0927 13:49:50.204869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.204940 (+ 71us) service_pool.cc:224] Handling call
0927 13:49:51.622086 (+1417146us) ts_tablet_manager.cc:1151] Deleting tablet 9bd182d7cb414f07944072b0c00ee35c
0927 13:49:51.622094 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.622209 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1416933}
I20260927 13:49:51.622589 4929 catalog_manager.cc:5838] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:51.623330 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 303) took 1326 ms. Trace:
I20260927 13:49:51.623121 4929 catalog_manager.cc:5838] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:51.623430 5625 rpcz_store.cc:276] 0927 13:49:50.297167 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.297221 (+ 54us) service_pool.cc:224] Handling call
0927 13:49:51.623212 (+1325991us) ts_tablet_manager.cc:1151] Deleting tablet f70b70eb29cb4361a12ed393eabb82e1
0927 13:49:51.623221 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.623298 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1325762}
I20260927 13:49:51.623952 4929 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1cc174eab36b46fb8e276b3168fbfbcd (table default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe]). Expected version 3 got 0
I20260927 13:49:51.624339 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 307) took 1213 ms. Trace:
I20260927 13:49:51.624261 4929 catalog_manager.cc:5838] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:51.624444 5625 rpcz_store.cc:276] 0927 13:49:50.410912 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.411235 (+ 323us) service_pool.cc:224] Handling call
0927 13:49:51.624190 (+1212955us) ts_tablet_manager.cc:1151] Deleting tablet 1245334728994a60ad641c2e90f8d2df
0927 13:49:51.624198 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.624311 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1205052}
I20260927 13:49:51.624588 4929 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (table default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]). Expected version 1 got 0
I20260927 13:49:51.625517 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 315) took 1206 ms. Trace:
I20260927 13:49:51.625617 5625 rpcz_store.cc:276] 0927 13:49:50.418893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.418960 (+ 67us) service_pool.cc:224] Handling call
0927 13:49:51.625400 (+1206440us) ts_tablet_manager.cc:1151] Deleting tablet 5e3fa4870d5547a2bbffe1745b964504
0927 13:49:51.625406 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.625491 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1206077}
I20260927 13:49:51.626555 5628 tablet_bootstrap.cc:492] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:51.626628 5626 tablet_bootstrap.cc:654] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.626745 5628 ts_tablet_manager.cc:1403] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.005s
I20260927 13:49:51.627619 5628 raft_consensus.cc:359] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.627893 5628 raft_consensus.cc:385] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.627969 5628 raft_consensus.cc:740] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.628226 5628 consensus_queue.cc:260] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.630349 5628 ts_tablet_manager.cc:1434] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:51.630677 5628 tablet_bootstrap.cc:492] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:51.633457 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 316) took 1212 ms. Trace:
I20260927 13:49:51.633574 5625 rpcz_store.cc:276] 0927 13:49:50.420639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.420739 (+ 100us) service_pool.cc:224] Handling call
0927 13:49:51.633320 (+1212581us) ts_tablet_manager.cc:1151] Deleting tablet f75847513dcf4c84913a4073176f2507
0927 13:49:51.633329 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.633425 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1212376}
I20260927 13:49:51.634821 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 317) took 1207 ms. Trace:
I20260927 13:49:51.634930 5625 rpcz_store.cc:276] 0927 13:49:50.427157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.427705 (+ 548us) service_pool.cc:224] Handling call
0927 13:49:51.634686 (+1206981us) ts_tablet_manager.cc:1151] Deleting tablet a7a97f4df3a84781bfcbdc768d518ef0
0927 13:49:51.634695 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.634792 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1199996}
I20260927 13:49:51.636428 5628 tablet_bootstrap.cc:654] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.637226 5619 tablet_bootstrap.cc:492] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:51.637418 5625 tablet_replica.cc:333] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:51.637404 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 296) took 1431 ms. Trace:
I20260927 13:49:51.637641 5625 raft_consensus.cc:2243] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.637550 5606 rpcz_store.cc:276] 0927 13:49:50.206416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.206552 (+ 136us) service_pool.cc:224] Handling call
0927 13:49:51.637202 (+1430650us) ts_tablet_manager.cc:1151] Deleting tablet 9bd182d7cb414f07944072b0c00ee35c
0927 13:49:51.637221 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.637336 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1362047}
I20260927 13:49:51.637814 5625 raft_consensus.cc:2272] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.638020 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 297) took 1343 ms. Trace:
I20260927 13:49:51.638151 5606 rpcz_store.cc:276] 0927 13:49:50.294945 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.295006 (+ 61us) service_pool.cc:224] Handling call
0927 13:49:51.637833 (+1342827us) ts_tablet_manager.cc:1151] Deleting tablet f70b70eb29cb4361a12ed393eabb82e1
0927 13:49:51.637842 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.637961 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1342595}
W20260927 13:49:51.638234 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 9bd182d7cb414f07944072b0c00ee35c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd182d7cb414f07944072b0c00ee35c already in progress: creating tablet
I20260927 13:49:51.638542 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 302) took 1262 ms. Trace:
I20260927 13:49:51.638562 5625 ts_tablet_manager.cc:1916] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.638628 5606 rpcz_store.cc:276] 0927 13:49:50.376114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.380351 (+ 4237us) service_pool.cc:224] Handling call
0927 13:49:51.638387 (+1258036us) ts_tablet_manager.cc:1151] Deleting tablet 1245334728994a60ad641c2e90f8d2df
0927 13:49:51.638396 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.638470 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1257817}
W20260927 13:49:51.638763 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet f70b70eb29cb4361a12ed393eabb82e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f70b70eb29cb4361a12ed393eabb82e1 already in progress: creating tablet
I20260927 13:49:51.638944 5606 tablet_replica.cc:333] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:51.639127 5606 raft_consensus.cc:2243] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:51.639158 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 1245334728994a60ad641c2e90f8d2df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1245334728994a60ad641c2e90f8d2df already in progress: creating tablet
I20260927 13:49:51.639349 5606 raft_consensus.cc:2272] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.639864 5606 ts_tablet_manager.cc:1916] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.643507 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet efd31e3dd142413c92fce2043e053d32 with delete_type TABLET_DATA_DELETED (replaced by tablet 11d48db9b20a41419d5be703190fadd8) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.644655 5628 tablet_bootstrap.cc:492] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:51.644797 5628 ts_tablet_manager.cc:1403] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260927 13:49:51.645083 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f5bf9ba5d857421ebc783d4c567f411c (table default.Table_71b0f958b1ec49bf9f334180403b5e3f [id=e84cfb4f1dc04be8928d31ded73197c1]) successfully deleted
I20260927 13:49:51.645644 5628 raft_consensus.cc:359] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.645836 5628 raft_consensus.cc:385] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.645934 5628 raft_consensus.cc:740] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.646201 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 2c976a667e7c4b948b3aa176b13b7d0d (table default.Table_3efafc6b184f4f73bd2b6fad23d8991c [id=d6e13461272741bb8e15183f5bc473d2]) successfully deleted
W20260927 13:49:51.646595 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 825a73d47bff4246965be82eb482f7aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 825a73d47bff4246965be82eb482f7aa already in progress: creating tablet
I20260927 13:49:51.646546 5628 consensus_queue.cc:260] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:51.646955 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet bb25bb5ee153494d803130f1ad4f7c2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb25bb5ee153494d803130f1ad4f7c2e already in progress: creating tablet
I20260927 13:49:51.648450 5628 ts_tablet_manager.cc:1434] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:49:51.648762 5628 tablet_bootstrap.cc:492] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:51.652639 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 79514522a9d142438fd6aecc91f0463e
I20260927 13:49:51.653152 4921 catalog_manager.cc:6934] ReplaceTablet: tablet 79514522a9d142438fd6aecc91f0463e deleted and replaced by tablet 23e3bb24afad4d789041b6a557512618
I20260927 13:49:51.654538 5628 tablet_bootstrap.cc:654] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.655217 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 79514522a9d142438fd6aecc91f0463e with delete_type TABLET_DATA_DELETED (replaced by tablet 23e3bb24afad4d789041b6a557512618) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.655759 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet efd31e3dd142413c92fce2043e053d32 with delete_type TABLET_DATA_DELETED (replaced by tablet 11d48db9b20a41419d5be703190fadd8) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.657083 5625 ts_tablet_manager.cc:1929] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.657232 5625 log.cc:1199] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/1f5dfa3e80454463908df19a49454764
I20260927 13:49:51.657635 5625 ts_tablet_manager.cc:1950] T 1f5dfa3e80454463908df19a49454764 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:51.637562 5619 ts_tablet_manager.cc:1403] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.167s user 0.004s sys 0.005s
I20260927 13:49:51.658509 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 329) took 1103 ms. Trace:
I20260927 13:49:51.658618 5625 rpcz_store.cc:276] 0927 13:49:50.559946 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.581636 (+ 21690us) service_pool.cc:224] Handling call
0927 13:49:51.637362 (+1055726us) ts_tablet_manager.cc:1151] Deleting tablet 1f5dfa3e80454463908df19a49454764
0927 13:49:51.637370 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.642574 (+ 5204us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.657010 (+ 14436us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.658448 (+ 1438us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1019759}
I20260927 13:49:51.659219 5625 tablet_replica.cc:333] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:51.659366 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 06c810fde988439c97a8445fc88626b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 0191cfad4e7a4b088b2ecdc246bfa58a) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.659442 5625 raft_consensus.cc:2243] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.659617 5625 raft_consensus.cc:2272] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.660164 5625 ts_tablet_manager.cc:1916] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.661218 5619 raft_consensus.cc:359] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.661492 5619 raft_consensus.cc:385] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.661604 5619 raft_consensus.cc:740] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.661947 5619 consensus_queue.cc:260] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.665138 5619 ts_tablet_manager.cc:1434] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260927 13:49:51.665521 5619 tablet_bootstrap.cc:492] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:51.667822 5628 tablet_bootstrap.cc:492] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:51.667992 5628 ts_tablet_manager.cc:1403] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260927 13:49:51.668757 5628 raft_consensus.cc:359] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.669019 5628 raft_consensus.cc:385] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.669102 5628 raft_consensus.cc:740] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.669375 5628 consensus_queue.cc:260] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.669855 5626 tablet_bootstrap.cc:492] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:51.670049 5626 ts_tablet_manager.cc:1403] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.071s user 0.010s sys 0.004s
I20260927 13:49:51.671177 5628 ts_tablet_manager.cc:1434] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:51.671480 5628 tablet_bootstrap.cc:492] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:51.673144 5628 tablet_bootstrap.cc:654] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.673756 5626 raft_consensus.cc:359] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.673962 5626 raft_consensus.cc:385] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.676743 5626 raft_consensus.cc:740] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.677455 5626 consensus_queue.cc:260] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.678328 5625 ts_tablet_manager.cc:1929] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.678454 5625 log.cc:1199] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b5cc71e06eb743d2b63e056e88a6498f
I20260927 13:49:51.678622 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 06c810fde988439c97a8445fc88626b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 0191cfad4e7a4b088b2ecdc246bfa58a) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.679531 5625 ts_tablet_manager.cc:1950] T b5cc71e06eb743d2b63e056e88a6498f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:51.680442 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 333) took 1094 ms. Trace:
I20260927 13:49:51.680559 5625 rpcz_store.cc:276] 0927 13:49:50.586602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.658709 (+ 72107us) service_pool.cc:224] Handling call
0927 13:49:51.659125 (+1000416us) ts_tablet_manager.cc:1151] Deleting tablet b5cc71e06eb743d2b63e056e88a6498f
0927 13:49:51.659134 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.663405 (+ 4271us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.678226 (+ 14821us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.680405 (+ 2179us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":986298}
I20260927 13:49:51.680846 5626 ts_tablet_manager.cc:1434] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 13:49:51.681974 5626 tablet_bootstrap.cc:492] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:49:51.682209 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 3700a1f40c0644848da62392cb0c297f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3700a1f40c0644848da62392cb0c297f already in progress: creating tablet
W20260927 13:49:51.682603 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 1efaf62692c545dcaa5175fcd826785a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1efaf62692c545dcaa5175fcd826785a already in progress: creating tablet
W20260927 13:49:51.682942 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 6ff7d501f7704e69b696053cb1b1ffe5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ff7d501f7704e69b696053cb1b1ffe5 already in progress: creating tablet
I20260927 13:49:51.683233 5628 tablet_bootstrap.cc:492] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:51.683377 5628 ts_tablet_manager.cc:1403] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.004s
I20260927 13:49:51.684087 5628 raft_consensus.cc:359] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.684283 5628 raft_consensus.cc:385] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.684376 5628 raft_consensus.cc:740] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.684604 5628 consensus_queue.cc:260] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:51.685232 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet efd31e3dd142413c92fce2043e053d32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efd31e3dd142413c92fce2043e053d32 already in progress: creating tablet
I20260927 13:49:51.686780 5628 ts_tablet_manager.cc:1434] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 13:49:51.687119 5628 tablet_bootstrap.cc:492] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:51.691175 5625 tablet_replica.cc:333] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:51.684823 4929 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (table default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]). Expected version 1 got 0
I20260927 13:49:51.691418 5625 raft_consensus.cc:2243] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:51.691571 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 06c810fde988439c97a8445fc88626b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06c810fde988439c97a8445fc88626b3 already in progress: creating tablet
I20260927 13:49:51.691609 5625 raft_consensus.cc:2272] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.692149 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet cd4c568b96084baeb7438a4857adadc1 with delete_type TABLET_DATA_DELETED (replaced by tablet bb7b3a35b2e94bbea6be4b4a8f158593) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.692200 5625 ts_tablet_manager.cc:1916] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.695060 5606 ts_tablet_manager.cc:1929] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.695163 5626 tablet_bootstrap.cc:654] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.695215 5606 log.cc:1199] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/bc8f6354c1034814af3cc20df25ddb47
I20260927 13:49:51.695427 5628 tablet_bootstrap.cc:654] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.696144 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f080b4ca9894eae8305d1548010a6cb with delete_type TABLET_DATA_DELETED (replaced by tablet da5d9bda857f467da6930a6c64266f3a) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.696936 4929 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (table default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]). Expected version 1 got 0
I20260927 13:49:51.697062 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 79514522a9d142438fd6aecc91f0463e with delete_type TABLET_DATA_DELETED (replaced by tablet 23e3bb24afad4d789041b6a557512618) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.697180 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet cd4c568b96084baeb7438a4857adadc1 with delete_type TABLET_DATA_DELETED (replaced by tablet bb7b3a35b2e94bbea6be4b4a8f158593) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.697506 5623 tablet_replica.cc:333] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:51.697700 5623 raft_consensus.cc:2243] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:51.698238 5623 raft_consensus.cc:2272] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.698939 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 4abe721ef8614d86870a0526de69014f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.699267 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f080b4ca9894eae8305d1548010a6cb with delete_type TABLET_DATA_DELETED (replaced by tablet da5d9bda857f467da6930a6c64266f3a) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.699364 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a6af740383384609a354d7f0fae2cd70 (table default.Table_de419f4cfd244caeaa7707f22194c5bd [id=1cceb2a28eac4398a1e8d1ddb8afd21b]) successfully deleted
I20260927 13:49:51.699659 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 79514522a9d142438fd6aecc91f0463e with delete_type TABLET_DATA_DELETED (replaced by tablet 23e3bb24afad4d789041b6a557512618) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.699880 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet c989f70385f64593a46f633c98267627 (table default.Table_2c9769bf8a394c8385b21e36bd7afe18 [id=3653a6192dca4f8b9df5f4862eb512a8]) successfully deleted
W20260927 13:49:51.700083 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 059afd48ac4a41569ed1d3556b7974f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 059afd48ac4a41569ed1d3556b7974f0 already in progress: creating tablet
W20260927 13:49:51.700273 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet fa9d09ca7952499ba135e15cecb1143e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa9d09ca7952499ba135e15cecb1143e already in progress: creating tablet
I20260927 13:49:51.700299 5623 ts_tablet_manager.cc:1916] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:51.700452 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 559ac90ef36d406881dc17ade0560044 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 559ac90ef36d406881dc17ade0560044 already in progress: creating tablet
W20260927 13:49:51.700688 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet d1f9ae430c414cdf9370388d51dd7c63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1f9ae430c414cdf9370388d51dd7c63 already in progress: creating tablet
I20260927 13:49:51.700698 5625 ts_tablet_manager.cc:1929] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.700824 5625 log.cc:1199] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/72711f14f26a479c9699b172b41b1db0
W20260927 13:49:51.700901 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 9bd182d7cb414f07944072b0c00ee35c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd182d7cb414f07944072b0c00ee35c already in progress: creating tablet
W20260927 13:49:51.701110 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet f70b70eb29cb4361a12ed393eabb82e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f70b70eb29cb4361a12ed393eabb82e1 already in progress: creating tablet
I20260927 13:49:51.701165 5625 ts_tablet_manager.cc:1950] T 72711f14f26a479c9699b172b41b1db0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:51.701301 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 1245334728994a60ad641c2e90f8d2df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1245334728994a60ad641c2e90f8d2df already in progress: creating tablet
W20260927 13:49:51.701519 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 5e3fa4870d5547a2bbffe1745b964504 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e3fa4870d5547a2bbffe1745b964504 already in progress: creating tablet
W20260927 13:49:51.701700 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet f75847513dcf4c84913a4073176f2507 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f75847513dcf4c84913a4073176f2507 already in progress: creating tablet
I20260927 13:49:51.701985 5625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 334) took 1112 ms. Trace:
I20260927 13:49:51.706172 5628 tablet_bootstrap.cc:492] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:51.706353 5628 ts_tablet_manager.cc:1403] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.004s
I20260927 13:49:51.707664 5628 raft_consensus.cc:359] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.707872 5628 raft_consensus.cc:385] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.707945 5628 raft_consensus.cc:740] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.708189 5628 consensus_queue.cc:260] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.710220 5628 ts_tablet_manager.cc:1434] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:51.710537 5628 tablet_bootstrap.cc:492] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:51.710795 5619 tablet_bootstrap.cc:654] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.712745 5606 ts_tablet_manager.cc:1950] T bc8f6354c1034814af3cc20df25ddb47 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:51.713486 5623 ts_tablet_manager.cc:1929] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:51.702069 5625 rpcz_store.cc:276] 0927 13:49:50.589942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.664537 (+ 74595us) service_pool.cc:224] Handling call
0927 13:49:51.691114 (+1026577us) ts_tablet_manager.cc:1151] Deleting tablet 72711f14f26a479c9699b172b41b1db0
0927 13:49:51.691124 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.696942 (+ 5818us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.700632 (+ 3690us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.701934 (+ 1302us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1016331}
I20260927 13:49:51.714457 5623 log.cc:1199] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/cd4c568b96084baeb7438a4857adadc1
I20260927 13:49:51.714943 5625 tablet_replica.cc:333] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:51.715132 5625 raft_consensus.cc:2243] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.715301 5625 raft_consensus.cc:2272] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.715797 5625 ts_tablet_manager.cc:1916] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.715919 5623 ts_tablet_manager.cc:1950] T cd4c568b96084baeb7438a4857adadc1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:51.716650 5628 tablet_bootstrap.cc:654] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.718189 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 308) took 1265 ms. Trace:
I20260927 13:49:51.718331 5606 rpcz_store.cc:276] 0927 13:49:50.449713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.449848 (+ 135us) service_pool.cc:224] Handling call
0927 13:49:51.638851 (+1189003us) ts_tablet_manager.cc:1151] Deleting tablet bc8f6354c1034814af3cc20df25ddb47
0927 13:49:51.638859 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.653070 (+ 14211us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.688328 (+ 35258us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.714859 (+ 26531us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1187288}
I20260927 13:49:51.718901 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet bc8f6354c1034814af3cc20df25ddb47 (table default.Table_e6eff4f97e084636b5609c6c269cf5ec [id=4f32d603a6764a359605a945c924f6c5]) successfully deleted
I20260927 13:49:51.718976 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 310) took 1254 ms. Trace:
I20260927 13:49:51.719084 5606 rpcz_store.cc:276] 0927 13:49:50.464583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.464653 (+ 70us) service_pool.cc:224] Handling call
0927 13:49:51.718816 (+1254163us) ts_tablet_manager.cc:1151] Deleting tablet f75847513dcf4c84913a4073176f2507
0927 13:49:51.718827 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.718942 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1242269}
W20260927 13:49:51.719568 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet f75847513dcf4c84913a4073176f2507 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f75847513dcf4c84913a4073176f2507 already in progress: creating tablet
I20260927 13:49:51.719636 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 309) took 1269 ms. Trace:
I20260927 13:49:51.719734 5606 rpcz_store.cc:276] 0927 13:49:50.450579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.450663 (+ 84us) service_pool.cc:224] Handling call
0927 13:49:51.719509 (+1268846us) ts_tablet_manager.cc:1151] Deleting tablet 5e3fa4870d5547a2bbffe1745b964504
0927 13:49:51.719521 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.719606 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1242878}
W20260927 13:49:51.720088 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 5e3fa4870d5547a2bbffe1745b964504 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e3fa4870d5547a2bbffe1745b964504 already in progress: creating tablet
I20260927 13:49:51.720189 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 311) took 1238 ms. Trace:
I20260927 13:49:51.720296 5606 rpcz_store.cc:276] 0927 13:49:50.483336 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.483396 (+ 60us) service_pool.cc:224] Handling call
0927 13:49:51.720084 (+1236688us) ts_tablet_manager.cc:1151] Deleting tablet a7a97f4df3a84781bfcbdc768d518ef0
0927 13:49:51.720092 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.720162 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1232883}
I20260927 13:49:51.720758 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 327) took 1212 ms. Trace:
I20260927 13:49:51.720893 5606 rpcz_store.cc:276] 0927 13:49:50.508339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.531160 (+ 22821us) service_pool.cc:224] Handling call
0927 13:49:51.720645 (+1189485us) ts_tablet_manager.cc:1151] Deleting tablet b5cc71e06eb743d2b63e056e88a6498f
0927 13:49:51.720653 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.720728 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1154209}
I20260927 13:49:51.721329 5606 tablet_replica.cc:333] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
W20260927 13:49:51.721309 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b5cc71e06eb743d2b63e056e88a6498f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5cc71e06eb743d2b63e056e88a6498f already in progress: creating tablet
I20260927 13:49:51.721571 5606 raft_consensus.cc:2243] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.721792 5606 raft_consensus.cc:2272] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.722678 5606 ts_tablet_manager.cc:1916] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.726862 5625 ts_tablet_manager.cc:1929] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.726997 5625 log.cc:1199] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/dae5f63f709f455b8eceb44771845a3f
I20260927 13:49:51.727320 5625 ts_tablet_manager.cc:1950] T dae5f63f709f455b8eceb44771845a3f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:51.727391 5623 tablet_replica.cc:333] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:51.727903 5623 raft_consensus.cc:2243] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:51.728649 5623 raft_consensus.cc:2272] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.729835 5628 tablet_bootstrap.cc:492] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:51.729977 5628 ts_tablet_manager.cc:1403] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.003s
I20260927 13:49:51.730933 5628 raft_consensus.cc:359] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.731146 5628 raft_consensus.cc:385] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.731251 5628 raft_consensus.cc:740] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.731817 5628 consensus_queue.cc:260] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.734035 5623 ts_tablet_manager.cc:1916] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.734545 5628 ts_tablet_manager.cc:1434] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260927 13:49:51.734913 5628 tablet_bootstrap.cc:492] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:51.736528 5628 tablet_bootstrap.cc:654] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.740037 5626 tablet_bootstrap.cc:492] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:51.740303 5626 ts_tablet_manager.cc:1403] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.059s user 0.005s sys 0.001s
I20260927 13:49:51.741066 5625 tablet_replica.cc:333] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:51.741295 5625 raft_consensus.cc:2243] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.741472 5625 raft_consensus.cc:2272] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.742007 5625 ts_tablet_manager.cc:1916] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.742060 5626 raft_consensus.cc:359] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.742452 5626 raft_consensus.cc:385] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.742442 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 1f5dfa3e80454463908df19a49454764 (table default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]) successfully deleted
I20260927 13:49:51.742616 5626 raft_consensus.cc:740] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.742652 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b5cc71e06eb743d2b63e056e88a6498f (table default.Table_48a5fac9ec3d40c4a4b405f925a74326 [id=935f2e2df32c46e58760dba62709c181]) successfully deleted
I20260927 13:49:51.743000 5626 consensus_queue.cc:260] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.743258 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 72711f14f26a479c9699b172b41b1db0 (table default.Table_9fd82aceaf6d491facc37c309420e9ed [id=aa9bfeb5b20c499d9897f950fa6db2a9]) successfully deleted
W20260927 13:49:51.743474 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 84d9c94ee0af46e8aea12adac57829f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84d9c94ee0af46e8aea12adac57829f7 already in progress: creating tablet
I20260927 13:49:51.743678 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet dae5f63f709f455b8eceb44771845a3f (table default.Table_f1bd6c5f7d1c40e4b4898befde87e9a0 [id=76f4e4598d75471f806ae3f3efa2f104]) successfully deleted
I20260927 13:49:51.744305 5626 ts_tablet_manager.cc:1434] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:49:51.744338 4926 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 17153df5ba20458aa0a5c0297e959810 (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
W20260927 13:49:51.743885 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 3a07adcd33414d18ae9720e7a307548a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a07adcd33414d18ae9720e7a307548a already in progress: creating tablet
W20260927 13:49:51.746004 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b5a9f864e4274666a86baed43e1623cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5a9f864e4274666a86baed43e1623cd already in progress: creating tablet
W20260927 13:49:51.746323 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet e730a00ad2e646a4ba594ba9434c3b50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e730a00ad2e646a4ba594ba9434c3b50 already in progress: creating tablet
I20260927 13:49:51.746482 5628 tablet_bootstrap.cc:492] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:51.746656 5628 ts_tablet_manager.cc:1403] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.001s
W20260927 13:49:51.746665 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet ec40378eb80c412198d5b66c02e975ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec40378eb80c412198d5b66c02e975ef already in progress: creating tablet
I20260927 13:49:51.746925 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet c2fc2734e88e431facdf72e9ef136106 (table default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e]). Expected version 2 got 0
I20260927 13:49:51.747023 5626 tablet_bootstrap.cc:492] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:51.747534 5628 raft_consensus.cc:359] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.747745 5628 raft_consensus.cc:385] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.747840 5628 raft_consensus.cc:740] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.748100 5619 tablet_bootstrap.cc:492] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:51.748109 5628 consensus_queue.cc:260] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.748368 5619 ts_tablet_manager.cc:1403] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.083s user 0.005s sys 0.000s
I20260927 13:49:51.748708 5628 ts_tablet_manager.cc:1434] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:51.748870 5626 tablet_bootstrap.cc:654] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.749001 5628 tablet_bootstrap.cc:492] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:51.749385 5619 raft_consensus.cc:359] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.749611 5619 raft_consensus.cc:385] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.749742 5619 raft_consensus.cc:740] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.750069 5619 consensus_queue.cc:260] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.750988 5628 tablet_bootstrap.cc:654] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.753242 5619 ts_tablet_manager.cc:1434] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:49:51.756210 6127 raft_consensus.cc:493] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:51.756372 6127 raft_consensus.cc:515] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.756456 4926 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a443f65eba384b998fdc57ec57e37d87 (table default.Table_43b89b55155b4b51ab4b271a93f30d59 [id=f7a31bf57f1245cab85dd2c38d85c79f]). Expected version 2 got 0
I20260927 13:49:51.757094 6127 leader_election.cc:290] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:51.753597 5619 tablet_bootstrap.cc:492] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:51.754009 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 3ee18063dc634385b9e61fae3b3ece99 (DEFAULT_TABLE table=default.Table_0fb429f4425443cf828065d29ef97f10 [id=51e5eb6e824a402a8eaecca7f2516a71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.758610 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ee18063dc634385b9e61fae3b3ece99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.758864 5625 ts_tablet_manager.cc:1929] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.759008 5625 log.cc:1199] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/825a73d47bff4246965be82eb482f7aa
I20260927 13:49:51.759140 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "351132ca12924a35910ca5473696a02f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:51.759423 5625 ts_tablet_manager.cc:1950] T 825a73d47bff4246965be82eb482f7aa P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:51.746948 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 3933c0a2fd6547f28528fae7d443a2c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3933c0a2fd6547f28528fae7d443a2c1 already in progress: creating tablet
W20260927 13:49:51.760648 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 56b9612ffea543b9b0779c46533d91ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56b9612ffea543b9b0779c46533d91ab already in progress: creating tablet
I20260927 13:49:51.760885 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 825a73d47bff4246965be82eb482f7aa (table default.Table_de911651b6ff4188876ef1d412e041b7 [id=119de2adb4d24563b76c6099dec2d9a9]) successfully deleted
I20260927 13:49:51.761592 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 2329b988f5d9410d96eca321a7b8f3a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ac23ce85393457e8fd5402a9e0f55cb) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.761782 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 3ee18063dc634385b9e61fae3b3ece99 (DEFAULT_TABLE table=default.Table_0fb429f4425443cf828065d29ef97f10 [id=51e5eb6e824a402a8eaecca7f2516a71]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:51.761936 5044 leader_election.cc:343] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.762230 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ee18063dc634385b9e61fae3b3ece99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.762873 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 880ce1300eac40b28aac8cba3e11077e (DEFAULT_TABLE table=default.Table_f467eb34e5ed44eaa26bde85eded8dac [id=9e720c8c230f4fc28ea64071767c6ebc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.763231 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880ce1300eac40b28aac8cba3e11077e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.762666 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "351132ca12924a35910ca5473696a02f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:51.764226 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 98e2e305b92a4492a0df14a506c768f3 (DEFAULT_TABLE table=default.Table_97f900bc6c8b4b829da15d428de9e4ed [id=6790f313d1d64f38a77d52eebd7ca586]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:51.764339 5045 leader_election.cc:343] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.764487 5045 leader_election.cc:304] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:51.764564 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e2e305b92a4492a0df14a506c768f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.764874 5625 tablet_replica.cc:333] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:51.764955 6127 raft_consensus.cc:2749] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:51.765094 5625 raft_consensus.cc:2243] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.765439 5625 raft_consensus.cc:2272] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.767144 5625 ts_tablet_manager.cc:1916] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.768599 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet c2fc2734e88e431facdf72e9ef136106 (table default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e]). Expected version 2 got 0
I20260927 13:49:51.770529 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 2999bd61907847938975a6232e3899e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.779947 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 3ee18063dc634385b9e61fae3b3ece99 (DEFAULT_TABLE table=default.Table_0fb429f4425443cf828065d29ef97f10 [id=51e5eb6e824a402a8eaecca7f2516a71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.780376 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ee18063dc634385b9e61fae3b3ece99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.782829 5625 ts_tablet_manager.cc:1929] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:51.782979 5625 log.cc:1199] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/cd4c568b96084baeb7438a4857adadc1
I20260927 13:49:51.783412 5625 ts_tablet_manager.cc:1950] T cd4c568b96084baeb7438a4857adadc1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:51.786960 5625 tablet_replica.cc:333] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:51.787222 5625 raft_consensus.cc:2243] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.787427 5625 raft_consensus.cc:2272] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.788074 5625 ts_tablet_manager.cc:1916] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.788164 5626 tablet_bootstrap.cc:492] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:51.788436 5626 ts_tablet_manager.cc:1403] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20260927 13:49:51.789312 5626 raft_consensus.cc:359] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.789537 5626 raft_consensus.cc:385] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.789647 5626 raft_consensus.cc:740] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.789891 5626 consensus_queue.cc:260] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:51.790561 5626 ts_tablet_manager.cc:1434] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:49:51.791726 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 98e2e305b92a4492a0df14a506c768f3 (DEFAULT_TABLE table=default.Table_97f900bc6c8b4b829da15d428de9e4ed [id=6790f313d1d64f38a77d52eebd7ca586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.792055 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 8aeb0c2c2be04a598e011a9d99c5492a (DEFAULT_TABLE table=default.Table_1331333f8b0a40f9961974e3407260ca [id=8597c2e7f8244b97bc7b72adca1158bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.792526 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aeb0c2c2be04a598e011a9d99c5492a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.792722 5626 tablet_bootstrap.cc:492] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:51.794636 5626 tablet_bootstrap.cc:654] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.795606 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 2999bd61907847938975a6232e3899e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.795852 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e2e305b92a4492a0df14a506c768f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.796423 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 559ac90ef36d406881dc17ade0560044 with delete_type TABLET_DATA_DELETED (replaced by tablet 3afb800e7ff44aadaed8f8d85aa9efe2) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.799134 5353 tablet_service.cc:1511] Processing CreateTablet for tablet b1a98e712fb3492f9e4ebccfd489c16f (DEFAULT_TABLE table=default.Table_01b5b7db6ed64c46907e0527b4ccede2 [id=e050655a2d464b36bff5cd05c1ec4228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.799893 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 321b26c89f1a4c8d88f401c8ece448b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.800045 5625 ts_tablet_manager.cc:1929] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 13:49:51.800236 5356 tablet_service.cc:1511] Processing CreateTablet for tablet ec130d31f6274fd9b730c2bb8bba817e (DEFAULT_TABLE table=default.Table_6ca18492261b4eac898eb7838d59e717 [id=aea372366a9b4cb19097683fc81c1793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.801157 5625 log.cc:1199] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/79514522a9d142438fd6aecc91f0463e
I20260927 13:49:51.801631 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet f70b70eb29cb4361a12ed393eabb82e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:51.802160 5625 ts_tablet_manager.cc:1950] T 79514522a9d142438fd6aecc91f0463e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:51.802735 5623 ts_tablet_manager.cc:1929] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 13:49:51.802757 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 98e2e305b92a4492a0df14a506c768f3 (DEFAULT_TABLE table=default.Table_97f900bc6c8b4b829da15d428de9e4ed [id=6790f313d1d64f38a77d52eebd7ca586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.802942 5623 log.cc:1199] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/79514522a9d142438fd6aecc91f0463e
I20260927 13:49:51.803221 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e2e305b92a4492a0df14a506c768f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.803438 5623 ts_tablet_manager.cc:1950] T 79514522a9d142438fd6aecc91f0463e P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:51.803892 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 880ce1300eac40b28aac8cba3e11077e (DEFAULT_TABLE table=default.Table_f467eb34e5ed44eaa26bde85eded8dac [id=9e720c8c230f4fc28ea64071767c6ebc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.804246 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880ce1300eac40b28aac8cba3e11077e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.804646 5623 tablet_replica.cc:333] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:51.804849 5623 raft_consensus.cc:2243] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.805071 5623 raft_consensus.cc:2272] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.806012 5623 ts_tablet_manager.cc:1916] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.811300 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a98e712fb3492f9e4ebccfd489c16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.811805 5350 tablet_service.cc:1511] Processing CreateTablet for tablet bb7b3a35b2e94bbea6be4b4a8f158593 (DEFAULT_TABLE table=default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.812829 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]) successfully deleted
I20260927 13:49:51.804430 5625 tablet_replica.cc:333] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:51.806703 5628 tablet_bootstrap.cc:492] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:51.814227 5628 ts_tablet_manager.cc:1403] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.065s user 0.006s sys 0.010s
I20260927 13:49:51.815056 5628 raft_consensus.cc:359] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.815239 5628 raft_consensus.cc:385] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.813536 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f62fc7820ff54165afff30f8e47b56ab" } modify_external_catalogs: true
I20260927 13:49:51.813809 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_97f900bc6c8b4b829da15d428de9e4ed" } modify_external_catalogs: true
I20260927 13:49:51.815326 5628 raft_consensus.cc:740] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.815491 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_97f900bc6c8b4b829da15d428de9e4ed" } modify_external_catalogs: true
I20260927 13:49:51.815546 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f62fc7820ff54165afff30f8e47b56ab" } modify_external_catalogs: true
I20260927 13:49:51.815555 5628 consensus_queue.cc:260] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.816107 5628 ts_tablet_manager.cc:1434] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:51.816404 5628 tablet_bootstrap.cc:492] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:51.817272 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d60c38242e1e4cd58bfa63d7e986be02" } new_table_name: "default.Table_8e14804c24074e6fb0535144048886aa" modify_external_catalogs: true
W20260927 13:49:51.817673 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 9f080b4ca9894eae8305d1548010a6cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f080b4ca9894eae8305d1548010a6cb already in progress: creating tablet
I20260927 13:49:51.818019 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 79514522a9d142438fd6aecc91f0463e (table default.Table_977d1a0483e64f658c2eaead2cc16803 [id=59df0a1ee3ea43e8ac991b38717c1549]) successfully deleted
I20260927 13:49:51.818087 5628 tablet_bootstrap.cc:654] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.818662 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e5f8007fdae74bbe92a5c011cf80f361"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:51.818956 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 880ce1300eac40b28aac8cba3e11077e (DEFAULT_TABLE table=default.Table_f467eb34e5ed44eaa26bde85eded8dac [id=9e720c8c230f4fc28ea64071767c6ebc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:51.819181 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5f8007fdae74bbe92a5c011cf80f361 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.820502 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c193f6d7a86a41b58650b5be4520226d" } modify_external_catalogs: true
I20260927 13:49:51.820681 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880ce1300eac40b28aac8cba3e11077e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.820654 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c193f6d7a86a41b58650b5be4520226d" } modify_external_catalogs: true
I20260927 13:49:51.823107 5625 raft_consensus.cc:2243] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:51.823988 5625 raft_consensus.cc:2272] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:51.827636 5625 ts_tablet_manager.cc:1916] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:51.834517 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3f7e50c133694889a2ff545f1123eae9" } new_table_name: "default.Table_3b7666d87acf47bda3e3e2545c8cfb25" modify_external_catalogs: true
I20260927 13:49:51.836158 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.836700 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.837330 5626 tablet_bootstrap.cc:492] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:51.837493 5626 ts_tablet_manager.cc:1403] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260927 13:49:51.838675 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d2afdbaf831c4583a90a5f11927eae11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:51.838708 5082 tablet_service.cc:1511] Processing CreateTablet for tablet b1a98e712fb3492f9e4ebccfd489c16f (DEFAULT_TABLE table=default.Table_01b5b7db6ed64c46907e0527b4ccede2 [id=e050655a2d464b36bff5cd05c1ec4228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.838721 5626 raft_consensus.cc:359] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:51.839004 5626 raft_consensus.cc:385] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.839087 5626 raft_consensus.cc:740] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.839138 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a98e712fb3492f9e4ebccfd489c16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.839397 5626 consensus_queue.cc:260] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:51.841259 5626 ts_tablet_manager.cc:1434] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260927 13:49:51.841584 5626 tablet_bootstrap.cc:492] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:51.845391 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 98e2e305b92a4492a0df14a506c768f3
I20260927 13:49:51.847374 6127 raft_consensus.cc:493] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:51.847530 6127 raft_consensus.cc:515] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.848110 6127 leader_election.cc:290] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:51.851493 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet f702b0a6380543a8ac539125d4334cd5
I20260927 13:49:51.851562 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17153df5ba20458aa0a5c0297e959810" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:51.851954 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 0191cfad4e7a4b088b2ecdc246bfa58a (DEFAULT_TABLE table=default.Table_2bf1c8729308443bba92997d06f84e9e [id=861ae0d96dd54f1dac15e3cce0ed657a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:51.852288 5045 leader_election.cc:343] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.852507 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec130d31f6274fd9b730c2bb8bba817e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.853101 5364 tablet_service.cc:1511] Processing CreateTablet for tablet b3fbf1e7f5e04122a65f6e192ffdae20 (DEFAULT_TABLE table=default.Table_3614a1889eea43b39d1d94a3211a5473 [id=28c69a82f6db4ae5a5a5f6a608f0c899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.853614 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ac4b7b0394ef4ce3ac5edea4fd99227f" } new_table_name: "default.Table_cacde3a39927479095e38a677172ee0f" modify_external_catalogs: true
I20260927 13:49:51.856464 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17153df5ba20458aa0a5c0297e959810" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:51.857726 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 (DEFAULT_TABLE table=default.Table_473c4114525b4bea85fd83367cd4c376 [id=2c3a6aa3a59242ab831f9a72740f8879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.857857 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0191cfad4e7a4b088b2ecdc246bfa58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.860234 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 8aeb0c2c2be04a598e011a9d99c5492a (DEFAULT_TABLE table=default.Table_1331333f8b0a40f9961974e3407260ca [id=8597c2e7f8244b97bc7b72adca1158bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.861024 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aeb0c2c2be04a598e011a9d99c5492a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:51.863183 5044 leader_election.cc:343] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.863370 5044 leader_election.cc:304] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:51.863709 6127 raft_consensus.cc:2749] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:51.864415 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_13777f8bd8dc43b6b1da8868bbdc5e40" } modify_external_catalogs: true
I20260927 13:49:51.864604 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_13777f8bd8dc43b6b1da8868bbdc5e40" } modify_external_catalogs: true
I20260927 13:49:51.868736 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 8aeb0c2c2be04a598e011a9d99c5492a (DEFAULT_TABLE table=default.Table_1331333f8b0a40f9961974e3407260ca [id=8597c2e7f8244b97bc7b72adca1158bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.869378 5215 tablet_service.cc:1511] Processing CreateTablet for tablet ec130d31f6274fd9b730c2bb8bba817e (DEFAULT_TABLE table=default.Table_6ca18492261b4eac898eb7838d59e717 [id=aea372366a9b4cb19097683fc81c1793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.869516 5080 tablet_service.cc:1511] Processing CreateTablet for tablet ec130d31f6274fd9b730c2bb8bba817e (DEFAULT_TABLE table=default.Table_6ca18492261b4eac898eb7838d59e717 [id=aea372366a9b4cb19097683fc81c1793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.869793 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec130d31f6274fd9b730c2bb8bba817e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.870167 5075 tablet_service.cc:1511] Processing CreateTablet for tablet bb7b3a35b2e94bbea6be4b4a8f158593 (DEFAULT_TABLE table=default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.870275 6127 raft_consensus.cc:493] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:51.870430 6127 raft_consensus.cc:515] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.870764 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 0191cfad4e7a4b088b2ecdc246bfa58a (DEFAULT_TABLE table=default.Table_2bf1c8729308443bba92997d06f84e9e [id=861ae0d96dd54f1dac15e3cce0ed657a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.871124 6127 leader_election.cc:290] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:51.871371 5085 tablet_service.cc:1511] Processing CreateTablet for tablet b3fbf1e7f5e04122a65f6e192ffdae20 (DEFAULT_TABLE table=default.Table_3614a1889eea43b39d1d94a3211a5473 [id=28c69a82f6db4ae5a5a5f6a608f0c899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.871858 5070 tablet_service.cc:1511] Processing CreateTablet for tablet da5d9bda857f467da6930a6c64266f3a (DEFAULT_TABLE table=default.Table_3e9c701f47c14f53a3e9d39d0ec63a7d [id=42bfb85e0c8f425ea04c34b94ec24c58]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:51.872157 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2afdbaf831c4583a90a5f11927eae11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.873104 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2329b988f5d9410d96eca321a7b8f3a6" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:51.873725 5044 leader_election.cc:343] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.874460 5222 tablet_service.cc:1511] Processing CreateTablet for tablet bb7b3a35b2e94bbea6be4b4a8f158593 (DEFAULT_TABLE table=default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.875414 5223 tablet_service.cc:1511] Processing CreateTablet for tablet b3fbf1e7f5e04122a65f6e192ffdae20 (DEFAULT_TABLE table=default.Table_3614a1889eea43b39d1d94a3211a5473 [id=28c69a82f6db4ae5a5a5f6a608f0c899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.875962 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 0191cfad4e7a4b088b2ecdc246bfa58a (DEFAULT_TABLE table=default.Table_2bf1c8729308443bba92997d06f84e9e [id=861ae0d96dd54f1dac15e3cce0ed657a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.876353 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7b3a35b2e94bbea6be4b4a8f158593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.878441 5221 tablet_service.cc:1511] Processing CreateTablet for tablet b1a98e712fb3492f9e4ebccfd489c16f (DEFAULT_TABLE table=default.Table_01b5b7db6ed64c46907e0527b4ccede2 [id=e050655a2d464b36bff5cd05c1ec4228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.879016 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a98e712fb3492f9e4ebccfd489c16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.880414 5227 tablet_service.cc:1511] Processing CreateTablet for tablet da5d9bda857f467da6930a6c64266f3a (DEFAULT_TABLE table=default.Table_3e9c701f47c14f53a3e9d39d0ec63a7d [id=42bfb85e0c8f425ea04c34b94ec24c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.880769 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5d9bda857f467da6930a6c64266f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.882256 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet f702b0a6380543a8ac539125d4334cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.884708 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0191cfad4e7a4b088b2ecdc246bfa58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.884955 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 98e2e305b92a4492a0df14a506c768f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.885869 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f439e2a6434440ef981d41bcd6ef33c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:51.886046 5347 tablet_service.cc:1511] Processing CreateTablet for tablet da5d9bda857f467da6930a6c64266f3a (DEFAULT_TABLE table=default.Table_3e9c701f47c14f53a3e9d39d0ec63a7d [id=42bfb85e0c8f425ea04c34b94ec24c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.890853 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fbf1e7f5e04122a65f6e192ffdae20. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:51.890842 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 931a48792f4c4525bd563a4dd1062e35 consensus state has no leader
W20260927 13:49:51.891530 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 6ff7d501f7704e69b696053cb1b1ffe5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ff7d501f7704e69b696053cb1b1ffe5 already in progress: creating tablet
I20260927 13:49:51.892073 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12dd91ddaeff4f2a9d7a0761c08fc192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.875116 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (DEFAULT_TABLE table=default.Table_3f1356fe7e4340d99b696cace4f9a6a1 [id=b7649e0adc2e4b6c82afa8d846d54aa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.894569 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aeb0c2c2be04a598e011a9d99c5492a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.894851 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5d9bda857f467da6930a6c64266f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.898566 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fbf1e7f5e04122a65f6e192ffdae20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.899482 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0191cfad4e7a4b088b2ecdc246bfa58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.900395 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7b3a35b2e94bbea6be4b4a8f158593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.900490 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fdacca4b5bd4afb95c83f6c72091b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.901396 5619 tablet_bootstrap.cc:654] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.901769 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec130d31f6274fd9b730c2bb8bba817e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.905373 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2329b988f5d9410d96eca321a7b8f3a6" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:51.907049 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 11d48db9b20a41419d5be703190fadd8 (DEFAULT_TABLE table=default.Table_5dfc30791e4347db940f164882d547d7 [id=4999b783a5ec458a8af3fbd21cf3ea5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.908582 5626 tablet_bootstrap.cc:654] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:51.909438 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5d9bda857f467da6930a6c64266f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.913270 5623 ts_tablet_manager.cc:1929] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.915740 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d48db9b20a41419d5be703190fadd8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:51.918140 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f439e2a6434440ef981d41bcd6ef33c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:51.919265 5045 leader_election.cc:343] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:51.919469 5045 leader_election.cc:304] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:51.919863 6127 raft_consensus.cc:2749] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:51.925526 5623 log.cc:1199] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/2999bd61907847938975a6232e3899e4
I20260927 13:49:51.926064 5623 ts_tablet_manager.cc:1950] T 2999bd61907847938975a6232e3899e4 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
W20260927 13:49:51.933547 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 1efaf62692c545dcaa5175fcd826785a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1efaf62692c545dcaa5175fcd826785a already in progress: creating tablet
W20260927 13:49:51.933986 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 3700a1f40c0644848da62392cb0c297f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3700a1f40c0644848da62392cb0c297f already in progress: creating tablet
I20260927 13:49:51.935031 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_00a670601e1d4a509989647bb84ca8cd" } new_table_name: "default.Table_a02033f4b12c4cdd986cd855cb148309" modify_external_catalogs: true
I20260927 13:49:51.937242 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fbf1e7f5e04122a65f6e192ffdae20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.935055 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f5e45d5a82894bd3a24dc602992d9aba" } modify_external_catalogs: true
I20260927 13:49:51.921257 5626 tablet_bootstrap.cc:492] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:51.938079 5626 ts_tablet_manager.cc:1403] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.097s user 0.003s sys 0.000s
I20260927 13:49:51.939639 5626 raft_consensus.cc:359] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.939863 5626 raft_consensus.cc:385] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:51.939960 5626 raft_consensus.cc:740] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:51.940207 5626 consensus_queue.cc:260] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:51.940713 5626 ts_tablet_manager.cc:1434] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:51.941345 5626 tablet_bootstrap.cc:492] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:49:51.942965 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet bb25bb5ee153494d803130f1ad4f7c2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb25bb5ee153494d803130f1ad4f7c2e already in progress: creating tablet
W20260927 13:49:51.943284 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet efd31e3dd142413c92fce2043e053d32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efd31e3dd142413c92fce2043e053d32 already in progress: creating tablet
I20260927 13:49:51.950948 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7b3a35b2e94bbea6be4b4a8f158593. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:51.951237 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 06c810fde988439c97a8445fc88626b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06c810fde988439c97a8445fc88626b3 already in progress: creating tablet
I20260927 13:49:51.951591 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]) successfully deleted
W20260927 13:49:51.951825 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 9f080b4ca9894eae8305d1548010a6cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f080b4ca9894eae8305d1548010a6cb already in progress: creating tablet
I20260927 13:49:51.952524 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 79514522a9d142438fd6aecc91f0463e (table default.Table_977d1a0483e64f658c2eaead2cc16803 [id=59df0a1ee3ea43e8ac991b38717c1549]) successfully deleted
I20260927 13:49:51.953483 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (DEFAULT_TABLE table=default.Table_3f1356fe7e4340d99b696cace4f9a6a1 [id=b7649e0adc2e4b6c82afa8d846d54aa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.953891 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fdacca4b5bd4afb95c83f6c72091b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.960331 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f5e45d5a82894bd3a24dc602992d9aba" } modify_external_catalogs: true
I20260927 13:49:51.962555 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 (DEFAULT_TABLE table=default.Table_473c4114525b4bea85fd83367cd4c376 [id=2c3a6aa3a59242ab831f9a72740f8879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.962939 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12dd91ddaeff4f2a9d7a0761c08fc192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:51.968367 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fab1230046a44991874933aff1c03068" } new_table_name: "default.Table_a9c7908f36d44d36af173f11ac4f1036" modify_external_catalogs: true
W20260927 13:49:51.969024 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6985779674646f4abe18cdf7c063c90 consensus state has no leader
I20260927 13:49:51.969583 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_74b6e15654414f29ad685955a2c8bd3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:51.969755 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_bc37738823ef4e37a87cc856bf9bfbab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.970217 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc37738823ef4e37a87cc856bf9bfbab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.970372 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet e25f5898369f46fba32b7df27b334b28
I20260927 13:49:51.971225 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c5e936d61fc244cfb11cf0cc7e465df1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.971735 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5e936d61fc244cfb11cf0cc7e465df1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.973289 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_15989a15160f4cb5b6809d139795ed4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.973737 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15989a15160f4cb5b6809d139795ed4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.974865 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2885e0829d014765b54124a0eb23a4dc
I20260927 13:49:51.975535 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8a9f7c16b9ec4d10848c2bb0c661fe27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:51.976025 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a9f7c16b9ec4d10848c2bb0c661fe27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.976078 5606 ts_tablet_manager.cc:1929] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:51.976475 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 98e2e305b92a4492a0df14a506c768f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.977208 5606 log.cc:1199] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/72711f14f26a479c9699b172b41b1db0
I20260927 13:49:51.978312 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet f702b0a6380543a8ac539125d4334cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.979102 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 11d48db9b20a41419d5be703190fadd8 (DEFAULT_TABLE table=default.Table_5dfc30791e4347db940f164882d547d7 [id=4999b783a5ec458a8af3fbd21cf3ea5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.979542 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d48db9b20a41419d5be703190fadd8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:51.986958 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74b6e15654414f29ad685955a2c8bd3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:51.987221 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 72711f14f26a479c9699b172b41b1db0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:51.987798 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (DEFAULT_TABLE table=default.Table_3f1356fe7e4340d99b696cace4f9a6a1 [id=b7649e0adc2e4b6c82afa8d846d54aa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:51.992580 5606 ts_tablet_manager.cc:1950] T 72711f14f26a479c9699b172b41b1db0 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:51.997396 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet e25f5898369f46fba32b7df27b334b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.999347 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet 2885e0829d014765b54124a0eb23a4dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:51.999842 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 2999bd61907847938975a6232e3899e4 (table default.Table_7cef271e951d46f38d090f892f8e54c0 [id=55be6819da774e158af5a660b686a1f3]) successfully deleted
I20260927 13:49:51.999910 4924 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet c2fc2734e88e431facdf72e9ef136106 (table default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e]). Expected version 2 got 0
I20260927 13:49:52.000742 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet e25f5898369f46fba32b7df27b334b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.000656 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_94c0c28bb2b3422e810d8de243a2ccb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.001294 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94c0c28bb2b3422e810d8de243a2ccb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.002399 6127 raft_consensus.cc:493] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.003875 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:52.004324 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a81b44fb2f644dff899d6d4aa435ccee consensus state has no leader
W20260927 13:49:52.003870 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d54e51b5c104c75b938aba55cecf890 consensus state has no leader
I20260927 13:49:52.004871 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 328) took 1491 ms. Trace:
I20260927 13:49:52.005000 5606 rpcz_store.cc:276] 0927 13:49:50.538203 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.540175 (+ 1972us) service_pool.cc:224] Handling call
0927 13:49:51.721267 (+1181092us) ts_tablet_manager.cc:1151] Deleting tablet 72711f14f26a479c9699b172b41b1db0
0927 13:49:51.721275 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:51.876112 (+154837us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:51.972851 (+ 96739us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:52.000117 (+ 27266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":788,"tablet-delete.queue_time_us":1153320}
I20260927 13:49:52.006088 6127 raft_consensus.cc:515] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.007025 6127 leader_election.cc:290] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:52.007866 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 342) took 1217 ms. Trace:
I20260927 13:49:52.007967 5606 rpcz_store.cc:276] 0927 13:49:50.789941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.790290 (+ 349us) service_pool.cc:224] Handling call
0927 13:49:52.005305 (+1215015us) ts_tablet_manager.cc:1151] Deleting tablet 84d9c94ee0af46e8aea12adac57829f7
0927 13:49:52.005316 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:52.005411 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1214755}
I20260927 13:49:52.008867 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 (DEFAULT_TABLE table=default.Table_473c4114525b4bea85fd83367cd4c376 [id=2c3a6aa3a59242ab831f9a72740f8879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.009074 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fdacca4b5bd4afb95c83f6c72091b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.010040 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 72711f14f26a479c9699b172b41b1db0 (table default.Table_9fd82aceaf6d491facc37c309420e9ed [id=aa9bfeb5b20c499d9897f950fa6db2a9]) successfully deleted
W20260927 13:49:52.010360 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 84d9c94ee0af46e8aea12adac57829f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84d9c94ee0af46e8aea12adac57829f7 already in progress: creating tablet
I20260927 13:49:52.011515 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 11d48db9b20a41419d5be703190fadd8 (DEFAULT_TABLE table=default.Table_5dfc30791e4347db940f164882d547d7 [id=4999b783a5ec458a8af3fbd21cf3ea5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.012363 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet 98e2e305b92a4492a0df14a506c768f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.013283 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d48db9b20a41419d5be703190fadd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.013530 5628 tablet_bootstrap.cc:492] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:52.015225 5628 ts_tablet_manager.cc:1403] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.197s user 0.009s sys 0.017s
I20260927 13:49:52.016534 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 2885e0829d014765b54124a0eb23a4dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.016626 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 343) took 1210 ms. Trace:
I20260927 13:49:52.016700 6145 consensus_queue.cc:1048] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260927 13:49:52.016746 5606 rpcz_store.cc:276] 0927 13:49:50.800374 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.800566 (+ 192us) service_pool.cc:224] Handling call
0927 13:49:52.008192 (+1207626us) ts_tablet_manager.cc:1151] Deleting tablet dae5f63f709f455b8eceb44771845a3f
0927 13:49:52.008202 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:52.008303 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1207355}
I20260927 13:49:52.016534 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet f702b0a6380543a8ac539125d4334cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.017879 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fc2734e88e431facdf72e9ef136106" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:52.018085 5248 raft_consensus.cc:2468] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:52.018888 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b855dedb8d04145b0c4469b9ba79453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:52.019870 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet dae5f63f709f455b8eceb44771845a3f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dae5f63f709f455b8eceb44771845a3f already in progress: creating tablet
I20260927 13:49:52.020120 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet e25f5898369f46fba32b7df27b334b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.020133 5044 leader_election.cc:304] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:52.020728 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2cec272546cb4373bf69e3ab344c46e1
I20260927 13:49:52.024488 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 17153df5ba20458aa0a5c0297e959810 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:52.026463 6127 raft_consensus.cc:2804] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:52.026387 5628 raft_consensus.cc:359] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.026559 6127 raft_consensus.cc:493] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:52.026628 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 2885e0829d014765b54124a0eb23a4dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.028522 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 344) took 1214 ms. Trace:
I20260927 13:49:52.028643 5606 rpcz_store.cc:276] 0927 13:49:50.803588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:50.804058 (+ 470us) service_pool.cc:224] Handling call
0927 13:49:52.016993 (+1212935us) ts_tablet_manager.cc:1151] Deleting tablet 3a07adcd33414d18ae9720e7a307548a
0927 13:49:52.017003 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:52.017094 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1212742}
I20260927 13:49:52.028909 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102
I20260927 13:49:52.029415 4922 catalog_manager.cc:6934] ReplaceTablet: tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 deleted and replaced by tablet c0d3e3f86440448a88404f0ac06e0c0c
I20260927 13:49:52.029850 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cec272546cb4373bf69e3ab344c46e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:52.030081 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 3a07adcd33414d18ae9720e7a307548a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a07adcd33414d18ae9720e7a307548a already in progress: creating tablet
I20260927 13:49:52.030557 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 354) took 1014 ms. Trace:
I20260927 13:49:52.030668 5606 rpcz_store.cc:276] 0927 13:49:51.014446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:51.015014 (+ 568us) service_pool.cc:224] Handling call
0927 13:49:52.028917 (+1013903us) ts_tablet_manager.cc:1151] Deleting tablet b5a9f864e4274666a86baed43e1623cd
0927 13:49:52.028928 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:52.029364 (+ 436us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1008964}
I20260927 13:49:52.033674 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12dd91ddaeff4f2a9d7a0761c08fc192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.036448 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 357) took 1006 ms. Trace:
I20260927 13:49:52.036639 5606 rpcz_store.cc:276] 0927 13:49:51.025042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:51.027545 (+ 2503us) service_pool.cc:224] Handling call
0927 13:49:52.030921 (+1003376us) ts_tablet_manager.cc:1151] Deleting tablet 3933c0a2fd6547f28528fae7d443a2c1
0927 13:49:52.030931 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:52.031018 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":964567}
I20260927 13:49:52.031239 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fc2734e88e431facdf72e9ef136106" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:52.037547 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b5a9f864e4274666a86baed43e1623cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5a9f864e4274666a86baed43e1623cd already in progress: creating tablet
I20260927 13:49:52.037814 6127 raft_consensus.cc:3060] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:52.038008 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 3933c0a2fd6547f28528fae7d443a2c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3933c0a2fd6547f28528fae7d443a2c1 already in progress: creating tablet
I20260927 13:49:52.038448 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 356) took 1012 ms. Trace:
I20260927 13:49:52.038590 5606 rpcz_store.cc:276] 0927 13:49:51.024922 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:51.028928 (+ 4006us) service_pool.cc:224] Handling call
0927 13:49:52.037013 (+1008085us) ts_tablet_manager.cc:1151] Deleting tablet ec40378eb80c412198d5b66c02e975ef
0927 13:49:52.037024 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:52.037141 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":970491}
W20260927 13:49:52.039052 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet ec40378eb80c412198d5b66c02e975ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec40378eb80c412198d5b66c02e975ef already in progress: creating tablet
I20260927 13:49:52.040320 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 with delete_type TABLET_DATA_DELETED (replaced by tablet c0d3e3f86440448a88404f0ac06e0c0c) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.041025 5382 raft_consensus.cc:2468] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:52.045704 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 31ee75d0a39c42b09f2f46a1774f925c from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:52.046227 5360 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cec272546cb4373bf69e3ab344c46e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.048146 5628 raft_consensus.cc:385] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.048310 5628 raft_consensus.cc:740] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.048697 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 355) took 1020 ms. Trace:
I20260927 13:49:52.049016 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 with delete_type TABLET_DATA_DELETED (replaced by tablet c0d3e3f86440448a88404f0ac06e0c0c) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.048795 5606 rpcz_store.cc:276] 0927 13:49:51.024799 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:51.032356 (+ 7557us) service_pool.cc:224] Handling call
0927 13:49:52.039040 (+1006684us) ts_tablet_manager.cc:1151] Deleting tablet e730a00ad2e646a4ba594ba9434c3b50
0927 13:49:52.039052 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:52.045015 (+ 5963us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":964748}
I20260927 13:49:52.051100 5628 consensus_queue.cc:260] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:52.054994 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet e730a00ad2e646a4ba594ba9434c3b50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e730a00ad2e646a4ba594ba9434c3b50 already in progress: creating tablet
I20260927 13:49:52.063019 5623 tablet_replica.cc:333] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:52.064409 5623 raft_consensus.cc:2243] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.064639 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 17153df5ba20458aa0a5c0297e959810
I20260927 13:49:52.064703 5623 raft_consensus.cc:2272] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.064177 5626 tablet_bootstrap.cc:654] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.065120 4921 catalog_manager.cc:6934] ReplaceTablet: tablet 17153df5ba20458aa0a5c0297e959810 deleted and replaced by tablet 352e564866a747798ad44218133844ba
I20260927 13:49:52.067451 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 23e3bb24afad4d789041b6a557512618 (DEFAULT_TABLE table=default.Table_977d1a0483e64f658c2eaead2cc16803 [id=59df0a1ee3ea43e8ac991b38717c1549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.067865 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e3bb24afad4d789041b6a557512618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.069310 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f00ce7baf4f147e4bacf7c20efb9064b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.070071 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f00ce7baf4f147e4bacf7c20efb9064b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.071069 4921 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6ca18492261b4eac898eb7838d59e717" } modify_external_catalogs: true
I20260927 13:49:52.071256 4921 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6ca18492261b4eac898eb7838d59e717" } modify_external_catalogs: true
I20260927 13:49:52.072803 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fbec3d960eb2415280ee9b1e7171392a" } modify_external_catalogs: true
I20260927 13:49:52.072965 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fbec3d960eb2415280ee9b1e7171392a" } modify_external_catalogs: true
W20260927 13:49:52.073889 4914 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 931a48792f4c4525bd563a4dd1062e35 (table default.Table_3b7666d87acf47bda3e3e2545c8cfb25 [id=bed97aef149a417bb3807414f58ba52a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 931a48792f4c4525bd563a4dd1062e35 consensus state has no leader
I20260927 13:49:52.075760 5625 ts_tablet_manager.cc:1929] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.075925 5625 log.cc:1199] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/4abe721ef8614d86870a0526de69014f
I20260927 13:49:52.076233 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 496cffc2a8774185a0e0f63208bed8a5 (DEFAULT_TABLE table=default.Table_e5f8007fdae74bbe92a5c011cf80f361 [id=d6bdeaa183ee42c3ba0895927bda5096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.079303 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet ec130d31f6274fd9b730c2bb8bba817e
I20260927 13:49:52.082332 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 3afb800e7ff44aadaed8f8d85aa9efe2 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:52.082942 5623 ts_tablet_manager.cc:1916] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.083045 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 17153df5ba20458aa0a5c0297e959810 with delete_type TABLET_DATA_DELETED (replaced by tablet 352e564866a747798ad44218133844ba) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.085196 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cec272546cb4373bf69e3ab344c46e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.085709 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 23e3bb24afad4d789041b6a557512618 (DEFAULT_TABLE table=default.Table_977d1a0483e64f658c2eaead2cc16803 [id=59df0a1ee3ea43e8ac991b38717c1549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.086412 5070 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 with delete_type TABLET_DATA_DELETED (replaced by tablet c0d3e3f86440448a88404f0ac06e0c0c) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.087604 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 496cffc2a8774185a0e0f63208bed8a5 (DEFAULT_TABLE table=default.Table_e5f8007fdae74bbe92a5c011cf80f361 [id=d6bdeaa183ee42c3ba0895927bda5096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.088053 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496cffc2a8774185a0e0f63208bed8a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:52.088047 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 98e2e305b92a4492a0df14a506c768f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98e2e305b92a4492a0df14a506c768f3 already in progress: creating tablet
W20260927 13:49:52.089270 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet f702b0a6380543a8ac539125d4334cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f702b0a6380543a8ac539125d4334cd5 already in progress: creating tablet
I20260927 13:49:52.090801 5070 tablet_service.cc:1511] Processing CreateTablet for tablet 23e3bb24afad4d789041b6a557512618 (DEFAULT_TABLE table=default.Table_977d1a0483e64f658c2eaead2cc16803 [id=59df0a1ee3ea43e8ac991b38717c1549]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.091244 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e3bb24afad4d789041b6a557512618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.091302 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet ec130d31f6274fd9b730c2bb8bba817e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.092391 5625 ts_tablet_manager.cc:1950] T 4abe721ef8614d86870a0526de69014f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:52.093094 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet ec130d31f6274fd9b730c2bb8bba817e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.093609 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 17153df5ba20458aa0a5c0297e959810 with delete_type TABLET_DATA_DELETED (replaced by tablet 352e564866a747798ad44218133844ba) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.097218 5626 tablet_bootstrap.cc:492] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.097457 5626 ts_tablet_manager.cc:1403] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.156s user 0.000s sys 0.004s
I20260927 13:49:52.097651 5625 tablet_replica.cc:333] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:52.098155 5625 raft_consensus.cc:2243] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.099472 5346 tablet_service.cc:1558] Processing DeleteTablet for tablet ec130d31f6274fd9b730c2bb8bba817e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.099658 4929 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 76add3b9ef254ece958121a336e87936 (table default.Table_cacde3a39927479095e38a677172ee0f [id=d570c2cfe66d4c0e9fdfaee2c644aab2]). Expected version 1 got 0
I20260927 13:49:52.100442 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 413d863d9a564e5d8325b4479346730d
I20260927 13:49:52.101370 5626 raft_consensus.cc:359] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.101668 5626 raft_consensus.cc:385] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.101728 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 3afb800e7ff44aadaed8f8d85aa9efe2
I20260927 13:49:52.102013 5626 raft_consensus.cc:740] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.102202 4921 catalog_manager.cc:6934] ReplaceTablet: tablet 3afb800e7ff44aadaed8f8d85aa9efe2 deleted and replaced by tablet cf1a58c67bf54493a3c62fb175acabb8
I20260927 13:49:52.102583 5626 consensus_queue.cc:260] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.103207 5626 ts_tablet_manager.cc:1434] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 13:49:52.102216 5364 tablet_service.cc:1558] Processing DeleteTablet for tablet 413d863d9a564e5d8325b4479346730d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.103592 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496cffc2a8774185a0e0f63208bed8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.104007 5626 tablet_bootstrap.cc:492] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.104194 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 with delete_type TABLET_DATA_DELETED (replaced by tablet cf1a58c67bf54493a3c62fb175acabb8) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.105074 5625 raft_consensus.cc:2272] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.111289 5626 tablet_bootstrap.cc:654] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.113044 5625 ts_tablet_manager.cc:1916] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.117651 5623 ts_tablet_manager.cc:1929] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.121229 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 358) took 1045 ms. Trace:
I20260927 13:49:52.121371 5606 rpcz_store.cc:276] 0927 13:49:51.036780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:51.118394 (+ 81614us) service_pool.cc:224] Handling call
0927 13:49:52.073567 (+955173us) ts_tablet_manager.cc:1151] Deleting tablet 56b9612ffea543b9b0779c46533d91ab
0927 13:49:52.073582 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:52.082098 (+ 8516us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":954680}
I20260927 13:49:52.121762 5606 tablet_replica.cc:333] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:52.121963 5606 raft_consensus.cc:2243] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:52.121986 5623 log.cc:1199] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/72711f14f26a479c9699b172b41b1db0
I20260927 13:49:52.122289 5606 pending_rounds.cc:70] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:52.122365 5606 pending_rounds.cc:77] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957596763643904 op_type: NO_OP noop_request { }
I20260927 13:49:52.122500 5606 raft_consensus.cc:2889] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:52.122602 5606 raft_consensus.cc:2272] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.122985 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 17153df5ba20458aa0a5c0297e959810 with delete_type TABLET_DATA_DELETED (replaced by tablet 352e564866a747798ad44218133844ba) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:52.123010 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 56b9612ffea543b9b0779c46533d91ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56b9612ffea543b9b0779c46533d91ab already in progress: creating tablet
I20260927 13:49:52.123515 5623 ts_tablet_manager.cc:1950] T 72711f14f26a479c9699b172b41b1db0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:52.124073 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d2afdbaf831c4583a90a5f11927eae11" } new_table_name: "default.Table_af1fdd99060c4fbcbd2e734ce850a4ad" modify_external_catalogs: true
I20260927 13:49:52.124876 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e3bb24afad4d789041b6a557512618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.124990 6127 raft_consensus.cc:515] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.126247 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fc2734e88e431facdf72e9ef136106" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:52.126439 5382 raft_consensus.cc:3060] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.129436 5382 raft_consensus.cc:2468] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
W20260927 13:49:52.130475 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb6073174dbb4ca1933685b7bd3a22e1 has no consensus state
I20260927 13:49:52.130600 5626 tablet_bootstrap.cc:492] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.130631 5045 leader_election.cc:304] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:52.130731 5626 ts_tablet_manager.cc:1403] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.003s
I20260927 13:49:52.131520 5626 raft_consensus.cc:359] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.131711 5626 raft_consensus.cc:385] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.131805 5626 raft_consensus.cc:740] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.132064 5626 consensus_queue.cc:260] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.133090 5626 ts_tablet_manager.cc:1434] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:49:52.133363 5626 tablet_bootstrap.cc:492] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.136411 5606 ts_tablet_manager.cc:1916] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.136898 5626 tablet_bootstrap.cc:654] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.140240 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fc2734e88e431facdf72e9ef136106" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:52.140570 5248 raft_consensus.cc:3060] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.142187 5619 tablet_bootstrap.cc:492] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:52.142400 5619 ts_tablet_manager.cc:1403] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.389s user 0.015s sys 0.008s
I20260927 13:49:52.143200 5619 raft_consensus.cc:359] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.143435 5619 raft_consensus.cc:385] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.143522 5619 raft_consensus.cc:740] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.143817 5619 consensus_queue.cc:260] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.145488 5248 raft_consensus.cc:2468] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:52.146153 6127 leader_election.cc:290] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:52.152514 6127 raft_consensus.cc:493] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.154580 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_56b64738ce624ac98e0b4a4b327ab204"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.155292 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56b64738ce624ac98e0b4a4b327ab204 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.155771 5606 ts_tablet_manager.cc:1929] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:52.155902 5606 log.cc:1199] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/f5bf9ba5d857421ebc783d4c567f411c
I20260927 13:49:52.156162 6127 raft_consensus.cc:515] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.156314 5606 ts_tablet_manager.cc:1950] T f5bf9ba5d857421ebc783d4c567f411c P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:52.156894 6127 leader_election.cc:290] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:52.159238 6127 raft_consensus.cc:2804] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:52.159427 6127 raft_consensus.cc:697] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:52.164245 6204 raft_consensus.cc:493] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.164427 6204 raft_consensus.cc:515] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.165187 6204 leader_election.cc:290] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:52.165989 5626 tablet_bootstrap.cc:492] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.166170 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 51e1acd618fc44be9169fa1d56fa510a from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:52.166222 5626 ts_tablet_manager.cc:1403] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.002s
I20260927 13:49:52.166726 6127 consensus_queue.cc:237] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.167004 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a443f65eba384b998fdc57ec57e37d87" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:52.167632 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 413d863d9a564e5d8325b4479346730d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:52.167869 5044 leader_election.cc:343] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:52.167665 5626 raft_consensus.cc:359] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.168685 5626 raft_consensus.cc:385] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.168908 5626 raft_consensus.cc:740] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.169224 5626 consensus_queue.cc:260] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.169808 5626 ts_tablet_manager.cc:1434] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:52.169894 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 with delete_type TABLET_DATA_DELETED (replaced by tablet cf1a58c67bf54493a3c62fb175acabb8) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.170367 5626 tablet_bootstrap.cc:492] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.172617 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 with delete_type TABLET_DATA_DELETED (replaced by tablet cf1a58c67bf54493a3c62fb175acabb8) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.173936 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 496cffc2a8774185a0e0f63208bed8a5 (DEFAULT_TABLE table=default.Table_e5f8007fdae74bbe92a5c011cf80f361 [id=d6bdeaa183ee42c3ba0895927bda5096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.174428 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496cffc2a8774185a0e0f63208bed8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.178577 4921 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_bc37738823ef4e37a87cc856bf9bfbab" } modify_external_catalogs: true
I20260927 13:49:52.178706 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 0004ef0b2dd841ac860798d804374dc1 with delete_type TABLET_DATA_DELETED (replaced by tablet bbb4f42522e84964aeb19358ee02dfc2) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.178799 4921 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_bc37738823ef4e37a87cc856bf9bfbab" } modify_external_catalogs: true
I20260927 13:49:52.178968 5623 tablet_replica.cc:333] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:52.179134 5623 raft_consensus.cc:2243] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.179328 5623 raft_consensus.cc:2272] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.180042 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b22e5dfd0ffc497b87892eaf8b0c2fc1" } new_table_name: "default.Table_2b111148dbd84b309ccd57fb0b2d1835" modify_external_catalogs: true
I20260927 13:49:52.180843 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 72711f14f26a479c9699b172b41b1db0 (table default.Table_9fd82aceaf6d491facc37c309420e9ed [id=aa9bfeb5b20c499d9897f950fa6db2a9]) successfully deleted
W20260927 13:49:52.181097 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet e25f5898369f46fba32b7df27b334b28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e25f5898369f46fba32b7df27b334b28 already in progress: creating tablet
I20260927 13:49:52.181104 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f34f2d0f6e9420a8ad38d708b658b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:52.181313 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2885e0829d014765b54124a0eb23a4dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2885e0829d014765b54124a0eb23a4dc already in progress: creating tablet
W20260927 13:49:52.181528 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2cec272546cb4373bf69e3ab344c46e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cec272546cb4373bf69e3ab344c46e1 already in progress: creating tablet
W20260927 13:49:52.181715 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 already in progress: creating tablet
W20260927 13:49:52.181911 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 17153df5ba20458aa0a5c0297e959810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17153df5ba20458aa0a5c0297e959810 already in progress: creating tablet
I20260927 13:49:52.181862 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f439e2a6434440ef981d41bcd6ef33c1" } modify_external_catalogs: true
W20260927 13:49:52.182086 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet ec130d31f6274fd9b730c2bb8bba817e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec130d31f6274fd9b730c2bb8bba817e already in progress: creating tablet
W20260927 13:49:52.182307 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 413d863d9a564e5d8325b4479346730d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 413d863d9a564e5d8325b4479346730d already in progress: creating tablet
I20260927 13:49:52.182049 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f439e2a6434440ef981d41bcd6ef33c1" } modify_external_catalogs: true
W20260927 13:49:52.182521 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3afb800e7ff44aadaed8f8d85aa9efe2 already in progress: creating tablet
I20260927 13:49:52.182744 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 4abe721ef8614d86870a0526de69014f (table default.Table_15df8518ff4f446cadb3f1c389a17954 [id=fcaf2809390c4d6c9dd836f5bfdacf40]) successfully deleted
I20260927 13:49:52.182747 5625 ts_tablet_manager.cc:1929] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.182906 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_48a5fac9ec3d40c4a4b405f925a74326" } new_table_name: "default.Table_e146c2f2d2614db7912a172c61e3f9f4" modify_external_catalogs: true
I20260927 13:49:52.185515 5623 ts_tablet_manager.cc:1916] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:52.187284 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95726f690a71433ca63f95da4ee750e5 consensus state has no leader
I20260927 13:49:52.192235 5623 ts_tablet_manager.cc:1929] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:49:52.194732 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cbacda63c0d3427aabf3332b278576c5 consensus state has no leader
I20260927 13:49:52.194882 5623 log.cc:1199] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/0004ef0b2dd841ac860798d804374dc1
I20260927 13:49:52.194765 5626 tablet_bootstrap.cc:654] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.195811 6232 raft_consensus.cc:493] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.196053 6232 raft_consensus.cc:515] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.196619 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effce815011d47df960df2c79d41aa1f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:52.196707 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 413d863d9a564e5d8325b4479346730d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.196884 5108 raft_consensus.cc:2393] T effce815011d47df960df2c79d41aa1f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:49:52.195235 5623 ts_tablet_manager.cc:1950] T 0004ef0b2dd841ac860798d804374dc1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:52.198730 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effce815011d47df960df2c79d41aa1f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:52.199967 5619 ts_tablet_manager.cc:1434] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.057s user 0.004s sys 0.000s
I20260927 13:49:52.200007 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f168ee5434894b38987656de421fcdfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:52.200343 5619 tablet_bootstrap.cc:492] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:49:52.200606 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f168ee5434894b38987656de421fcdfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.202275 5623 tablet_replica.cc:333] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:52.202481 5619 tablet_bootstrap.cc:654] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.203455 5623 raft_consensus.cc:2243] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.203563 5185 leader_election.cc:304] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:52.203693 5623 raft_consensus.cc:2272] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.203985 6204 raft_consensus.cc:3060] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.204289 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet bc8f6354c1034814af3cc20df25ddb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.204612 5623 ts_tablet_manager.cc:1916] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.205225 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 0004ef0b2dd841ac860798d804374dc1 (table default.Table_5f2f268fd879476db40bf7a96885d2a5 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]) successfully deleted
I20260927 13:49:52.205618 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 910b73528ed949bc86badcc4cf6c74a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.207198 6204 raft_consensus.cc:2749] T effce815011d47df960df2c79d41aa1f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.207235 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8e2e1621778d459a930d7f15ea30dd06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:52.208043 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_177a9f16ad5342eb81daa361585e3154" } new_table_name: "default.Table_9fd68b572cdd486399d89cd3f517b796" modify_external_catalogs: true
I20260927 13:49:52.208003 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_cc0802f1f9f94b4b8f385d521fe95721"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.208539 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc0802f1f9f94b4b8f385d521fe95721 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.209299 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f9676fa793204703b70a70c0c3ea563d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:52.209496 5625 log.cc:1199] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/2329b988f5d9410d96eca321a7b8f3a6
I20260927 13:49:52.209619 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5e60c258bac24c7cabc2b7e1e6052193" } new_table_name: "default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f" modify_external_catalogs: true
W20260927 13:49:52.209764 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9676fa793204703b70a70c0c3ea563d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.209873 5625 ts_tablet_manager.cc:1950] T 2329b988f5d9410d96eca321a7b8f3a6 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:52.213518 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e2e1621778d459a930d7f15ea30dd06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.214980 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a1fca938c34718ae541f0038b56025" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:52.215354 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_94ba7a27252044beb2d23563d4092a8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.215512 5044 leader_election.cc:343] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:52.215811 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94ba7a27252044beb2d23563d4092a8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.215981 6232 leader_election.cc:290] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:52.217023 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 369) took 1116 ms. Trace:
I20260927 13:49:52.217135 5606 rpcz_store.cc:276] 0927 13:49:51.100677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:51.358212 (+257535us) service_pool.cc:224] Handling call
0927 13:49:52.121670 (+763458us) ts_tablet_manager.cc:1151] Deleting tablet f5bf9ba5d857421ebc783d4c567f411c
0927 13:49:52.121685 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:52.152105 (+ 30420us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:52.155703 (+ 3598us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:52.216953 (+ 61250us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":763083}
I20260927 13:49:52.217577 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet f5bf9ba5d857421ebc783d4c567f411c (table default.Table_71b0f958b1ec49bf9f334180403b5e3f [id=e84cfb4f1dc04be8928d31ded73197c1]) successfully deleted
W20260927 13:49:52.217981 5045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 86478.5us
I20260927 13:49:52.220345 5626 tablet_bootstrap.cc:492] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.220252 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a443f65eba384b998fdc57ec57e37d87" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:52.220583 5626 ts_tablet_manager.cc:1403] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.050s user 0.001s sys 0.003s
I20260927 13:49:52.221423 5626 raft_consensus.cc:359] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.222150 5626 raft_consensus.cc:385] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.222563 5626 raft_consensus.cc:740] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.222894 5626 consensus_queue.cc:260] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.223454 5626 ts_tablet_manager.cc:1434] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:52.225504 5626 tablet_bootstrap.cc:492] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.227532 5626 tablet_bootstrap.cc:654] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:52.234516 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1087ad60dade46bb9d38f52a94dd536b consensus state has no leader
I20260927 13:49:52.235330 5625 tablet_replica.cc:333] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:52.235549 5625 raft_consensus.cc:2243] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.235955 5623 ts_tablet_manager.cc:1929] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.238145 5625 raft_consensus.cc:2272] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.238101 6240 consensus_queue.cc:1048] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260927 13:49:52.238360 5623 log.cc:1199] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/1f34f2d0f6e9420a8ad38d708b658b17
I20260927 13:49:52.238760 5625 ts_tablet_manager.cc:1916] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.239615 5623 ts_tablet_manager.cc:1950] T 1f34f2d0f6e9420a8ad38d708b658b17 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:52.240109 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c7e950edad044de5b910f91a80448895"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:52.240844 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 2329b988f5d9410d96eca321a7b8f3a6 (table default.Table_812430ef8c1c4462ae6a6663805f50b8 [id=24cbb4b2dc904080a522c768da9ebe68]) successfully deleted
I20260927 13:49:52.241062 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 1f34f2d0f6e9420a8ad38d708b658b17 (table default.Table_f4169b61d7234a6286c6c26a3b3b2c65 [id=30320123ccb44660bb6013069aa42e18]) successfully deleted
I20260927 13:49:52.241072 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 910b73528ed949bc86badcc4cf6c74a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:45 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:52.241448 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7e950edad044de5b910f91a80448895 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.243563 5623 tablet_replica.cc:333] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
W20260927 13:49:52.243660 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 825a73d47bff4246965be82eb482f7aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 825a73d47bff4246965be82eb482f7aa already in progress: creating tablet
I20260927 13:49:52.244040 5623 raft_consensus.cc:2243] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.244433 5628 ts_tablet_manager.cc:1434] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.229s user 0.008s sys 0.003s
I20260927 13:49:52.244679 5623 raft_consensus.cc:2272] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:52.245409 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 3700a1f40c0644848da62392cb0c297f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3700a1f40c0644848da62392cb0c297f already in progress: creating tablet
I20260927 13:49:52.245671 5623 ts_tablet_manager.cc:1916] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.253088 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_88984f1568c54b4398964528d6e45861" } modify_external_catalogs: true
I20260927 13:49:52.253367 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_88984f1568c54b4398964528d6e45861" } modify_external_catalogs: true
I20260927 13:49:52.255160 4928 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 76add3b9ef254ece958121a336e87936 (table default.Table_cacde3a39927479095e38a677172ee0f [id=d570c2cfe66d4c0e9fdfaee2c644aab2]). Expected version 1 got 0
I20260927 13:49:52.263198 5079 tablet_service.cc:1558] Processing DeleteTablet for tablet 56b9612ffea543b9b0779c46533d91ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.263613 5628 tablet_bootstrap.cc:492] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:52.264564 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d8d34c74dce64346bb6939d4e662b864"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.265134 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8d34c74dce64346bb6939d4e662b864 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.265425 5628 tablet_bootstrap.cc:654] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.268728 5625 ts_tablet_manager.cc:1929] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.268867 5625 log.cc:1199] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/559ac90ef36d406881dc17ade0560044
I20260927 13:49:52.269223 5625 ts_tablet_manager.cc:1950] T 559ac90ef36d406881dc17ade0560044 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:52.269197 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a06dc9d175614ec2b842ccbb93b0f739"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:52.272167 5606 tablet_replica.cc:333] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:52.272388 5606 raft_consensus.cc:2243] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.272614 5606 raft_consensus.cc:2272] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:52.271474 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 1efaf62692c545dcaa5175fcd826785a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1efaf62692c545dcaa5175fcd826785a already in progress: creating tablet
W20260927 13:49:52.276494 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet bb25bb5ee153494d803130f1ad4f7c2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb25bb5ee153494d803130f1ad4f7c2e already in progress: creating tablet
W20260927 13:49:52.276718 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet efd31e3dd142413c92fce2043e053d32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efd31e3dd142413c92fce2043e053d32 already in progress: creating tablet
W20260927 13:49:52.276897 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 6ff7d501f7704e69b696053cb1b1ffe5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ff7d501f7704e69b696053cb1b1ffe5 already in progress: creating tablet
W20260927 13:49:52.277064 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 06c810fde988439c97a8445fc88626b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06c810fde988439c97a8445fc88626b3 already in progress: creating tablet
W20260927 13:49:52.277273 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 9f080b4ca9894eae8305d1548010a6cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f080b4ca9894eae8305d1548010a6cb already in progress: creating tablet
W20260927 13:49:52.273669 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 03917a40b5884401a6bc09c7925fd1ae consensus state has no leader
I20260927 13:49:52.278306 5625 tablet_replica.cc:333] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:52.279107 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 559ac90ef36d406881dc17ade0560044 (table default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]) successfully deleted
I20260927 13:49:52.279488 5625 raft_consensus.cc:2243] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.279713 5625 raft_consensus.cc:2272] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.280464 5623 ts_tablet_manager.cc:1929] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.280586 5625 ts_tablet_manager.cc:1916] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:52.281035 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a06dc9d175614ec2b842ccbb93b0f739 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.282045 6247 raft_consensus.cc:493] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.283279 6247 raft_consensus.cc:515] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.284013 6247 leader_election.cc:290] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.284838 5606 ts_tablet_manager.cc:1916] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.292719 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet ec130d31f6274fd9b730c2bb8bba817e from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:52.294735 5619 tablet_bootstrap.cc:492] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:52.294895 5619 ts_tablet_manager.cc:1403] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.095s user 0.003s sys 0.000s
I20260927 13:49:52.295619 5619 raft_consensus.cc:359] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.295802 5619 raft_consensus.cc:385] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.295892 5619 raft_consensus.cc:740] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.296046 5623 log.cc:1199] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/bc8f6354c1034814af3cc20df25ddb47
I20260927 13:49:52.296916 5623 ts_tablet_manager.cc:1950] T bc8f6354c1034814af3cc20df25ddb47 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:52.298342 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet bc8f6354c1034814af3cc20df25ddb47 (table default.Table_e6eff4f97e084636b5609c6c269cf5ec [id=4f32d603a6764a359605a945c924f6c5]) successfully deleted
I20260927 13:49:52.299517 5623 tablet_replica.cc:333] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:52.299971 5623 raft_consensus.cc:2243] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.301226 5619 consensus_queue.cc:260] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.301601 5623 raft_consensus.cc:2272] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:52.302711 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 82752.5us
I20260927 13:49:52.304159 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a1fca938c34718ae541f0038b56025" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:52.311543 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_94c0c28bb2b3422e810d8de243a2ccb2" } modify_external_catalogs: true
I20260927 13:49:52.311826 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_94c0c28bb2b3422e810d8de243a2ccb2" } modify_external_catalogs: true
I20260927 13:49:52.311862 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f34f2d0f6e9420a8ad38d708b658b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.317425 4925 master_service.cc:960] ReplaceTablet: received request to replace tablet 0361e3b244a1437b8e402dd8602528fe from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:52.319770 5319 leader_election.cc:343] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 2999bd61907847938975a6232e3899e4
I20260927 13:49:52.320856 5623 ts_tablet_manager.cc:1916] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.326745 5626 tablet_bootstrap.cc:492] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.327033 5626 ts_tablet_manager.cc:1403] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.102s user 0.012s sys 0.003s
I20260927 13:49:52.327879 5626 raft_consensus.cc:359] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.328583 5626 raft_consensus.cc:385] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.328725 5626 raft_consensus.cc:740] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.329078 5626 consensus_queue.cc:260] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.330194 5626 ts_tablet_manager.cc:1434] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:52.335861 5626 tablet_bootstrap.cc:492] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.336663 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2bf1c8729308443bba92997d06f84e9e" } modify_external_catalogs: true
I20260927 13:49:52.336855 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2bf1c8729308443bba92997d06f84e9e" } modify_external_catalogs: true
I20260927 13:49:52.347008 5626 tablet_bootstrap.cc:654] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.347268 5619 ts_tablet_manager.cc:1434] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.052s user 0.002s sys 0.000s
I20260927 13:49:52.350989 5619 tablet_bootstrap.cc:492] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:52.350365 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f33f22d6ee3f458694985ca9a9c3c488"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.352444 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f33f22d6ee3f458694985ca9a9c3c488 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.353840 5619 tablet_bootstrap.cc:654] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.360194 5623 ts_tablet_manager.cc:1929] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.360476 5623 log.cc:1199] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/910b73528ed949bc86badcc4cf6c74a3
I20260927 13:49:52.360810 5606 ts_tablet_manager.cc:1929] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:52.360961 5606 log.cc:1199] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/cd4c568b96084baeb7438a4857adadc1
I20260927 13:49:52.361428 5606 ts_tablet_manager.cc:1950] T cd4c568b96084baeb7438a4857adadc1 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:52.361744 5623 ts_tablet_manager.cc:1950] T 910b73528ed949bc86badcc4cf6c74a3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:52.363517 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 910b73528ed949bc86badcc4cf6c74a3 (table default.Table_791bee87bef64e35bb7c22d8611be6d5 [id=53769bb0c70748e6b710b518250b2649]) successfully deleted
I20260927 13:49:52.363610 6252 tablet.cc:1751] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:52.364719 5626 tablet_bootstrap.cc:492] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.365859 5626 ts_tablet_manager.cc:1403] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260927 13:49:52.366822 5626 raft_consensus.cc:359] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.367074 5626 raft_consensus.cc:385] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.367214 5626 raft_consensus.cc:740] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.367553 5626 consensus_queue.cc:260] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.369803 5626 ts_tablet_manager.cc:1434] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260927 13:49:52.370535 5626 tablet_bootstrap.cc:492] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.372553 5626 tablet_bootstrap.cc:654] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.375969 6251 tablet.cc:1751] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:52.376631 4927 catalog_manager.cc:5838] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65). New cstate: current_term: 1 leader_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260927 13:49:52.377059 4927 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c2fc2734e88e431facdf72e9ef136106 (table default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e]). Expected version 2 got 0
I20260927 13:49:52.379276 5619 tablet_bootstrap.cc:492] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:52.379546 5619 ts_tablet_manager.cc:1403] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.003s
W20260927 13:49:52.379786 5045 leader_election.cc:343] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:52.380431 5319 leader_election.cc:343] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2999bd61907847938975a6232e3899e4
I20260927 13:49:52.380662 5319 leader_election.cc:304] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:52.380808 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 (DEFAULT_TABLE table=default.Table_94c0c28bb2b3422e810d8de243a2ccb2 [id=d226d55db789403b9b31e6a5461c8b5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.381182 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.381939 6245 raft_consensus.cc:2749] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.381938 6240 consensus_queue.cc:1048] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:52.382350 6247 consensus_queue.cc:1048] T effce815011d47df960df2c79d41aa1f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:52.383625 5045 leader_election.cc:304] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:52.384261 5108 raft_consensus.cc:1275] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Refusing update from remote peer bb28c54312c94d7dafb1c2abf7870735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:52.384857 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet cd4c568b96084baeb7438a4857adadc1 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]) successfully deleted
I20260927 13:49:52.384862 5619 raft_consensus.cc:359] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.385042 5619 raft_consensus.cc:385] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.385105 5619 raft_consensus.cc:740] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.386754 5606 tablet_replica.cc:333] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:52.386998 5606 raft_consensus.cc:2243] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.387344 5606 raft_consensus.cc:2272] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.387962 5606 ts_tablet_manager.cc:1916] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.389093 6247 consensus_queue.cc:1048] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:52.390065 5619 consensus_queue.cc:260] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.391492 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 (DEFAULT_TABLE table=default.Table_94c0c28bb2b3422e810d8de243a2ccb2 [id=d226d55db789403b9b31e6a5461c8b5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.392086 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.393102 5619 ts_tablet_manager.cc:1434] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260927 13:49:52.393451 5619 tablet_bootstrap.cc:492] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:52.393697 4930 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 76add3b9ef254ece958121a336e87936 (table default.Table_cacde3a39927479095e38a677172ee0f [id=d570c2cfe66d4c0e9fdfaee2c644aab2]). Expected version 1 got 0
I20260927 13:49:52.395339 6231 raft_consensus.cc:2749] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.397046 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ba9eecef03ec466b97eab6b3720b265b" } new_table_name: "default.Table_3af91c12409e4dbc97a79774e12d3634" modify_external_catalogs: true
I20260927 13:49:52.399554 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c72e1a5dced499a932bdc302e006f29 with delete_type TABLET_DATA_DELETED (replaced by tablet 2cec272546cb4373bf69e3ab344c46e1) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:52.399832 5045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 88132.8us
I20260927 13:49:52.400045 5623 tablet_replica.cc:333] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
W20260927 13:49:52.400132 5045 leader_election.cc:343] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:52.400243 5623 raft_consensus.cc:2243] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.400429 5623 raft_consensus.cc:2272] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.401232 5623 ts_tablet_manager.cc:1916] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.403226 5221 tablet_service.cc:1511] Processing CreateTablet for tablet f49384587bfa41d6aabfa8ee175d6abe (DEFAULT_TABLE table=default.Table_8a9f7c16b9ec4d10848c2bb0c661fe27 [id=0cf3d2b79225499f86d3d78ef105ab4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.403647 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49384587bfa41d6aabfa8ee175d6abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.409147 5623 ts_tablet_manager.cc:1929] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.409363 5623 log.cc:1199] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/0c72e1a5dced499a932bdc302e006f29
I20260927 13:49:52.409794 5623 ts_tablet_manager.cc:1950] T 0c72e1a5dced499a932bdc302e006f29 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:52.410040 5361 tablet_service.cc:1511] Processing CreateTablet for tablet f49384587bfa41d6aabfa8ee175d6abe (DEFAULT_TABLE table=default.Table_8a9f7c16b9ec4d10848c2bb0c661fe27 [id=0cf3d2b79225499f86d3d78ef105ab4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.410483 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49384587bfa41d6aabfa8ee175d6abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.412424 5619 tablet_bootstrap.cc:654] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.419152 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 0c72e1a5dced499a932bdc302e006f29 (table default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]) successfully deleted
I20260927 13:49:52.420421 5619 tablet_bootstrap.cc:492] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:52.420631 5619 ts_tablet_manager.cc:1403] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.004s
I20260927 13:49:52.419274 4928 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 7011125c78084deca83b1570d1c2d704 (table default.Table_48f2011ba0d94370a858a7187bf55677 [id=c073a79da0b440698186e6856c8c8c68]). Expected version 1 got 0
I20260927 13:49:52.421550 5619 raft_consensus.cc:359] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.421749 5619 raft_consensus.cc:385] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.421870 5619 raft_consensus.cc:740] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.422983 6247 raft_consensus.cc:493] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.423182 6247 raft_consensus.cc:515] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.424154 6247 leader_election.cc:290] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.424182 5619 consensus_queue.cc:260] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.424872 5619 ts_tablet_manager.cc:1434] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:49:52.425199 5619 tablet_bootstrap.cc:492] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:52.427155 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 0191cfad4e7a4b088b2ecdc246bfa58a
I20260927 13:49:52.427510 6204 raft_consensus.cc:493] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.427681 6204 raft_consensus.cc:515] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.428413 6204 leader_election.cc:290] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:52.428409 5319 leader_election.cc:343] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 1f34f2d0f6e9420a8ad38d708b658b17
I20260927 13:49:52.428766 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 0191cfad4e7a4b088b2ecdc246bfa58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.429255 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 0191cfad4e7a4b088b2ecdc246bfa58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.430205 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b8d6958e6f44d3a98ed96d89d4c1b4" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:52.430892 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 0191cfad4e7a4b088b2ecdc246bfa58a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0191cfad4e7a4b088b2ecdc246bfa58a already in progress: creating tablet
I20260927 13:49:52.433079 5619 tablet_bootstrap.cc:654] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.434185 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 44d29459405b4cdd921fb43bf5a2ae81 (DEFAULT_TABLE table=default.Table_c5e936d61fc244cfb11cf0cc7e465df1 [id=7924f9989b95438bb8af0b55868bf59e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.434733 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d29459405b4cdd921fb43bf5a2ae81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.437721 5606 ts_tablet_manager.cc:1929] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 13:49:52.441610 6247 raft_consensus.cc:493] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.444392 5606 log.cc:1199] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/79514522a9d142438fd6aecc91f0463e
I20260927 13:49:52.444446 6247 raft_consensus.cc:515] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.444837 5606 ts_tablet_manager.cc:1950] T 79514522a9d142438fd6aecc91f0463e P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:52.445492 6247 leader_election.cc:290] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.445747 5606 tablet_replica.cc:333] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:52.445942 5606 raft_consensus.cc:2243] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.446208 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 79514522a9d142438fd6aecc91f0463e (table default.Table_977d1a0483e64f658c2eaead2cc16803 [id=59df0a1ee3ea43e8ac991b38717c1549]) successfully deleted
I20260927 13:49:52.446559 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7011125c78084deca83b1570d1c2d704" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:52.446861 5249 raft_consensus.cc:2468] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:52.447431 5319 leader_election.cc:304] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:52.448016 6247 raft_consensus.cc:2804] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:52.448154 6247 raft_consensus.cc:493] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:52.448272 6247 raft_consensus.cc:3060] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.451054 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7a18018de90d47688f3668cb739ddaa5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.451856 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a18018de90d47688f3668cb739ddaa5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.452169 6247 raft_consensus.cc:515] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.446103 5606 raft_consensus.cc:2272] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.453436 5606 ts_tablet_manager.cc:1916] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.454439 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7011125c78084deca83b1570d1c2d704" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:52.454705 5249 raft_consensus.cc:3060] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.458325 5045 leader_election.cc:304] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:52.459095 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 44d29459405b4cdd921fb43bf5a2ae81 (DEFAULT_TABLE table=default.Table_c5e936d61fc244cfb11cf0cc7e465df1 [id=7924f9989b95438bb8af0b55868bf59e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.459645 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d29459405b4cdd921fb43bf5a2ae81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.460068 5619 tablet_bootstrap.cc:492] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:52.460280 5619 ts_tablet_manager.cc:1403] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.001s
I20260927 13:49:52.461191 5619 raft_consensus.cc:359] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.461406 5619 raft_consensus.cc:385] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.461485 5619 raft_consensus.cc:740] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.461485 5213 tablet_service.cc:1511] Processing CreateTablet for tablet a1e7e50142e447158f90770322609a2f (DEFAULT_TABLE table=default.Table_bc37738823ef4e37a87cc856bf9bfbab [id=f5dc8e23cf63496f9b5920f02ce9cad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.461768 5619 consensus_queue.cc:260] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.461887 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e7e50142e447158f90770322609a2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.465583 5249 raft_consensus.cc:2468] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:52.475559 5319 leader_election.cc:304] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:52.479151 6240 raft_consensus.cc:2804] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:52.480037 6240 raft_consensus.cc:697] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:52.480190 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 0361e3b244a1437b8e402dd8602528fe
I20260927 13:49:52.480401 5619 ts_tablet_manager.cc:1434] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260927 13:49:52.479677 6247 leader_election.cc:290] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.480823 4925 catalog_manager.cc:6934] ReplaceTablet: tablet 0361e3b244a1437b8e402dd8602528fe deleted and replaced by tablet 187b3ceeccb142c4b798947e584d6044
I20260927 13:49:52.480832 6240 consensus_queue.cc:237] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.482463 4925 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 7011125c78084deca83b1570d1c2d704 (table default.Table_48f2011ba0d94370a858a7187bf55677 [id=c073a79da0b440698186e6856c8c8c68]). Expected version 1 got 0
I20260927 13:49:52.483479 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_48f2011ba0d94370a858a7187bf55677" } new_table_name: "default.Table_a09e5155fa1148ef88003c6c1afedce5" modify_external_catalogs: true
I20260927 13:49:52.484036 5619 tablet_bootstrap.cc:492] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:52.484918 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 0361e3b244a1437b8e402dd8602528fe with delete_type TABLET_DATA_DELETED (replaced by tablet 187b3ceeccb142c4b798947e584d6044) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.485946 5619 tablet_bootstrap.cc:654] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.486096 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 0361e3b244a1437b8e402dd8602528fe with delete_type TABLET_DATA_DELETED (replaced by tablet 187b3ceeccb142c4b798947e584d6044) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:52.486202 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 0361e3b244a1437b8e402dd8602528fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0361e3b244a1437b8e402dd8602528fe already in progress: creating tablet
I20260927 13:49:52.486215 5363 tablet_service.cc:1511] Processing CreateTablet for tablet a1e7e50142e447158f90770322609a2f (DEFAULT_TABLE table=default.Table_bc37738823ef4e37a87cc856bf9bfbab [id=f5dc8e23cf63496f9b5920f02ce9cad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.486370 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c976a667e7c4b948b3aa176b13b7d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.486944 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e7e50142e447158f90770322609a2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.487028 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7
I20260927 13:49:52.487884 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3540d8e89c9c46c393a438ad3c0439b0" } new_table_name: "default.Table_85388904282441d09642d64019688c97" modify_external_catalogs: true
I20260927 13:49:52.489857 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.490237 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:52.492326 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 already in progress: creating tablet
I20260927 13:49:52.501557 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 51e1acd618fc44be9169fa1d56fa510a
I20260927 13:49:52.502278 4924 catalog_manager.cc:6934] ReplaceTablet: tablet 51e1acd618fc44be9169fa1d56fa510a deleted and replaced by tablet 14f5479761f94ee0b339e125d06a808c
I20260927 13:49:52.503415 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e1acd618fc44be9169fa1d56fa510a with delete_type TABLET_DATA_DELETED (replaced by tablet 14f5479761f94ee0b339e125d06a808c) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.504227 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e1acd618fc44be9169fa1d56fa510a with delete_type TABLET_DATA_DELETED (replaced by tablet 14f5479761f94ee0b339e125d06a808c) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:52.505261 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 51e1acd618fc44be9169fa1d56fa510a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e1acd618fc44be9169fa1d56fa510a already in progress: creating tablet
I20260927 13:49:52.509585 5606 ts_tablet_manager.cc:1929] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.509728 5606 log.cc:1199] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/2999bd61907847938975a6232e3899e4
I20260927 13:49:52.510975 5619 tablet_bootstrap.cc:492] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:52.511147 5619 ts_tablet_manager.cc:1403] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.008s
W20260927 13:49:52.511958 5045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 111818us
I20260927 13:49:52.511940 5619 raft_consensus.cc:359] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.512006 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 (DEFAULT_TABLE table=default.Table_94c0c28bb2b3422e810d8de243a2ccb2 [id=d226d55db789403b9b31e6a5461c8b5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.512130 5619 raft_consensus.cc:385] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.512223 5619 raft_consensus.cc:740] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.515183 6231 raft_consensus.cc:2749] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.515369 6232 raft_consensus.cc:493] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.515528 6127 raft_consensus.cc:493] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.515574 5227 tablet_service.cc:1511] Processing CreateTablet for tablet bb6073174dbb4ca1933685b7bd3a22e1 (DEFAULT_TABLE table=default.Table_af1fdd99060c4fbcbd2e734ce850a4ad [id=671b833b30694e8ca3802d879a947f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.515980 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6073174dbb4ca1933685b7bd3a22e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.517091 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.517180 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 0361e3b244a1437b8e402dd8602528fe with delete_type TABLET_DATA_DELETED (replaced by tablet 187b3ceeccb142c4b798947e584d6044) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.518173 6204 raft_consensus.cc:493] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.518201 6232 raft_consensus.cc:515] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.518339 6204 raft_consensus.cc:515] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.519047 6232 leader_election.cc:290] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:52.519047 6204 leader_election.cc:290] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:52.520128 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc174eab36b46fb8e276b3168fbfbcd" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:52.520498 6127 raft_consensus.cc:515] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.520716 5070 tablet_service.cc:1511] Processing CreateTablet for tablet 44d29459405b4cdd921fb43bf5a2ae81 (DEFAULT_TABLE table=default.Table_c5e936d61fc244cfb11cf0cc7e465df1 [id=7924f9989b95438bb8af0b55868bf59e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.521080 5085 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e1acd618fc44be9169fa1d56fa510a with delete_type TABLET_DATA_DELETED (replaced by tablet 14f5479761f94ee0b339e125d06a808c) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.520532 5076 tablet_service.cc:1511] Processing CreateTablet for tablet f49384587bfa41d6aabfa8ee175d6abe (DEFAULT_TABLE table=default.Table_8a9f7c16b9ec4d10848c2bb0c661fe27 [id=0cf3d2b79225499f86d3d78ef105ab4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.521260 6127 leader_election.cc:290] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.521983 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 0191cfad4e7a4b088b2ecdc246bfa58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.522441 5606 ts_tablet_manager.cc:1950] T 2999bd61907847938975a6232e3899e4 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:52.522922 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a49834518ff34b1981d44f3824c131f3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:52.524080 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b855dedb8d04145b0c4469b9ba79453" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:52.524207 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 2999bd61907847938975a6232e3899e4 (table default.Table_7cef271e951d46f38d090f892f8e54c0 [id=55be6819da774e158af5a660b686a1f3]) successfully deleted
I20260927 13:49:52.525426 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a49834518ff34b1981d44f3824c131f3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:52.525947 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.527007 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d29459405b4cdd921fb43bf5a2ae81. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:52.527038 5045 leader_election.cc:343] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:52.527184 5619 consensus_queue.cc:260] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.527374 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b8d6958e6f44d3a98ed96d89d4c1b4" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:52.527778 5619 ts_tablet_manager.cc:1434] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260927 13:49:52.528119 5619 tablet_bootstrap.cc:492] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:52.528047 5077 tablet_service.cc:1511] Processing CreateTablet for tablet a1e7e50142e447158f90770322609a2f (DEFAULT_TABLE table=default.Table_bc37738823ef4e37a87cc856bf9bfbab [id=f5dc8e23cf63496f9b5920f02ce9cad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.528406 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2e4f0715e1e94f4ca85d9f6c4fbbbc76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.528873 5044 leader_election.cc:343] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:52.529043 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e4f0715e1e94f4ca85d9f6c4fbbbc76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.529922 5619 tablet_bootstrap.cc:654] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.530534 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49384587bfa41d6aabfa8ee175d6abe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:52.530725 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet f702b0a6380543a8ac539125d4334cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f702b0a6380543a8ac539125d4334cd5 already in progress: creating tablet
W20260927 13:49:52.531004 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 98e2e305b92a4492a0df14a506c768f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98e2e305b92a4492a0df14a506c768f3 already in progress: creating tablet
W20260927 13:49:52.531291 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet e25f5898369f46fba32b7df27b334b28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e25f5898369f46fba32b7df27b334b28 already in progress: creating tablet
W20260927 13:49:52.531646 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2885e0829d014765b54124a0eb23a4dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2885e0829d014765b54124a0eb23a4dc already in progress: creating tablet
W20260927 13:49:52.531896 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2cec272546cb4373bf69e3ab344c46e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cec272546cb4373bf69e3ab344c46e1 already in progress: creating tablet
W20260927 13:49:52.532207 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 already in progress: creating tablet
W20260927 13:49:52.532544 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet ec130d31f6274fd9b730c2bb8bba817e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec130d31f6274fd9b730c2bb8bba817e already in progress: creating tablet
W20260927 13:49:52.532792 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 413d863d9a564e5d8325b4479346730d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 413d863d9a564e5d8325b4479346730d already in progress: creating tablet
W20260927 13:49:52.533442 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3afb800e7ff44aadaed8f8d85aa9efe2 already in progress: creating tablet
W20260927 13:49:52.533694 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 17153df5ba20458aa0a5c0297e959810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17153df5ba20458aa0a5c0297e959810 already in progress: creating tablet
I20260927 13:49:52.534634 5606 tablet_replica.cc:333] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:52.535017 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b855dedb8d04145b0c4469b9ba79453" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:52.535276 5606 raft_consensus.cc:2243] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.535461 5606 raft_consensus.cc:2272] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:52.536481 5045 leader_election.cc:343] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:52.537067 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e7e50142e447158f90770322609a2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.537487 5106 raft_consensus.cc:2393] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:49:52.537391 5363 tablet_service.cc:1511] Processing CreateTablet for tablet bb6073174dbb4ca1933685b7bd3a22e1 (DEFAULT_TABLE table=default.Table_af1fdd99060c4fbcbd2e734ce850a4ad [id=671b833b30694e8ca3802d879a947f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.537954 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6073174dbb4ca1933685b7bd3a22e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:52.538857 5044 leader_election.cc:343] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:52.538990 5044 leader_election.cc:304] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:52.539032 5606 ts_tablet_manager.cc:1916] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.539884 5361 tablet_service.cc:1511] Processing CreateTablet for tablet c0d3e3f86440448a88404f0ac06e0c0c (DEFAULT_TABLE table=default.Table_7675c4eea2d04c06b01cf0466c4ed466 [id=c58f2a8e5acf483d89fb782663512587]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.540421 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 5aed7fe630f64213846ad37d904f6516 (DEFAULT_TABLE table=default.Table_f439e2a6434440ef981d41bcd6ef33c1 [id=a57ba63945bb44e6a950410b44233523]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.540907 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aed7fe630f64213846ad37d904f6516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.541085 5184 leader_election.cc:304] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:52.541484 5619 tablet_bootstrap.cc:492] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:52.541635 5619 ts_tablet_manager.cc:1403] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
W20260927 13:49:52.542126 5319 leader_election.cc:343] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 1f34f2d0f6e9420a8ad38d708b658b17
I20260927 13:49:52.542428 6204 raft_consensus.cc:3060] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.542359 5319 leader_election.cc:304] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:52.543383 6247 raft_consensus.cc:2749] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.536203 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7011125c78084deca83b1570d1c2d704" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:52.543815 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d3e3f86440448a88404f0ac06e0c0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.547663 5085 tablet_service.cc:1511] Processing CreateTablet for tablet c0d3e3f86440448a88404f0ac06e0c0c (DEFAULT_TABLE table=default.Table_7675c4eea2d04c06b01cf0466c4ed466 [id=c58f2a8e5acf483d89fb782663512587]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.549821 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7011125c78084deca83b1570d1c2d704" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:52.550190 5249 raft_consensus.cc:3060] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.552021 6204 raft_consensus.cc:2749] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.552891 5071 tablet_service.cc:1511] Processing CreateTablet for tablet bb6073174dbb4ca1933685b7bd3a22e1 (DEFAULT_TABLE table=default.Table_af1fdd99060c4fbcbd2e734ce850a4ad [id=671b833b30694e8ca3802d879a947f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.553138 6127 raft_consensus.cc:2749] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.553258 5105 raft_consensus.cc:2468] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:52.553292 5227 tablet_service.cc:1511] Processing CreateTablet for tablet c0d3e3f86440448a88404f0ac06e0c0c (DEFAULT_TABLE table=default.Table_7675c4eea2d04c06b01cf0466c4ed466 [id=c58f2a8e5acf483d89fb782663512587]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.553650 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d3e3f86440448a88404f0ac06e0c0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.553977 5045 leader_election.cc:304] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:52.555088 6127 raft_consensus.cc:2749] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.555637 5619 raft_consensus.cc:359] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.555856 5619 raft_consensus.cc:385] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.555917 5619 raft_consensus.cc:740] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.557070 5619 consensus_queue.cc:260] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.557569 5619 ts_tablet_manager.cc:1434] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.015s user 0.000s sys 0.003s
I20260927 13:49:52.557909 5619 tablet_bootstrap.cc:492] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:52.560969 5626 tablet_bootstrap.cc:492] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.561165 5626 ts_tablet_manager.cc:1403] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.191s user 0.013s sys 0.013s
I20260927 13:49:52.561247 5625 ts_tablet_manager.cc:1929] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.561426 5625 log.cc:1199] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/321b26c89f1a4c8d88f401c8ece448b0
I20260927 13:49:52.561900 5625 ts_tablet_manager.cc:1950] T 321b26c89f1a4c8d88f401c8ece448b0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:52.561992 5626 raft_consensus.cc:359] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.562230 5626 raft_consensus.cc:385] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.562340 5626 raft_consensus.cc:740] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.562510 5625 tablet_replica.cc:333] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:52.562740 5625 raft_consensus.cc:2243] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.562708 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 321b26c89f1a4c8d88f401c8ece448b0 (table default.Table_dbe657f659e24156b29a259c4b995402 [id=c1b3466f7acf411dbb7b0a2d63403edf]) successfully deleted
I20260927 13:49:52.562671 5626 consensus_queue.cc:260] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.562945 5625 raft_consensus.cc:2272] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.563381 5626 ts_tablet_manager.cc:1434] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:52.563838 5626 tablet_bootstrap.cc:492] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.567184 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6073174dbb4ca1933685b7bd3a22e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.568910 5606 ts_tablet_manager.cc:1929] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.569056 5606 log.cc:1199] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/910b73528ed949bc86badcc4cf6c74a3
I20260927 13:49:52.569615 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d3e3f86440448a88404f0ac06e0c0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.571981 6247 consensus_queue.cc:1048] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:52.574790 5625 ts_tablet_manager.cc:1916] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.577991 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a1e7e50142e447158f90770322609a2f
I20260927 13:49:52.578289 5606 ts_tablet_manager.cc:1950] T 910b73528ed949bc86badcc4cf6c74a3 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:52.580143 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 910b73528ed949bc86badcc4cf6c74a3 (table default.Table_791bee87bef64e35bb7c22d8611be6d5 [id=53769bb0c70748e6b710b518250b2649]) successfully deleted
I20260927 13:49:52.580534 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e7e50142e447158f90770322609a2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.582391 5606 tablet_replica.cc:333] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:52.582868 5606 raft_consensus.cc:2243] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.585083 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e7e50142e447158f90770322609a2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:52.585819 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a1e7e50142e447158f90770322609a2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1e7e50142e447158f90770322609a2f already in progress: creating tablet
I20260927 13:49:52.586176 5606 raft_consensus.cc:2272] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.587266 5606 ts_tablet_manager.cc:1916] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.588099 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f168ee5434894b38987656de421fcdfa" } new_table_name: "default.Table_f25d83d382d244f5996d649ed03b248c" modify_external_catalogs: true
I20260927 13:49:52.590210 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e7e50142e447158f90770322609a2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.587083 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc174eab36b46fb8e276b3168fbfbcd" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:52.593727 5184 leader_election.cc:304] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:52.598747 5626 tablet_bootstrap.cc:654] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.601888 5606 ts_tablet_manager.cc:1929] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.602026 5606 log.cc:1199] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/1f34f2d0f6e9420a8ad38d708b658b17
I20260927 13:49:52.602394 5606 ts_tablet_manager.cc:1950] T 1f34f2d0f6e9420a8ad38d708b658b17 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:52.603926 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 1f34f2d0f6e9420a8ad38d708b658b17 (table default.Table_f4169b61d7234a6286c6c26a3b3b2c65 [id=30320123ccb44660bb6013069aa42e18]) successfully deleted
W20260927 13:49:52.605226 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 0191cfad4e7a4b088b2ecdc246bfa58a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0191cfad4e7a4b088b2ecdc246bfa58a already in progress: creating tablet
W20260927 13:49:52.605594 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 0361e3b244a1437b8e402dd8602528fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0361e3b244a1437b8e402dd8602528fe already in progress: creating tablet
I20260927 13:49:52.605731 5606 tablet_replica.cc:333] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:52.606259 5606 raft_consensus.cc:2243] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.606436 5606 raft_consensus.cc:2272] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.606827 5626 tablet_bootstrap.cc:492] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.606969 5626 ts_tablet_manager.cc:1403] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.001s
I20260927 13:49:52.608619 5606 ts_tablet_manager.cc:1916] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.608817 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 5aed7fe630f64213846ad37d904f6516
I20260927 13:49:52.611090 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aed7fe630f64213846ad37d904f6516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.611233 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aed7fe630f64213846ad37d904f6516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.613189 5619 tablet_bootstrap.cc:654] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.613763 4927 catalog_manager.cc:5838] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:52.614272 4927 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 7011125c78084deca83b1570d1c2d704 (table default.Table_48f2011ba0d94370a858a7187bf55677 [id=c073a79da0b440698186e6856c8c8c68]). Expected version 1 got 0
I20260927 13:49:52.615741 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4cd659e994114aa1b042d1f2391b9760"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.616451 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cd659e994114aa1b042d1f2391b9760 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.611164 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aed7fe630f64213846ad37d904f6516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.621551 5070 tablet_service.cc:1511] Processing CreateTablet for tablet 5aed7fe630f64213846ad37d904f6516 (DEFAULT_TABLE table=default.Table_f439e2a6434440ef981d41bcd6ef33c1 [id=a57ba63945bb44e6a950410b44233523]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.612382 5221 tablet_service.cc:1511] Processing CreateTablet for tablet e917382b6f3d4e009fa159ed38c342d8 (DEFAULT_TABLE table=default.Table_15989a15160f4cb5b6809d139795ed4d [id=df932e674be6487993e23fe38f4f8e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.621829 5347 tablet_service.cc:1511] Processing CreateTablet for tablet e917382b6f3d4e009fa159ed38c342d8 (DEFAULT_TABLE table=default.Table_15989a15160f4cb5b6809d139795ed4d [id=df932e674be6487993e23fe38f4f8e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.622052 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e917382b6f3d4e009fa159ed38c342d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.622081 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aed7fe630f64213846ad37d904f6516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.622229 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e917382b6f3d4e009fa159ed38c342d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.623265 5628 tablet_bootstrap.cc:492] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:52.623415 5628 ts_tablet_manager.cc:1403] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.376s user 0.016s sys 0.027s
W20260927 13:49:52.623816 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 5aed7fe630f64213846ad37d904f6516 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aed7fe630f64213846ad37d904f6516 already in progress: creating tablet
I20260927 13:49:52.625270 6204 raft_consensus.cc:2749] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.623015 5626 raft_consensus.cc:359] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.631019 5080 tablet_service.cc:1511] Processing CreateTablet for tablet e917382b6f3d4e009fa159ed38c342d8 (DEFAULT_TABLE table=default.Table_15989a15160f4cb5b6809d139795ed4d [id=df932e674be6487993e23fe38f4f8e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.631116 5626 raft_consensus.cc:385] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.631225 5626 raft_consensus.cc:740] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.631512 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e917382b6f3d4e009fa159ed38c342d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.632364 5628 raft_consensus.cc:359] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.632583 5628 raft_consensus.cc:385] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.632709 5628 raft_consensus.cc:740] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.632995 5628 consensus_queue.cc:260] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.633700 5628 ts_tablet_manager.cc:1434] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.010s user 0.000s sys 0.000s
I20260927 13:49:52.634039 5628 tablet_bootstrap.cc:492] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:52.631518 6127 raft_consensus.cc:493] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.634370 6127 raft_consensus.cc:515] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.635062 6127 leader_election.cc:290] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.635828 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a35fefc73c54d6c9b1907f55add7b92" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:52.636324 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a35fefc73c54d6c9b1907f55add7b92" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:52.636333 5626 consensus_queue.cc:260] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.636579 5248 raft_consensus.cc:2468] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:52.636571 5385 raft_consensus.cc:2468] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:52.637410 5044 leader_election.cc:304] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:52.637969 6127 raft_consensus.cc:2804] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:52.638098 6127 raft_consensus.cc:493] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:52.638223 6127 raft_consensus.cc:3060] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.641673 5626 ts_tablet_manager.cc:1434] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260927 13:49:52.642267 5626 tablet_bootstrap.cc:492] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.645159 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet f5b2b6f2ce1145a18c199bb37cc7e5b2
I20260927 13:49:52.647647 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.649283 5626 tablet_bootstrap.cc:654] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.649322 5079 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.649075 6240 consensus_queue.cc:1048] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:52.649685 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:52.650944 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 already in progress: creating tablet
I20260927 13:49:52.653795 6127 raft_consensus.cc:515] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.654094 5619 tablet_bootstrap.cc:492] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:52.654301 5619 ts_tablet_manager.cc:1403] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.096s user 0.008s sys 0.003s
I20260927 13:49:52.654520 6127 leader_election.cc:290] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.655154 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a35fefc73c54d6c9b1907f55add7b92" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:52.655201 5619 raft_consensus.cc:359] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.655369 5249 raft_consensus.cc:3060] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.655411 5619 raft_consensus.cc:385] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.655506 5619 raft_consensus.cc:740] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.655534 6127 raft_consensus.cc:493] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.655665 6127 raft_consensus.cc:515] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.655790 5619 consensus_queue.cc:260] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.656370 6127 leader_election.cc:290] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:52.656558 5619 ts_tablet_manager.cc:1434] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:49:52.658267 5619 tablet_bootstrap.cc:492] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:52.660000 5619 tablet_bootstrap.cc:654] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.661158 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b9612ffea543b9b0779c46533d91ab" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:52.662190 5044 leader_election.cc:343] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:52.662472 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 5aed7fe630f64213846ad37d904f6516 (DEFAULT_TABLE table=default.Table_f439e2a6434440ef981d41bcd6ef33c1 [id=a57ba63945bb44e6a950410b44233523]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.662873 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b9612ffea543b9b0779c46533d91ab" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:52.662881 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a35fefc73c54d6c9b1907f55add7b92" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:52.663827 5385 raft_consensus.cc:3060] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.663968 5249 raft_consensus.cc:2468] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:52.664732 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_74758221c71d4c799da6b76df7746ba3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.665323 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74758221c71d4c799da6b76df7746ba3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.665741 5044 leader_election.cc:304] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
W20260927 13:49:52.666348 5045 leader_election.cc:343] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:52.666509 5045 leader_election.cc:304] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:52.666791 6232 raft_consensus.cc:2804] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:52.666939 6232 raft_consensus.cc:697] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:52.666944 5385 raft_consensus.cc:2468] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:52.667256 6232 consensus_queue.cc:237] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.667616 6127 raft_consensus.cc:2749] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.667721 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aed7fe630f64213846ad37d904f6516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.670594 5628 tablet_bootstrap.cc:654] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.672267 5606 ts_tablet_manager.cc:1929] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.672425 5606 log.cc:1199] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/2c976a667e7c4b948b3aa176b13b7d0d
I20260927 13:49:52.672778 5606 ts_tablet_manager.cc:1950] T 2c976a667e7c4b948b3aa176b13b7d0d P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:52.674383 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 2c976a667e7c4b948b3aa176b13b7d0d (table default.Table_3efafc6b184f4f73bd2b6fad23d8991c [id=d6e13461272741bb8e15183f5bc473d2]) successfully deleted
I20260927 13:49:52.676215 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3b98290dc74d88856e13f003a1e4c7 (DEFAULT_TABLE table=default.Table_74b6e15654414f29ad685955a2c8bd3e [id=24a51641d02d4f49b1a7b093da801017]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.676935 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3b98290dc74d88856e13f003a1e4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.678762 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3b98290dc74d88856e13f003a1e4c7 (DEFAULT_TABLE table=default.Table_74b6e15654414f29ad685955a2c8bd3e [id=24a51641d02d4f49b1a7b093da801017]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.679471 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3b98290dc74d88856e13f003a1e4c7 (DEFAULT_TABLE table=default.Table_74b6e15654414f29ad685955a2c8bd3e [id=24a51641d02d4f49b1a7b093da801017]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.680061 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3b98290dc74d88856e13f003a1e4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.681699 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3b98290dc74d88856e13f003a1e4c7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:52.682372 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 already in progress: creating tablet
W20260927 13:49:52.682690 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 51e1acd618fc44be9169fa1d56fa510a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e1acd618fc44be9169fa1d56fa510a already in progress: creating tablet
W20260927 13:49:52.682945 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a1e7e50142e447158f90770322609a2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1e7e50142e447158f90770322609a2f already in progress: creating tablet
W20260927 13:49:52.683292 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 5aed7fe630f64213846ad37d904f6516 because the tablet was not found. No further retry: Not found: Tablet not found: 5aed7fe630f64213846ad37d904f6516
W20260927 13:49:52.683547 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 already in progress: creating tablet
I20260927 13:49:52.686218 6231 raft_consensus.cc:493] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.686372 6231 raft_consensus.cc:515] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.687312 6231 leader_election.cc:290] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.687714 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74226753751a49fa8ce98eafb2ca1250" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:52.687757 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74226753751a49fa8ce98eafb2ca1250" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:52.688407 5045 leader_election.cc:343] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:52.688724 5044 leader_election.cc:343] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:52.688905 5044 leader_election.cc:304] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:52.689343 6231 raft_consensus.cc:2749] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:52.691710 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da75a470ec0c4ec9afa7c18a51cd7276 consensus state has no leader
I20260927 13:49:52.694447 6240 raft_consensus.cc:493] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.694628 5625 ts_tablet_manager.cc:1929] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.694607 6240 raft_consensus.cc:515] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.694773 5625 log.cc:1199] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f70b70eb29cb4361a12ed393eabb82e1
I20260927 13:49:52.695231 5625 ts_tablet_manager.cc:1950] T f70b70eb29cb4361a12ed393eabb82e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:52.695365 6240 leader_election.cc:290] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.695634 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_0fb429f4425443cf828065d29ef97f10" } new_table_name: "default.Table_628ba6af19054b408e29160407aa53bf" modify_external_catalogs: true
I20260927 13:49:52.695910 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f70b70eb29cb4361a12ed393eabb82e1 (table default.Table_55aa0cde9170428d848330642e3b171e [id=18b81e3d511942b38a609e5f9552b4d8]) successfully deleted
W20260927 13:49:52.697118 5319 leader_election.cc:343] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 0c72e1a5dced499a932bdc302e006f29
W20260927 13:49:52.699877 5319 leader_election.cc:343] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 0c72e1a5dced499a932bdc302e006f29
I20260927 13:49:52.700018 5319 leader_election.cc:304] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:52.700490 6245 raft_consensus.cc:2749] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.702803 4928 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_cacde3a39927479095e38a677172ee0f [id=d570c2cfe66d4c0e9fdfaee2c644aab2] alter complete (version 1)
I20260927 13:49:52.708204 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 08798185a7c641f98d7dc6a6b1b72e0a (DEFAULT_TABLE table=default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.708794 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08798185a7c641f98d7dc6a6b1b72e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.709591 6245 consensus_queue.cc:1048] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:52.716200 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 08798185a7c641f98d7dc6a6b1b72e0a (DEFAULT_TABLE table=default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.716627 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08798185a7c641f98d7dc6a6b1b72e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.726528 6277 tablet.cc:1751] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:52.728067 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 08798185a7c641f98d7dc6a6b1b72e0a (DEFAULT_TABLE table=default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:52.728588 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08798185a7c641f98d7dc6a6b1b72e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:52.728794 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_54a5f652ce3b4855b55545b034f1e17d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.729449 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54a5f652ce3b4855b55545b034f1e17d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.740209 5619 tablet_bootstrap.cc:492] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:52.740414 5619 ts_tablet_manager.cc:1403] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.084s user 0.013s sys 0.008s
I20260927 13:49:52.741474 5619 raft_consensus.cc:359] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.741720 5619 raft_consensus.cc:385] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.741822 5619 raft_consensus.cc:740] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.742089 5619 consensus_queue.cc:260] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.742852 5619 ts_tablet_manager.cc:1434] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260927 13:49:52.744415 6245 raft_consensus.cc:493] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.744585 6245 raft_consensus.cc:515] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.745262 6245 leader_election.cc:290] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.745466 5619 tablet_bootstrap.cc:492] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:52.746027 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a49834518ff34b1981d44f3824c131f3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:52.746189 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a49834518ff34b1981d44f3824c131f3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:52.746340 5108 raft_consensus.cc:2468] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:52.746421 5249 raft_consensus.cc:2468] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:52.747061 5319 leader_election.cc:304] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:52.748132 6245 raft_consensus.cc:2804] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:52.748227 6245 raft_consensus.cc:493] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:52.748344 6245 raft_consensus.cc:3060] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.748708 5628 tablet_bootstrap.cc:492] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:52.748889 5628 ts_tablet_manager.cc:1403] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.115s user 0.007s sys 0.001s
I20260927 13:49:52.749792 5628 raft_consensus.cc:359] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.749992 5628 raft_consensus.cc:385] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.750078 5628 raft_consensus.cc:740] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.751485 6245 raft_consensus.cc:515] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.751981 5628 consensus_queue.cc:260] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.752701 5628 ts_tablet_manager.cc:1434] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260927 13:49:52.753005 5628 tablet_bootstrap.cc:492] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:52.753152 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a49834518ff34b1981d44f3824c131f3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:52.753363 5249 raft_consensus.cc:3060] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.754680 5626 tablet_bootstrap.cc:492] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.754859 5626 ts_tablet_manager.cc:1403] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.113s user 0.003s sys 0.005s
W20260927 13:49:52.754966 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 992bf643dee64bccaa993a08027aa5fc consensus state has no leader
I20260927 13:49:52.755873 5626 raft_consensus.cc:359] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.756055 5626 raft_consensus.cc:385] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.756117 5626 raft_consensus.cc:740] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.756408 5626 consensus_queue.cc:260] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.757282 5249 raft_consensus.cc:2468] T a49834518ff34b1981d44f3824c131f3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:52.757763 5319 leader_election.cc:304] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:52.758213 6247 raft_consensus.cc:2804] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:52.758340 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_9db5a06b3541451089e3b03a35674a16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.759040 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9db5a06b3541451089e3b03a35674a16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.759035 6247 raft_consensus.cc:697] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:52.760042 6247 consensus_queue.cc:237] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.761066 6245 leader_election.cc:290] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.762326 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a49834518ff34b1981d44f3824c131f3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:52.762511 5626 ts_tablet_manager.cc:1434] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 13:49:52.762765 5108 raft_consensus.cc:3060] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:52.763984 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 98e2e305b92a4492a0df14a506c768f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98e2e305b92a4492a0df14a506c768f3 already in progress: creating tablet
I20260927 13:49:52.764722 5619 tablet_bootstrap.cc:654] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:52.764703 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet f702b0a6380543a8ac539125d4334cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f702b0a6380543a8ac539125d4334cd5 already in progress: creating tablet
I20260927 13:49:52.765051 5625 tablet_replica.cc:333] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:52.765870 5626 tablet_bootstrap.cc:492] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.768242 5625 raft_consensus.cc:2243] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.768458 5625 raft_consensus.cc:2272] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.769304 5625 ts_tablet_manager.cc:1916] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:52.770337 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7011125c78084deca83b1570d1c2d704 consensus state has no leader
I20260927 13:49:52.771399 5108 raft_consensus.cc:2468] T a49834518ff34b1981d44f3824c131f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:52.777694 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f0c950212bbf448eb0f057c01e482ecf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.778331 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0c950212bbf448eb0f057c01e482ecf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.781080 5628 tablet_bootstrap.cc:654] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.781035 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 1cc174eab36b46fb8e276b3168fbfbcd (table default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe]). Expected version 3 got 0
I20260927 13:49:52.781248 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 76add3b9ef254ece958121a336e87936 (table default.Table_cacde3a39927479095e38a677172ee0f [id=d570c2cfe66d4c0e9fdfaee2c644aab2]). Expected version 1 got 0
I20260927 13:49:52.782894 5626 tablet_bootstrap.cc:654] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.784956 4925 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 1cc174eab36b46fb8e276b3168fbfbcd (table default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe]). Expected version 3 got 0
I20260927 13:49:52.785133 4925 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
I20260927 13:49:52.785312 4925 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (table default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]). Expected version 1 got 0
I20260927 13:49:52.787256 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d90fa8a272ec463da41c187d77d01a3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.787966 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d90fa8a272ec463da41c187d77d01a3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.788115 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bf9abe277040078eb765728e3c52ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.788457 5623 tablet_replica.cc:333] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:52.788726 5623 raft_consensus.cc:2243] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.788944 5623 raft_consensus.cc:2272] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.789721 5623 ts_tablet_manager.cc:1916] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.796917 5623 ts_tablet_manager.cc:1929] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.797125 5623 log.cc:1199] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/24bf9abe277040078eb765728e3c52ef
I20260927 13:49:52.797523 5623 ts_tablet_manager.cc:1950] T 24bf9abe277040078eb765728e3c52ef P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:52.798606 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 24bf9abe277040078eb765728e3c52ef (table default.Table_f3b7b12a18cd41dc98240136b5611848 [id=9e5e2ee15095486b815cf581c218a75c]) successfully deleted
I20260927 13:49:52.801434 5628 tablet_bootstrap.cc:492] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:52.801703 5628 ts_tablet_manager.cc:1403] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.003s
I20260927 13:49:52.803100 5628 raft_consensus.cc:359] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.804963 5628 raft_consensus.cc:385] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.805208 5628 raft_consensus.cc:740] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.805636 5628 consensus_queue.cc:260] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.806913 4924 catalog_manager.cc:5838] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65). New cstate: current_term: 1 leader_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:52.807399 4924 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
I20260927 13:49:52.807617 4924 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:49:52.807828 4924 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (table default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]). Expected version 1 got 0
I20260927 13:49:52.810491 5626 tablet_bootstrap.cc:492] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.810628 5626 ts_tablet_manager.cc:1403] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.000s
I20260927 13:49:52.811419 5626 raft_consensus.cc:359] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.811582 5626 raft_consensus.cc:385] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.811653 5626 raft_consensus.cc:740] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.811880 5626 consensus_queue.cc:260] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.815330 5626 ts_tablet_manager.cc:1434] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:49:52.817252 5628 ts_tablet_manager.cc:1434] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260927 13:49:52.817564 5628 tablet_bootstrap.cc:492] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:52.818373 5626 tablet_bootstrap.cc:492] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.820197 5626 tablet_bootstrap.cc:654] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.824380 5628 tablet_bootstrap.cc:654] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:52.831387 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d897f986d26a44f4894e147a74a90949 has no consensus state
I20260927 13:49:52.837404 5626 tablet_bootstrap.cc:492] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.837574 5626 ts_tablet_manager.cc:1403] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.003s
I20260927 13:49:52.838415 5625 ts_tablet_manager.cc:1929] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.838369 5626 raft_consensus.cc:359] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.838609 5625 log.cc:1199] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/3b855dedb8d04145b0c4469b9ba79453
I20260927 13:49:52.838606 5626 raft_consensus.cc:385] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.838681 5626 raft_consensus.cc:740] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.839071 5625 ts_tablet_manager.cc:1950] T 3b855dedb8d04145b0c4469b9ba79453 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:52.838980 5626 consensus_queue.cc:260] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.842170 5626 ts_tablet_manager.cc:1434] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:49:52.843310 5626 tablet_bootstrap.cc:492] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.844267 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 3b855dedb8d04145b0c4469b9ba79453 (table default.Table_fec7020fbf30493cbe6a218ae1cc9dab [id=05951559c98143f5bf067109c7ce2e28]) successfully deleted
W20260927 13:49:52.844995 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet e25f5898369f46fba32b7df27b334b28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e25f5898369f46fba32b7df27b334b28 already in progress: creating tablet
I20260927 13:49:52.845067 5625 tablet_replica.cc:333] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:52.845269 5625 raft_consensus.cc:2243] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:52.845256 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 2885e0829d014765b54124a0eb23a4dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2885e0829d014765b54124a0eb23a4dc already in progress: creating tablet
I20260927 13:49:52.845461 5625 raft_consensus.cc:2272] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:52.845480 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 2cec272546cb4373bf69e3ab344c46e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cec272546cb4373bf69e3ab344c46e1 already in progress: creating tablet
W20260927 13:49:52.845700 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 already in progress: creating tablet
I20260927 13:49:52.846051 5625 ts_tablet_manager.cc:1916] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:52.846060 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet ec130d31f6274fd9b730c2bb8bba817e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec130d31f6274fd9b730c2bb8bba817e already in progress: creating tablet
I20260927 13:49:52.847666 5626 tablet_bootstrap.cc:654] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.849313 5619 tablet_bootstrap.cc:492] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:52.849521 5619 ts_tablet_manager.cc:1403] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.104s user 0.000s sys 0.004s
I20260927 13:49:52.850539 5619 raft_consensus.cc:359] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.851112 5619 raft_consensus.cc:385] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.853259 5619 raft_consensus.cc:740] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.853590 5619 consensus_queue.cc:260] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.858851 5628 tablet_bootstrap.cc:492] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:52.859323 5628 ts_tablet_manager.cc:1403] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.001s
I20260927 13:49:52.859961 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_694d68f5161840289b065bce1d592d4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:52.860114 5628 raft_consensus.cc:359] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.860306 5628 raft_consensus.cc:385] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.860370 5628 raft_consensus.cc:740] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:49:52.860569 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_694d68f5161840289b065bce1d592d4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.860646 5628 consensus_queue.cc:260] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.862015 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_cb043d4ac1634ad497377f4eda030a17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:52.862555 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb043d4ac1634ad497377f4eda030a17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:52.862560 5628 ts_tablet_manager.cc:1434] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:52.862893 5628 tablet_bootstrap.cc:492] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:52.863976 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b5cc5519bcfb41efacb0dab9a602c3d9" } modify_external_catalogs: true
I20260927 13:49:52.864131 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b5cc5519bcfb41efacb0dab9a602c3d9" } modify_external_catalogs: true
I20260927 13:49:52.869843 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 129c2f99d5b143b3bd25731cfeb0009e with delete_type TABLET_DATA_DELETED (replaced by tablet 46537e1b33f24d50b705d53f6978da3c) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.870252 5623 tablet_replica.cc:333] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:52.870451 5623 raft_consensus.cc:2243] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.870640 5623 raft_consensus.cc:2272] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.872009 5623 ts_tablet_manager.cc:1916] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.874305 5628 tablet_bootstrap.cc:654] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.879544 5626 tablet_bootstrap.cc:492] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:52.879721 5623 ts_tablet_manager.cc:1929] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.879972 5623 log.cc:1199] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/129c2f99d5b143b3bd25731cfeb0009e
I20260927 13:49:52.879737 5626 ts_tablet_manager.cc:1403] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.000s
I20260927 13:49:52.881255 5626 raft_consensus.cc:359] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.881510 5626 raft_consensus.cc:385] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.881633 5626 raft_consensus.cc:740] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.881927 5626 consensus_queue.cc:260] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.882519 5626 ts_tablet_manager.cc:1434] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:52.882802 5623 ts_tablet_manager.cc:1950] T 129c2f99d5b143b3bd25731cfeb0009e P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:52.883599 5619 ts_tablet_manager.cc:1434] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260927 13:49:52.883106 5626 tablet_bootstrap.cc:492] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:52.860052 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c72e1a5dced499a932bdc302e006f29 with delete_type TABLET_DATA_DELETED (replaced by tablet 2cec272546cb4373bf69e3ab344c46e1) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.888243 5619 tablet_bootstrap.cc:492] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:52.888797 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 129c2f99d5b143b3bd25731cfeb0009e (table default.Table_22d5c80b2b5b4ee09361300740be2ab2 [id=f78659fb9203483aa74b05e453e1fa63]) successfully deleted
I20260927 13:49:52.889354 5606 tablet_replica.cc:333] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:52.889554 5606 raft_consensus.cc:2243] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.889727 5606 raft_consensus.cc:2272] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.890857 5606 ts_tablet_manager.cc:1916] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.891918 5625 ts_tablet_manager.cc:1929] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.892064 5625 log.cc:1199] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/17153df5ba20458aa0a5c0297e959810
I20260927 13:49:52.894290 5628 tablet_bootstrap.cc:492] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:52.894438 5628 ts_tablet_manager.cc:1403] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.002s
W20260927 13:49:52.894913 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ee18063dc634385b9e61fae3b3ece99 consensus state has no leader
I20260927 13:49:52.890359 5626 tablet_bootstrap.cc:654] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.896591 5628 raft_consensus.cc:359] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:52.896802 5628 raft_consensus.cc:385] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.896881 5628 raft_consensus.cc:740] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.897101 5628 consensus_queue.cc:260] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:52.897413 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e02f217077414076ab9e4f74fdd61b36" } modify_external_catalogs: true
I20260927 13:49:52.897600 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e02f217077414076ab9e4f74fdd61b36" } modify_external_catalogs: true
I20260927 13:49:52.899792 5628 ts_tablet_manager.cc:1434] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:52.899998 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 129c2f99d5b143b3bd25731cfeb0009e with delete_type TABLET_DATA_DELETED (replaced by tablet 46537e1b33f24d50b705d53f6978da3c) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.900112 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet b64d3aa052bf4c48b3802f6006cce9c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 03a1f13b31934baa8ce18fc499e94806) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.900434 5628 tablet_bootstrap.cc:492] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:52.900503 5623 tablet_replica.cc:333] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:52.900561 5108 raft_consensus.cc:3060] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:52.900720 5623 raft_consensus.cc:2243] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.900890 5623 raft_consensus.cc:2272] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.901496 5619 tablet_bootstrap.cc:654] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.901624 5249 raft_consensus.cc:1275] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Refusing update from remote peer bb28c54312c94d7dafb1c2abf7870735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:52.902467 6245 consensus_queue.cc:1048] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:49:52.902637 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 129c2f99d5b143b3bd25731cfeb0009e because the tablet was not found. No further retry: Not found: Tablet not found: 129c2f99d5b143b3bd25731cfeb0009e
I20260927 13:49:52.902947 5623 ts_tablet_manager.cc:1916] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.909622 5108 raft_consensus.cc:1275] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Refusing update from remote peer bb28c54312c94d7dafb1c2abf7870735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:52.892493 5625 ts_tablet_manager.cc:1950] T 17153df5ba20458aa0a5c0297e959810 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:52.910838 6245 consensus_queue.cc:1048] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:52.911471 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 17153df5ba20458aa0a5c0297e959810 (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]) successfully deleted
I20260927 13:49:52.911710 5625 tablet_replica.cc:333] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:52.911942 5625 raft_consensus.cc:2243] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.912106 5625 raft_consensus.cc:2272] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:52.912238 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3afb800e7ff44aadaed8f8d85aa9efe2 already in progress: creating tablet
W20260927 13:49:52.912510 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 413d863d9a564e5d8325b4479346730d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 413d863d9a564e5d8325b4479346730d already in progress: creating tablet
I20260927 13:49:52.912688 5625 ts_tablet_manager.cc:1916] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.915411 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_73693476f4564e2e8e0f60b0f7e3d474" } modify_external_catalogs: true
I20260927 13:49:52.915630 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_73693476f4564e2e8e0f60b0f7e3d474" } modify_external_catalogs: true
I20260927 13:49:52.918526 6245 raft_consensus.cc:493] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.918715 6245 raft_consensus.cc:515] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:52.919340 6245 leader_election.cc:290] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:52.919659 5628 tablet_bootstrap.cc:654] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.920027 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet dae5f63f709f455b8eceb44771845a3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:52.920549 5319 leader_election.cc:343] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 24bf9abe277040078eb765728e3c52ef
W20260927 13:49:52.921137 5319 leader_election.cc:343] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 24bf9abe277040078eb765728e3c52ef
I20260927 13:49:52.921277 5319 leader_election.cc:304] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:52.921810 6245 raft_consensus.cc:2749] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.924641 5606 ts_tablet_manager.cc:1929] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.928498 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet bbb4f42522e84964aeb19358ee02dfc2 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:52.930159 4928 master_service.cc:960] ReplaceTablet: received request to replace tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:52.932330 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 7011125c78084deca83b1570d1c2d704 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:52.933877 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (table default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]). Expected version 1 got 0
I20260927 13:49:52.934332 4921 catalog_manager.cc:5838] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:52.934957 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1cc174eab36b46fb8e276b3168fbfbcd (table default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe]). Expected version 3 got 0
I20260927 13:49:52.935230 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
I20260927 13:49:52.937378 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet b8311ff24259477a9523355908ac14f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.940433 6232 raft_consensus.cc:493] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:52.940340 5606 log.cc:1199] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/0c72e1a5dced499a932bdc302e006f29
I20260927 13:49:52.940595 6232 raft_consensus.cc:515] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:52.940981 5606 ts_tablet_manager.cc:1950] T 0c72e1a5dced499a932bdc302e006f29 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:52.941323 6232 leader_election.cc:290] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:52.942214 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 0c72e1a5dced499a932bdc302e006f29 (table default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]) successfully deleted
I20260927 13:49:52.942627 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059afd48ac4a41569ed1d3556b7974f0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:52.943274 5044 leader_election.cc:343] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:52.943508 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059afd48ac4a41569ed1d3556b7974f0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:52.944202 5045 leader_election.cc:343] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:52.944319 5045 leader_election.cc:304] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:52.944804 6232 raft_consensus.cc:2749] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:52.944857 5623 ts_tablet_manager.cc:1929] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.944988 5623 log.cc:1199] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b64d3aa052bf4c48b3802f6006cce9c9
I20260927 13:49:52.945302 5623 ts_tablet_manager.cc:1950] T b64d3aa052bf4c48b3802f6006cce9c9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:52.946354 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b64d3aa052bf4c48b3802f6006cce9c9 (table default.Table_cf1d80366a7743b3b4fea68ea5246139 [id=ded13e9c993046cd891db043b1ff6a95]) successfully deleted
I20260927 13:49:52.946957 5628 tablet_bootstrap.cc:492] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:52.947125 5628 ts_tablet_manager.cc:1403] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.002s
I20260927 13:49:52.947889 5628 raft_consensus.cc:359] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.948078 5628 raft_consensus.cc:385] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:52.948148 5628 raft_consensus.cc:740] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:52.948374 5628 consensus_queue.cc:260] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:52.948886 5628 ts_tablet_manager.cc:1434] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:52.949199 5628 tablet_bootstrap.cc:492] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:52.955523 5628 tablet_bootstrap.cc:654] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:52.966321 5623 tablet_replica.cc:333] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:52.968984 6251 tablet.cc:1751] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:52.969267 4927 master_service.cc:960] ReplaceTablet: received request to replace tablet 3933c0a2fd6547f28528fae7d443a2c1 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:52.969437 5623 raft_consensus.cc:2243] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:52.969648 5623 raft_consensus.cc:2272] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:52.972059 6232 consensus_queue.cc:1048] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:52.975503 5625 ts_tablet_manager.cc:1929] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:52.975643 5625 log.cc:1199] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/56b9612ffea543b9b0779c46533d91ab
I20260927 13:49:52.976017 5625 ts_tablet_manager.cc:1950] T 56b9612ffea543b9b0779c46533d91ab P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:52.977100 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 56b9612ffea543b9b0779c46533d91ab (table default.Table_8f56db43a65c4bd5a295fc1966c944a2 [id=a8089fe90d01478dbf155541ed227099]) successfully deleted
I20260927 13:49:52.978329 5623 ts_tablet_manager.cc:1916] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:52.982139 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 715b9af057f6425eb664e2399677890f
I20260927 13:49:52.983027 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 715b9af057f6425eb664e2399677890f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:52.983776 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 715b9af057f6425eb664e2399677890f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.984496 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 715b9af057f6425eb664e2399677890f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:52.985483 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 715b9af057f6425eb664e2399677890f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 715b9af057f6425eb664e2399677890f already in progress: creating tablet
W20260927 13:49:52.985523 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 already in progress: creating tablet
I20260927 13:49:52.985584 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 7c2f814bb9ff41ebab19e8c16cf4affa
I20260927 13:49:52.986236 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:52.987160 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c2f814bb9ff41ebab19e8c16cf4affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:52.987399 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c2f814bb9ff41ebab19e8c16cf4affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:52.987795 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c2f814bb9ff41ebab19e8c16cf4affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:52.988075 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 7c2f814bb9ff41ebab19e8c16cf4affa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c2f814bb9ff41ebab19e8c16cf4affa already in progress: creating tablet
W20260927 13:49:52.988186 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 0361e3b244a1437b8e402dd8602528fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0361e3b244a1437b8e402dd8602528fe already in progress: creating tablet
I20260927 13:49:52.992148 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_44d960a4808c41b3857a9d76053fc16a" } modify_external_catalogs: true
I20260927 13:49:52.993134 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_44d960a4808c41b3857a9d76053fc16a" } modify_external_catalogs: true
I20260927 13:49:52.994599 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8442b904c41d4d39a56497c27763e7f4" } modify_external_catalogs: true
I20260927 13:49:52.997969 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_dcdac8819c9b408fbef7c11fdd631090" } new_table_name: "default.Table_a6d8378ddd6f43a9a731014528c1d94a" modify_external_catalogs: true
I20260927 13:49:53.000056 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_fe3174f3ee074adf9193e1f8228cdcce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:52.995857 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8442b904c41d4d39a56497c27763e7f4" } modify_external_catalogs: true
I20260927 13:49:53.000758 6300 tablet.cc:1751] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260927 13:49:53.003598 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe3174f3ee074adf9193e1f8228cdcce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:53.004870 4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.125:42239, user_credentials={real_user=slave}} blocked reactor thread for 43785.9us
I20260927 13:49:53.006615 5619 tablet_bootstrap.cc:492] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
W20260927 13:49:53.006978 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 51e1acd618fc44be9169fa1d56fa510a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e1acd618fc44be9169fa1d56fa510a already in progress: creating tablet
W20260927 13:49:53.007731 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 0191cfad4e7a4b088b2ecdc246bfa58a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0191cfad4e7a4b088b2ecdc246bfa58a already in progress: creating tablet
I20260927 13:49:53.008199 5619 ts_tablet_manager.cc:1403] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.120s user 0.004s sys 0.003s
W20260927 13:49:53.011554 4915 consensus_peers.cc:597] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de -> Peer e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239): Couldn't send request to peer e421351a34d1463e9773dcebdeebae3c. Status: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260927 13:49:53.012979 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a1e7e50142e447158f90770322609a2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1e7e50142e447158f90770322609a2f already in progress: creating tablet
W20260927 13:49:53.013576 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 5aed7fe630f64213846ad37d904f6516 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aed7fe630f64213846ad37d904f6516 already in progress: creating tablet
W20260927 13:49:53.016218 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 already in progress: creating tablet
I20260927 13:49:53.016572 5625 tablet_replica.cc:333] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:53.016844 5625 raft_consensus.cc:2243] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.022075 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet bbb4f42522e84964aeb19358ee02dfc2
I20260927 13:49:53.022622 4922 catalog_manager.cc:6934] ReplaceTablet: tablet bbb4f42522e84964aeb19358ee02dfc2 deleted and replaced by tablet fcf4c143d5824458be4a42945c338dc9
I20260927 13:49:53.022835 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet dae5f63f709f455b8eceb44771845a3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.022831 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bf9abe277040078eb765728e3c52ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.022943 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f9676fa793204703b70a70c0c3ea563d" } new_table_name: "default.Table_4155d438fc7c4d6cbe87e16451c6bbba" modify_external_catalogs: true
I20260927 13:49:53.023110 5606 tablet_replica.cc:333] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:53.023337 5606 raft_consensus.cc:2243] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.023504 5606 raft_consensus.cc:2272] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.026587 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet bbb4f42522e84964aeb19358ee02dfc2 with delete_type TABLET_DATA_DELETED (replaced by tablet fcf4c143d5824458be4a42945c338dc9) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.027652 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet bbb4f42522e84964aeb19358ee02dfc2 with delete_type TABLET_DATA_DELETED (replaced by tablet fcf4c143d5824458be4a42945c338dc9) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.027889 5606 ts_tablet_manager.cc:1916] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.033912 5626 tablet_bootstrap.cc:492] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:53.034168 5626 ts_tablet_manager.cc:1403] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.151s user 0.002s sys 0.006s
I20260927 13:49:53.035135 5626 raft_consensus.cc:359] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.035445 5626 raft_consensus.cc:385] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.035568 5626 raft_consensus.cc:740] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.035905 5626 consensus_queue.cc:260] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.016525 5619 raft_consensus.cc:359] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.037509 6232 raft_consensus.cc:493] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.037694 6232 raft_consensus.cc:515] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.037937 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet bbb4f42522e84964aeb19358ee02dfc2 with delete_type TABLET_DATA_DELETED (replaced by tablet fcf4c143d5824458be4a42945c338dc9) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.037559 5628 tablet_bootstrap.cc:492] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:53.039565 5625 raft_consensus.cc:2272] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.039990 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81b44fb2f644dff899d6d4aa435ccee" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:53.040966 6232 leader_election.cc:290] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:53.040977 5628 ts_tablet_manager.cc:1403] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.090s user 0.000s sys 0.005s
W20260927 13:49:53.041224 5044 leader_election.cc:343] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.042006 5628 raft_consensus.cc:359] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:53.042238 5628 raft_consensus.cc:385] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.042351 5628 raft_consensus.cc:740] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.042649 5628 consensus_queue.cc:260] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:53.043324 5628 ts_tablet_manager.cc:1434] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:53.042138 5625 ts_tablet_manager.cc:1916] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.043292 5626 ts_tablet_manager.cc:1434] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260927 13:49:53.044133 5628 tablet_bootstrap.cc:492] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:53.046957 5623 ts_tablet_manager.cc:1929] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.047206 5623 log.cc:1199] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/dae5f63f709f455b8eceb44771845a3f
I20260927 13:49:53.047680 5623 ts_tablet_manager.cc:1950] T dae5f63f709f455b8eceb44771845a3f P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:53.054152 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a0e14fd01a9141cdb2df030ee0dd05db
I20260927 13:49:53.055274 5619 raft_consensus.cc:385] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.055429 5619 raft_consensus.cc:740] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.055717 5619 consensus_queue.cc:260] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.061928 5628 tablet_bootstrap.cc:654] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.054152 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet dae5f63f709f455b8eceb44771845a3f (table default.Table_f1bd6c5f7d1c40e4b4898befde87e9a0 [id=76f4e4598d75471f806ae3f3efa2f104]) successfully deleted
I20260927 13:49:53.063763 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet a0e14fd01a9141cdb2df030ee0dd05db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.063910 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet a0e14fd01a9141cdb2df030ee0dd05db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.064738 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet a0e14fd01a9141cdb2df030ee0dd05db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:53.065994 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 715b9af057f6425eb664e2399677890f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 715b9af057f6425eb664e2399677890f already in progress: creating tablet
I20260927 13:49:53.066788 5626 tablet_bootstrap.cc:492] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.066725 6277 tablet.cc:1751] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260927 13:49:53.068410 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 7c2f814bb9ff41ebab19e8c16cf4affa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c2f814bb9ff41ebab19e8c16cf4affa already in progress: creating tablet
I20260927 13:49:53.069646 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81b44fb2f644dff899d6d4aa435ccee" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:53.071349 5045 leader_election.cc:343] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.071930 5045 leader_election.cc:304] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.072217 6231 raft_consensus.cc:2749] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:53.072674 5625 ts_tablet_manager.cc:1929] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.072810 5625 log.cc:1199] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b8311ff24259477a9523355908ac14f8
W20260927 13:49:53.073973 4916 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet da75a470ec0c4ec9afa7c18a51cd7276 (table default.Table_3af91c12409e4dbc97a79774e12d3634 [id=77f35cbefeec4875839aadb06d0d0238], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet da75a470ec0c4ec9afa7c18a51cd7276 consensus state has no leader
I20260927 13:49:53.074179 6231 consensus_queue.cc:1048] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:49:53.074965 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet bbb4f42522e84964aeb19358ee02dfc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbb4f42522e84964aeb19358ee02dfc2 already in progress: creating tablet
W20260927 13:49:53.075641 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a0e14fd01a9141cdb2df030ee0dd05db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0e14fd01a9141cdb2df030ee0dd05db already in progress: creating tablet
W20260927 13:49:53.076807 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3513663de6724b108adcb46cc151163c consensus state has no leader
I20260927 13:49:53.077278 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4acaf9798ba44467a19273723178f257" } new_table_name: "default.Table_7567474623ce4d588bb654dc21623cb6" modify_external_catalogs: true
I20260927 13:49:53.078203 5626 tablet_bootstrap.cc:654] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.078871 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ba83ebe4eac44519a9ebd65f9a503c58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.079387 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba83ebe4eac44519a9ebd65f9a503c58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.081175 5625 ts_tablet_manager.cc:1950] T b8311ff24259477a9523355908ac14f8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:53.082219 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b8311ff24259477a9523355908ac14f8 (table default.Table_2e1239a5183b45839ad4a031b7398f95 [id=deaa0ccfa31b4763887d5bfd6418ce26]) successfully deleted
W20260927 13:49:53.085760 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 715b9af057f6425eb664e2399677890f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 715b9af057f6425eb664e2399677890f already in progress: creating tablet
W20260927 13:49:53.090993 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7c2f814bb9ff41ebab19e8c16cf4affa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c2f814bb9ff41ebab19e8c16cf4affa already in progress: creating tablet
W20260927 13:49:53.091859 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet bbb4f42522e84964aeb19358ee02dfc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbb4f42522e84964aeb19358ee02dfc2 already in progress: creating tablet
I20260927 13:49:53.092626 5628 tablet_bootstrap.cc:492] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:53.092773 5628 ts_tablet_manager.cc:1403] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.001s
W20260927 13:49:53.093286 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 44d85213c05c465abda78cc49c70d36f has no consensus state
I20260927 13:49:53.093662 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_9fd68b572cdd486399d89cd3f517b796" } new_table_name: "default.Table_3abb801c19b540b7b65b1d75791fdff7" modify_external_catalogs: true
I20260927 13:49:53.093752 5628 raft_consensus.cc:359] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.094002 5628 raft_consensus.cc:385] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.094087 5628 raft_consensus.cc:740] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.094473 5628 consensus_queue.cc:260] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.095242 5628 ts_tablet_manager.cc:1434] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:49:53.095659 5628 tablet_bootstrap.cc:492] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:53.096197 4923 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 7011125c78084deca83b1570d1c2d704 (table default.Table_a09e5155fa1148ef88003c6c1afedce5 [id=c073a79da0b440698186e6856c8c8c68]). Expected version 2 got 0
W20260927 13:49:53.096347 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9ff32095a554784b91e74012ad8e020 consensus state has no leader
I20260927 13:49:53.096771 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_0fcacd34a360441db89b05359f9c8c21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:53.096916 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2e63e80572a047aabb5d20f0417a30cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:53.097409 5628 tablet_bootstrap.cc:654] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.100561 5626 tablet_bootstrap.cc:492] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:53.100709 5626 ts_tablet_manager.cc:1403] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.002s
I20260927 13:49:53.101428 5626 raft_consensus.cc:359] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.101598 5626 raft_consensus.cc:385] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.101672 5626 raft_consensus.cc:740] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.101886 5626 consensus_queue.cc:260] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.102605 5626 ts_tablet_manager.cc:1434] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:53.104043 5626 tablet_bootstrap.cc:492] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.109877 5626 tablet_bootstrap.cc:654] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:53.112386 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a0e14fd01a9141cdb2df030ee0dd05db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0e14fd01a9141cdb2df030ee0dd05db already in progress: creating tablet
I20260927 13:49:53.113229 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 85130d7ea68545518ca3c255e28a20d3 (DEFAULT_TABLE table=default.Table_7a18018de90d47688f3668cb739ddaa5 [id=de8b7ce50f8c4bb4a105d25f701d4d82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.113641 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85130d7ea68545518ca3c255e28a20d3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:53.120431 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e63e80572a047aabb5d20f0417a30cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.123090 5628 tablet_bootstrap.cc:492] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:53.123335 5628 ts_tablet_manager.cc:1403] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.002s
W20260927 13:49:53.123997 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fcacd34a360441db89b05359f9c8c21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.124436 5628 raft_consensus.cc:359] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.124565 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 85130d7ea68545518ca3c255e28a20d3 (DEFAULT_TABLE table=default.Table_7a18018de90d47688f3668cb739ddaa5 [id=de8b7ce50f8c4bb4a105d25f701d4d82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.125459 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85130d7ea68545518ca3c255e28a20d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.125598 5626 tablet_bootstrap.cc:492] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:53.125773 5626 ts_tablet_manager.cc:1403] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.002s
I20260927 13:49:53.125800 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 85130d7ea68545518ca3c255e28a20d3 (DEFAULT_TABLE table=default.Table_7a18018de90d47688f3668cb739ddaa5 [id=de8b7ce50f8c4bb4a105d25f701d4d82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.126304 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85130d7ea68545518ca3c255e28a20d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.126600 5626 raft_consensus.cc:359] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.126837 5626 raft_consensus.cc:385] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.126906 5626 raft_consensus.cc:740] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.127141 5626 consensus_queue.cc:260] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.127938 5626 ts_tablet_manager.cc:1434] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:53.128312 5626 tablet_bootstrap.cc:492] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.130447 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 9872d637765b4d719e2de63ae1eb3196 (DEFAULT_TABLE table=default.Table_c7e950edad044de5b910f91a80448895 [id=fde3e0efd65f4345b3fd64d141753ca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.130575 5626 tablet_bootstrap.cc:654] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.130924 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9872d637765b4d719e2de63ae1eb3196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.124632 5628 raft_consensus.cc:385] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.134337 5628 raft_consensus.cc:740] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.134578 5628 consensus_queue.cc:260] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.135079 5628 ts_tablet_manager.cc:1434] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260927 13:49:53.135892 5606 ts_tablet_manager.cc:1929] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.136050 5606 log.cc:1199] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/dae5f63f709f455b8eceb44771845a3f
I20260927 13:49:53.137650 5606 ts_tablet_manager.cc:1950] T dae5f63f709f455b8eceb44771845a3f P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:53.142714 5347 tablet_service.cc:1511] Processing CreateTablet for tablet e54a83664397460399960a0f73966fef (DEFAULT_TABLE table=default.Table_8e2e1621778d459a930d7f15ea30dd06 [id=e6cd27ae03884c518cebff6b8a7483d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.143267 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54a83664397460399960a0f73966fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.143410 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 14f5479761f94ee0b339e125d06a808c
I20260927 13:49:53.144366 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 9872d637765b4d719e2de63ae1eb3196 (DEFAULT_TABLE table=default.Table_c7e950edad044de5b910f91a80448895 [id=fde3e0efd65f4345b3fd64d141753ca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.144440 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0
I20260927 13:49:53.144793 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9872d637765b4d719e2de63ae1eb3196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.145155 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 9872d637765b4d719e2de63ae1eb3196 (DEFAULT_TABLE table=default.Table_c7e950edad044de5b910f91a80448895 [id=fde3e0efd65f4345b3fd64d141753ca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.145604 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9872d637765b4d719e2de63ae1eb3196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.149799 5070 tablet_service.cc:1511] Processing CreateTablet for tablet e54a83664397460399960a0f73966fef (DEFAULT_TABLE table=default.Table_8e2e1621778d459a930d7f15ea30dd06 [id=e6cd27ae03884c518cebff6b8a7483d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.149825 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 4709e969569b43a7aace8d7cfe4e64c5 (DEFAULT_TABLE table=default.Table_56b64738ce624ac98e0b4a4b327ab204 [id=11b7ccc28a104e57a243695c47b55a65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.150214 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4709e969569b43a7aace8d7cfe4e64c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.150202 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 14f5479761f94ee0b339e125d06a808c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.150635 5085 tablet_service.cc:1511] Processing CreateTablet for tablet 4709e969569b43a7aace8d7cfe4e64c5 (DEFAULT_TABLE table=default.Table_56b64738ce624ac98e0b4a4b327ab204 [id=11b7ccc28a104e57a243695c47b55a65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.150889 5619 ts_tablet_manager.cc:1434] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.042s user 0.001s sys 0.000s
I20260927 13:49:53.151630 5619 tablet_bootstrap.cc:492] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:53.153302 5619 tablet_bootstrap.cc:654] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.153556 5227 tablet_service.cc:1511] Processing CreateTablet for tablet e54a83664397460399960a0f73966fef (DEFAULT_TABLE table=default.Table_8e2e1621778d459a930d7f15ea30dd06 [id=e6cd27ae03884c518cebff6b8a7483d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.153930 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54a83664397460399960a0f73966fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.154906 5606 tablet_replica.cc:333] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:53.155092 5606 raft_consensus.cc:2243] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.155267 5606 raft_consensus.cc:2272] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.156898 5606 ts_tablet_manager.cc:1916] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.161546 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1b4494b7e895454f81fef308950729ef) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.163092 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1b4494b7e895454f81fef308950729ef) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.164111 4928 catalog_manager.cc:6934] ReplaceTablet: tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 deleted and replaced by tablet 1b4494b7e895454f81fef308950729ef
W20260927 13:49:53.164726 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 14f5479761f94ee0b339e125d06a808c because the tablet was not found. No further retry: Not found: Tablet not found: 14f5479761f94ee0b339e125d06a808c
I20260927 13:49:53.165684 5626 tablet_bootstrap.cc:492] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
W20260927 13:49:53.165905 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 already in progress: creating tablet
I20260927 13:49:53.165987 5626 ts_tablet_manager.cc:1403] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.001s
W20260927 13:49:53.166244 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 already in progress: creating tablet
I20260927 13:49:53.166208 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 4709e969569b43a7aace8d7cfe4e64c5 (DEFAULT_TABLE table=default.Table_56b64738ce624ac98e0b4a4b327ab204 [id=11b7ccc28a104e57a243695c47b55a65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.166515 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet dae5f63f709f455b8eceb44771845a3f (table default.Table_f1bd6c5f7d1c40e4b4898befde87e9a0 [id=76f4e4598d75471f806ae3f3efa2f104]) successfully deleted
I20260927 13:49:53.166653 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4709e969569b43a7aace8d7cfe4e64c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.167583 5626 raft_consensus.cc:359] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.168035 5626 raft_consensus.cc:385] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.168244 5626 raft_consensus.cc:740] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.169106 5626 consensus_queue.cc:260] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.170056 5619 tablet_bootstrap.cc:492] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:53.170230 5619 ts_tablet_manager.cc:1403] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.003s
I20260927 13:49:53.170312 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 14f5479761f94ee0b339e125d06a808c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.170548 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1b4494b7e895454f81fef308950729ef) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.171044 5619 raft_consensus.cc:359] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.171221 5619 raft_consensus.cc:385] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.171315 5619 raft_consensus.cc:740] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.172254 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3b716a51ffbe4613a958b62eef4cdcb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.172973 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b716a51ffbe4613a958b62eef4cdcb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.173177 5626 ts_tablet_manager.cc:1434] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260927 13:49:53.172254 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d90fa8a272ec463da41c187d77d01a3b" } new_table_name: "default.Table_71f2aad652cc472996693761abcb7dde" modify_external_catalogs: true
I20260927 13:49:53.175273 5626 tablet_bootstrap.cc:492] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.180544 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 5b224b590e5c4a2ab26ea7eaeedd976c
W20260927 13:49:53.181247 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1087ad60dade46bb9d38f52a94dd536b consensus state has no leader
I20260927 13:49:53.181594 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 7011125c78084deca83b1570d1c2d704
I20260927 13:49:53.182017 4924 catalog_manager.cc:6934] ReplaceTablet: tablet 7011125c78084deca83b1570d1c2d704 deleted and replaced by tablet 9fdef4f56d9647118afe83ac3cd364fd
I20260927 13:49:53.183195 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b224b590e5c4a2ab26ea7eaeedd976c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.183442 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 7011125c78084deca83b1570d1c2d704 with delete_type TABLET_DATA_DELETED (replaced by tablet 9fdef4f56d9647118afe83ac3cd364fd) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.183456 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 7011125c78084deca83b1570d1c2d704 with delete_type TABLET_DATA_DELETED (replaced by tablet 9fdef4f56d9647118afe83ac3cd364fd) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.183899 4927 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet c2fc2734e88e431facdf72e9ef136106 (table default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e]). Expected version 2 got 0
I20260927 13:49:53.184064 5361 tablet_service.cc:1511] Processing CreateTablet for tablet fe6a4cf5ee2b43158d8db4c7cdd4a42e (DEFAULT_TABLE table=default.Table_f00ce7baf4f147e4bacf7c20efb9064b [id=28e5a27b58044d9ebcf9b33abfe878e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.184402 5079 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b224b590e5c4a2ab26ea7eaeedd976c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.184711 5625 tablet_replica.cc:333] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:53.184782 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6a4cf5ee2b43158d8db4c7cdd4a42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.184904 5625 raft_consensus.cc:2243] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.185103 5625 raft_consensus.cc:2272] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.185266 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4709e969569b43a7aace8d7cfe4e64c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.185708 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54a83664397460399960a0f73966fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.185736 5079 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce893441d5e4d9f89743e75eb762276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.185766 5076 tablet_service.cc:1511] Processing CreateTablet for tablet fe6a4cf5ee2b43158d8db4c7cdd4a42e (DEFAULT_TABLE table=default.Table_f00ce7baf4f147e4bacf7c20efb9064b [id=28e5a27b58044d9ebcf9b33abfe878e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.186154 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6a4cf5ee2b43158d8db4c7cdd4a42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.186210 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 059afd48ac4a41569ed1d3556b7974f0 with delete_type TABLET_DATA_DELETED (replaced by tablet b57886cc11a2423983c2b7bac79150a0) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.190255 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b224b590e5c4a2ab26ea7eaeedd976c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.190549 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 7011125c78084deca83b1570d1c2d704 with delete_type TABLET_DATA_DELETED (replaced by tablet 9fdef4f56d9647118afe83ac3cd364fd) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.190766 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 80b1970a344045389709260c850adc07 with delete_type TABLET_DATA_DELETED (replaced by tablet 081f18e00af74e5c811f774d29422351) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.191273 5623 tablet_replica.cc:333] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:53.191495 5623 raft_consensus.cc:2243] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.191730 5623 raft_consensus.cc:2272] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.192238 5215 tablet_service.cc:1511] Processing CreateTablet for tablet fe6a4cf5ee2b43158d8db4c7cdd4a42e (DEFAULT_TABLE table=default.Table_f00ce7baf4f147e4bacf7c20efb9064b [id=28e5a27b58044d9ebcf9b33abfe878e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.192622 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6a4cf5ee2b43158d8db4c7cdd4a42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.192652 5623 ts_tablet_manager.cc:1916] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.197264 5625 ts_tablet_manager.cc:1916] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.200798 5623 ts_tablet_manager.cc:1929] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:53.200932 5623 log.cc:1199] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/7011125c78084deca83b1570d1c2d704
I20260927 13:49:53.201324 5623 ts_tablet_manager.cc:1950] T 7011125c78084deca83b1570d1c2d704 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:53.201414 5626 tablet_bootstrap.cc:654] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.203982 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 129c2f99d5b143b3bd25731cfeb0009e with delete_type TABLET_DATA_DELETED (replaced by tablet 46537e1b33f24d50b705d53f6978da3c) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:53.207332 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 5b224b590e5c4a2ab26ea7eaeedd976c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b224b590e5c4a2ab26ea7eaeedd976c already in progress: creating tablet
I20260927 13:49:53.213815 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 44d85213c05c465abda78cc49c70d36f (DEFAULT_TABLE table=default.Table_4155d438fc7c4d6cbe87e16451c6bbba [id=2d2e2254587f4832b7ad918724eeea64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.214222 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d85213c05c465abda78cc49c70d36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.214424 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 44d85213c05c465abda78cc49c70d36f (DEFAULT_TABLE table=default.Table_4155d438fc7c4d6cbe87e16451c6bbba [id=2d2e2254587f4832b7ad918724eeea64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.214778 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d85213c05c465abda78cc49c70d36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.221972 5626 tablet_bootstrap.cc:492] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:53.222191 5626 ts_tablet_manager.cc:1403] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.048s user 0.006s sys 0.000s
I20260927 13:49:53.223240 5626 raft_consensus.cc:359] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.223460 5626 raft_consensus.cc:385] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.223542 5626 raft_consensus.cc:740] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.223719 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 44d85213c05c465abda78cc49c70d36f (DEFAULT_TABLE table=default.Table_4155d438fc7c4d6cbe87e16451c6bbba [id=2d2e2254587f4832b7ad918724eeea64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.223821 5626 consensus_queue.cc:260] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.224131 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d85213c05c465abda78cc49c70d36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.226799 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 5848740410d74e749ad6c44591ab0d24 (DEFAULT_TABLE table=default.Table_f33f22d6ee3f458694985ca9a9c3c488 [id=43db068fa4a04954b3638aa09347fe91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.227182 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5848740410d74e749ad6c44591ab0d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.227459 5626 ts_tablet_manager.cc:1434] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:49:53.230455 5626 tablet_bootstrap.cc:492] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.232404 5626 tablet_bootstrap.cc:654] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.236752 5625 ts_tablet_manager.cc:1929] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:53.236878 5625 log.cc:1199] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/7011125c78084deca83b1570d1c2d704
I20260927 13:49:53.237232 5625 ts_tablet_manager.cc:1950] T 7011125c78084deca83b1570d1c2d704 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:53.238257 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 7011125c78084deca83b1570d1c2d704 (table default.Table_a09e5155fa1148ef88003c6c1afedce5 [id=c073a79da0b440698186e6856c8c8c68]) successfully deleted
I20260927 13:49:53.240813 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 5848740410d74e749ad6c44591ab0d24 (DEFAULT_TABLE table=default.Table_f33f22d6ee3f458694985ca9a9c3c488 [id=43db068fa4a04954b3638aa09347fe91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.241355 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5848740410d74e749ad6c44591ab0d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.241429 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 5848740410d74e749ad6c44591ab0d24 (DEFAULT_TABLE table=default.Table_f33f22d6ee3f458694985ca9a9c3c488 [id=43db068fa4a04954b3638aa09347fe91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.241773 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5848740410d74e749ad6c44591ab0d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.246440 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7881acf83e854c3d86e41bcea92e353d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.247031 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7881acf83e854c3d86e41bcea92e353d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.247388 4927 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 74226753751a49fa8ce98eafb2ca1250 (table default.Table_000065d7fd1245df945d5c14cf4b881b [id=8c41592b4b4c4d4b9286336ed3c77b4b]). Expected version 2 got 0
I20260927 13:49:53.249061 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_bf1d966c56b941bab74f8fe4cef3bbb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.249715 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf1d966c56b941bab74f8fe4cef3bbb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.249908 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_010dd8cdd9ea470397aeff0f1235bf1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.250407 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_010dd8cdd9ea470397aeff0f1235bf1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.249541 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet c2fc2734e88e431facdf72e9ef136106 (table default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e]). Expected version 2 got 0
I20260927 13:49:53.252163 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cc6af9b33f0c464683e40adc28037bc8 (table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec]). Expected version 1 got 0
I20260927 13:49:53.252542 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5ca3c5799145419794585daecfa39d9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.253051 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ca3c5799145419794585daecfa39d9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.254082 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 4d35148d80b44fca9b39a4625d3e61c1 (table default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]). Expected version 1 got 0
I20260927 13:49:53.254897 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_82abe0dde56e49ea9af2bb8ddcfa508d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.255415 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82abe0dde56e49ea9af2bb8ddcfa508d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.263897 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.264424 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet a6af740383384609a354d7f0fae2cd70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.256590 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 931a48792f4c4525bd563a4dd1062e35 (table default.Table_3b7666d87acf47bda3e3e2545c8cfb25 [id=bed97aef149a417bb3807414f58ba52a]). Expected version 2 got 0
I20260927 13:49:53.265806 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c2fc2734e88e431facdf72e9ef136106 (table default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e]). Expected version 2 got 0
I20260927 13:49:53.267637 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 7011125c78084deca83b1570d1c2d704 with delete_type TABLET_DATA_DELETED (replaced by tablet 9fdef4f56d9647118afe83ac3cd364fd) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.268025 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ee75d0a39c42b09f2f46a1774f925c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.268882 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet d1f9ae430c414cdf9370388d51dd7c63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.269271 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet a7a97f4df3a84781bfcbdc768d518ef0 with delete_type TABLET_DATA_DELETED (replaced by tablet b5a9f864e4274666a86baed43e1623cd) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.269928 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_86f890e6a07c4dbda356960e42168324" } modify_external_catalogs: true
I20260927 13:49:53.270232 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_86f890e6a07c4dbda356960e42168324" } modify_external_catalogs: true
I20260927 13:49:53.272019 5628 tablet_bootstrap.cc:492] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:53.272255 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 14f5479761f94ee0b339e125d06a808c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.273905 5628 tablet_bootstrap.cc:654] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.274637 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cc0802f1f9f94b4b8f385d521fe95721" } modify_external_catalogs: true
I20260927 13:49:53.274746 5623 tablet_replica.cc:333] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:53.274802 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cc0802f1f9f94b4b8f385d521fe95721" } modify_external_catalogs: true
I20260927 13:49:53.274946 5623 raft_consensus.cc:2243] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.275143 5623 raft_consensus.cc:2272] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.276041 5623 ts_tablet_manager.cc:1916] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.276286 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7a48c16d7a32465cbc86892633257ea3" } modify_external_catalogs: true
I20260927 13:49:53.276455 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7a48c16d7a32465cbc86892633257ea3" } modify_external_catalogs: true
I20260927 13:49:53.282204 6204 raft_consensus.cc:493] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:49:53.282332 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1aaffd54534442e1aa6db158d313fab3 has no consensus state
I20260927 13:49:53.282373 6204 raft_consensus.cc:515] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.283070 6204 leader_election.cc:290] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:53.284317 5184 leader_election.cc:343] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a6af740383384609a354d7f0fae2cd70
I20260927 13:49:53.284587 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6af740383384609a354d7f0fae2cd70" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:53.285585 5185 leader_election.cc:343] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.285702 5185 leader_election.cc:304] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.286136 6204 raft_consensus.cc:2749] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:53.285703 5623 ts_tablet_manager.cc:1929] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.291020 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6697aa5e44b143bd8c7c394f45b4ba7a" } new_table_name: "default.Table_a84034c9d8ab4ec5ada3c6fbb73934e1" modify_external_catalogs: true
I20260927 13:49:53.291230 5623 log.cc:1199] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/80b1970a344045389709260c850adc07
I20260927 13:49:53.291739 5623 ts_tablet_manager.cc:1950] T 80b1970a344045389709260c850adc07 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:53.292403 4929 master_service.cc:960] ReplaceTablet: received request to replace tablet b0827a26334c42728545a9eaa006fae0 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:53.292716 5628 tablet_bootstrap.cc:492] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:53.292830 5628 ts_tablet_manager.cc:1403] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.003s
I20260927 13:49:53.293462 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 7011125c78084deca83b1570d1c2d704 (table default.Table_a09e5155fa1148ef88003c6c1afedce5 [id=c073a79da0b440698186e6856c8c8c68]) successfully deleted
I20260927 13:49:53.293521 5628 raft_consensus.cc:359] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.293690 5628 raft_consensus.cc:385] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.293744 5628 raft_consensus.cc:740] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.293725 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c422a4d620fb41f788588f45ad6e57ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:53.293972 5628 consensus_queue.cc:260] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:53.294648 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c422a4d620fb41f788588f45ad6e57ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.294780 5628 ts_tablet_manager.cc:1434] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:53.295435 5628 tablet_bootstrap.cc:492] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:53.297508 5628 tablet_bootstrap.cc:654] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.305675 5079 tablet_service.cc:1558] Processing DeleteTablet for tablet 1245334728994a60ad641c2e90f8d2df with delete_type TABLET_DATA_DELETED (replaced by tablet f46f45a0a13b4e05802a08880d7f6a01) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.306388 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3f1356fe7e4340d99b696cace4f9a6a1" } new_table_name: "default.Table_445d25d3eeb64eb3845dad47fa41f27d" modify_external_catalogs: true
I20260927 13:49:53.306629 6231 raft_consensus.cc:493] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.306797 6231 raft_consensus.cc:515] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.307556 6231 leader_election.cc:290] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:53.308040 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6af9b33f0c464683e40adc28037bc8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:53.308243 5385 raft_consensus.cc:2468] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:53.308651 5045 leader_election.cc:304] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:53.308008 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_628ba6af19054b408e29160407aa53bf" } new_table_name: "default.Table_f2be6272899a44aea0960403abfd2474" modify_external_catalogs: true
I20260927 13:49:53.308861 6231 raft_consensus.cc:2804] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:53.308934 6231 raft_consensus.cc:493] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:53.308984 6231 raft_consensus.cc:3060] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:53.309876 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8d512449c471495286c66f025bfa4621"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.310401 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d512449c471495286c66f025bfa4621 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:53.311949 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 5b224b590e5c4a2ab26ea7eaeedd976c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b224b590e5c4a2ab26ea7eaeedd976c already in progress: creating tablet
I20260927 13:49:53.312268 5625 tablet_replica.cc:333] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:53.312510 5625 raft_consensus.cc:2243] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.312806 5625 raft_consensus.cc:2272] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.313004 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 (DEFAULT_TABLE table=default.Table_94ba7a27252044beb2d23563d4092a8f [id=4de8c6767c5640f2ab7b54f6e8884709]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.313509 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467aa7fb4edf4b1b8dad6514d1d017b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.313517 5625 ts_tablet_manager.cc:1916] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.318900 5628 tablet_bootstrap.cc:492] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:53.319061 5628 ts_tablet_manager.cc:1403] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260927 13:49:53.203926 5619 consensus_queue.cc:260] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.319994 5628 raft_consensus.cc:359] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.320202 5628 raft_consensus.cc:385] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.320264 5628 raft_consensus.cc:740] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.320534 5628 consensus_queue.cc:260] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.321112 5628 ts_tablet_manager.cc:1434] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:53.321290 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 87bba86a18504fc1ae2a3aef7f7c5a39 (DEFAULT_TABLE table=default.Table_a06dc9d175614ec2b842ccbb93b0f739 [id=7b0aaddfe9ba428c9c84960df68aaecf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.321396 5628 tablet_bootstrap.cc:492] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:53.321681 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87bba86a18504fc1ae2a3aef7f7c5a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.323110 5619 ts_tablet_manager.cc:1434] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.153s user 0.002s sys 0.000s
I20260927 13:49:53.323421 5619 tablet_bootstrap.cc:492] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:53.323791 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 87bba86a18504fc1ae2a3aef7f7c5a39 (DEFAULT_TABLE table=default.Table_a06dc9d175614ec2b842ccbb93b0f739 [id=7b0aaddfe9ba428c9c84960df68aaecf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.324164 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87bba86a18504fc1ae2a3aef7f7c5a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.326387 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 (DEFAULT_TABLE table=default.Table_94ba7a27252044beb2d23563d4092a8f [id=4de8c6767c5640f2ab7b54f6e8884709]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.326756 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467aa7fb4edf4b1b8dad6514d1d017b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.332979 6231 raft_consensus.cc:515] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.308058 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6af9b33f0c464683e40adc28037bc8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:53.334504 5044 leader_election.cc:343] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.336154 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6af9b33f0c464683e40adc28037bc8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:53.336336 5385 raft_consensus.cc:3060] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:53.336596 5628 tablet_bootstrap.cc:654] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.336604 5623 tablet_replica.cc:333] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:53.336831 5623 raft_consensus.cc:2243] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.336963 6231 leader_election.cc:290] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:53.337877 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6af9b33f0c464683e40adc28037bc8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:49:53.338395 5044 leader_election.cc:343] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.338568 5623 raft_consensus.cc:2272] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.338934 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 80b1970a344045389709260c850adc07 (table default.Table_92bf3a9fa895485597b7f5cda3251baf [id=5900f338a23b46e8a487ec9cfa08b8a8]) successfully deleted
I20260927 13:49:53.308215 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 (DEFAULT_TABLE table=default.Table_94ba7a27252044beb2d23563d4092a8f [id=4de8c6767c5640f2ab7b54f6e8884709]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.339614 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467aa7fb4edf4b1b8dad6514d1d017b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.340318 5385 raft_consensus.cc:2468] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:53.340701 5045 leader_election.cc:304] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:53.340960 6231 raft_consensus.cc:2804] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:53.341079 6231 raft_consensus.cc:697] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:53.341327 6231 consensus_queue.cc:237] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.342607 5623 ts_tablet_manager.cc:1916] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.329548 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 87bba86a18504fc1ae2a3aef7f7c5a39 (DEFAULT_TABLE table=default.Table_a06dc9d175614ec2b842ccbb93b0f739 [id=7b0aaddfe9ba428c9c84960df68aaecf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.346509 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87bba86a18504fc1ae2a3aef7f7c5a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.355013 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 71268fb7aa9646639ea41dc8ccebfc5c (DEFAULT_TABLE table=default.Table_cc0802f1f9f94b4b8f385d521fe95721 [id=eb6809c7866943b6b77be47fcee1e251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.355530 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71268fb7aa9646639ea41dc8ccebfc5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.355528 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 71268fb7aa9646639ea41dc8ccebfc5c (DEFAULT_TABLE table=default.Table_cc0802f1f9f94b4b8f385d521fe95721 [id=eb6809c7866943b6b77be47fcee1e251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.355886 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71268fb7aa9646639ea41dc8ccebfc5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.357982 5619 tablet_bootstrap.cc:654] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.360302 5606 ts_tablet_manager.cc:1929] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.360440 5606 log.cc:1199] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/24bf9abe277040078eb765728e3c52ef
I20260927 13:49:53.360812 5606 ts_tablet_manager.cc:1950] T 24bf9abe277040078eb765728e3c52ef P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:53.361474 5623 ts_tablet_manager.cc:1929] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.361989 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 24bf9abe277040078eb765728e3c52ef (table default.Table_f3b7b12a18cd41dc98240136b5611848 [id=9e5e2ee15095486b815cf581c218a75c]) successfully deleted
I20260927 13:49:53.364315 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 71268fb7aa9646639ea41dc8ccebfc5c (DEFAULT_TABLE table=default.Table_cc0802f1f9f94b4b8f385d521fe95721 [id=eb6809c7866943b6b77be47fcee1e251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.365882 5623 log.cc:1199] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/8e959f8c6fa74a1bbaf06d91c3e484bc
I20260927 13:49:53.366237 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71268fb7aa9646639ea41dc8ccebfc5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.366328 5623 ts_tablet_manager.cc:1950] T 8e959f8c6fa74a1bbaf06d91c3e484bc P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:53.367309 5623 tablet_replica.cc:333] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:53.367527 5623 raft_consensus.cc:2243] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.367714 5623 raft_consensus.cc:2272] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.370045 5628 tablet_bootstrap.cc:492] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:53.365522 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3f7ded9d644d749532e0700844bd62 (DEFAULT_TABLE table=default.Table_d8d34c74dce64346bb6939d4e662b864 [id=bd48f9df5dc34ec48d5742d8ec30feda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.370208 5628 ts_tablet_manager.cc:1403] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.049s user 0.001s sys 0.008s
I20260927 13:49:53.370558 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3f7ded9d644d749532e0700844bd62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.370622 5623 ts_tablet_manager.cc:1916] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.371109 5628 raft_consensus.cc:359] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:53.371368 5628 raft_consensus.cc:385] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.371511 5628 raft_consensus.cc:740] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.371876 5628 consensus_queue.cc:260] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:53.372396 5628 ts_tablet_manager.cc:1434] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:53.372737 5628 tablet_bootstrap.cc:492] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:53.374938 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 8e959f8c6fa74a1bbaf06d91c3e484bc (table default.Table_3ab0995080774a95967ee1d1ce7c9fdf [id=4dfd5d250a6f4ccd87ae40d6b0061394]) successfully deleted
I20260927 13:49:53.379691 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3f7ded9d644d749532e0700844bd62 (DEFAULT_TABLE table=default.Table_d8d34c74dce64346bb6939d4e662b864 [id=bd48f9df5dc34ec48d5742d8ec30feda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.380118 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3f7ded9d644d749532e0700844bd62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.380465 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3f7ded9d644d749532e0700844bd62 (DEFAULT_TABLE table=default.Table_d8d34c74dce64346bb6939d4e662b864 [id=bd48f9df5dc34ec48d5742d8ec30feda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.380663 5623 ts_tablet_manager.cc:1929] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.380887 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3f7ded9d644d749532e0700844bd62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.386021 5623 log.cc:1199] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/a6af740383384609a354d7f0fae2cd70
I20260927 13:49:53.386631 5623 ts_tablet_manager.cc:1950] T a6af740383384609a354d7f0fae2cd70 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:53.387287 5619 tablet_bootstrap.cc:492] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:53.387460 5619 ts_tablet_manager.cc:1403] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.064s user 0.001s sys 0.002s
I20260927 13:49:53.387593 5215 tablet_service.cc:1511] Processing CreateTablet for tablet d897f986d26a44f4894e147a74a90949 (DEFAULT_TABLE table=default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.388034 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d897f986d26a44f4894e147a74a90949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.388263 5619 raft_consensus.cc:359] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.388465 5619 raft_consensus.cc:385] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.388545 5619 raft_consensus.cc:740] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.388847 5619 consensus_queue.cc:260] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.389744 5628 tablet_bootstrap.cc:654] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.392165 5619 ts_tablet_manager.cc:1434] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260927 13:49:53.395180 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet a6af740383384609a354d7f0fae2cd70 (table default.Table_de419f4cfd244caeaa7707f22194c5bd [id=1cceb2a28eac4398a1e8d1ddb8afd21b]) successfully deleted
W20260927 13:49:53.395768 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 14f5479761f94ee0b339e125d06a808c because the tablet was not found. No further retry: Not found: Tablet not found: 14f5479761f94ee0b339e125d06a808c
I20260927 13:49:53.396734 5619 tablet_bootstrap.cc:492] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:53.398653 5619 tablet_bootstrap.cc:654] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.404619 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 71268fb7aa9646639ea41dc8ccebfc5c
I20260927 13:49:53.405680 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 71268fb7aa9646639ea41dc8ccebfc5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.408416 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet d1f9ae430c414cdf9370388d51dd7c63 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:53.409552 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3614a1889eea43b39d1d94a3211a5473" } modify_external_catalogs: true
I20260927 13:49:53.409718 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3614a1889eea43b39d1d94a3211a5473" } modify_external_catalogs: true
I20260927 13:49:53.410293 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet c48ca4b429294782a9e6ed496c6dfb72
I20260927 13:49:53.410883 4928 master_service.cc:960] ReplaceTablet: received request to replace tablet 8e8bf79954c2429f886ac7afc9a8455f from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:53.411082 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet c48ca4b429294782a9e6ed496c6dfb72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.416721 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e959f8c6fa74a1bbaf06d91c3e484bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:46 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.416983 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet c48ca4b429294782a9e6ed496c6dfb72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.417133 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 71268fb7aa9646639ea41dc8ccebfc5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.419406 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a813939920244be781d546311fe8a33e
W20260927 13:49:53.419916 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 64c7919f5076406186000cd4077aadaf consensus state has no leader
I20260927 13:49:53.420117 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet a813939920244be781d546311fe8a33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.421128 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet a813939920244be781d546311fe8a33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:53.422395 4754 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 53248us
I20260927 13:49:53.422711 5361 tablet_service.cc:1511] Processing CreateTablet for tablet d897f986d26a44f4894e147a74a90949 (DEFAULT_TABLE table=default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.422883 5080 tablet_service.cc:1511] Processing CreateTablet for tablet d897f986d26a44f4894e147a74a90949 (DEFAULT_TABLE table=default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.423180 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d897f986d26a44f4894e147a74a90949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.423256 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d897f986d26a44f4894e147a74a90949. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:53.423677 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet bbb4f42522e84964aeb19358ee02dfc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbb4f42522e84964aeb19358ee02dfc2 already in progress: creating tablet
W20260927 13:49:53.424329 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a0e14fd01a9141cdb2df030ee0dd05db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0e14fd01a9141cdb2df030ee0dd05db already in progress: creating tablet
W20260927 13:49:53.424894 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 14f5479761f94ee0b339e125d06a808c because the tablet was not found. No further retry: Not found: Tablet not found: 14f5479761f94ee0b339e125d06a808c
W20260927 13:49:53.425488 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 already in progress: creating tablet
W20260927 13:49:53.426017 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 5b224b590e5c4a2ab26ea7eaeedd976c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b224b590e5c4a2ab26ea7eaeedd976c already in progress: creating tablet
I20260927 13:49:53.426302 5606 tablet_replica.cc:333] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:53.428660 6231 consensus_queue.cc:1048] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:53.434804 5628 tablet_bootstrap.cc:492] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:53.434954 5628 ts_tablet_manager.cc:1403] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.062s user 0.009s sys 0.008s
I20260927 13:49:53.435796 5628 raft_consensus.cc:359] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.436015 5628 raft_consensus.cc:385] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.436079 5628 raft_consensus.cc:740] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.436365 5628 consensus_queue.cc:260] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.438046 4927 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 74226753751a49fa8ce98eafb2ca1250 (table default.Table_000065d7fd1245df945d5c14cf4b881b [id=8c41592b4b4c4d4b9286336ed3c77b4b]). Expected version 2 got 0
I20260927 13:49:53.438542 5628 ts_tablet_manager.cc:1434] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:49:53.439781 5628 tablet_bootstrap.cc:492] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:53.439723 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_511b3463a96f497dade7a9c12509f338" } new_table_name: "default.Table_ef6bb2dace3141688f83d3494419f619" modify_external_catalogs: true
I20260927 13:49:53.441455 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b0827a26334c42728545a9eaa006fae0
I20260927 13:49:53.441987 4929 catalog_manager.cc:6934] ReplaceTablet: tablet b0827a26334c42728545a9eaa006fae0 deleted and replaced by tablet 5978cb78bd974d669817def05007d0ea
I20260927 13:49:53.442205 5628 tablet_bootstrap.cc:654] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.445350 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet b0827a26334c42728545a9eaa006fae0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5978cb78bd974d669817def05007d0ea) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.446668 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet b0827a26334c42728545a9eaa006fae0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5978cb78bd974d669817def05007d0ea) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.445847 5347 tablet_service.cc:1511] Processing CreateTablet for tablet cf1a58c67bf54493a3c62fb175acabb8 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.447189 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1a58c67bf54493a3c62fb175acabb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.447623 5076 tablet_service.cc:1511] Processing CreateTablet for tablet cf1a58c67bf54493a3c62fb175acabb8 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.448482 5628 tablet_bootstrap.cc:492] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:53.448589 5628 ts_tablet_manager.cc:1403] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260927 13:49:53.448901 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1a58c67bf54493a3c62fb175acabb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.449215 5628 raft_consensus.cc:359] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.449358 5628 raft_consensus.cc:385] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.449406 5628 raft_consensus.cc:740] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.449409 4921 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]). Expected version 1 got 0
I20260927 13:49:53.450248 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 352e564866a747798ad44218133844ba (DEFAULT_TABLE table=default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.450541 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 352e564866a747798ad44218133844ba (DEFAULT_TABLE table=default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.450704 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352e564866a747798ad44218133844ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.451017 5628 consensus_queue.cc:260] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.453114 5628 ts_tablet_manager.cc:1434] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:49:53.453572 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352e564866a747798ad44218133844ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.454517 5628 tablet_bootstrap.cc:492] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:53.455248 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 187b3ceeccb142c4b798947e584d6044 (DEFAULT_TABLE table=default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.455572 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 187b3ceeccb142c4b798947e584d6044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.457226 5628 tablet_bootstrap.cc:654] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.457222 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_473c4114525b4bea85fd83367cd4c376" } modify_external_catalogs: true
I20260927 13:49:53.457412 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_473c4114525b4bea85fd83367cd4c376" } modify_external_catalogs: true
I20260927 13:49:53.459132 4921 catalog_manager.cc:5838] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65). New cstate: current_term: 1 leader_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:53.459689 4921 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cc6af9b33f0c464683e40adc28037bc8 (table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec]). Expected version 1 got 0
I20260927 13:49:53.464775 5625 ts_tablet_manager.cc:1929] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.464893 5625 log.cc:1199] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/6ce893441d5e4d9f89743e75eb762276
I20260927 13:49:53.465215 5625 ts_tablet_manager.cc:1950] T 6ce893441d5e4d9f89743e75eb762276 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:53.465751 5625 tablet_replica.cc:333] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:53.465939 5625 raft_consensus.cc:2243] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.466080 5625 raft_consensus.cc:2272] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.466166 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 6ce893441d5e4d9f89743e75eb762276 (table default.Table_6f968553a801422ba747b1d4516c2074 [id=b330cf549e3842ad9e82aed396bcba89]) successfully deleted
I20260927 13:49:53.467243 5628 tablet_bootstrap.cc:492] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:53.467368 5628 ts_tablet_manager.cc:1403] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260927 13:49:53.468060 5628 raft_consensus.cc:359] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.468212 5628 raft_consensus.cc:385] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.468261 5628 raft_consensus.cc:740] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.468870 5606 raft_consensus.cc:2243] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:53.469259 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 71268fb7aa9646639ea41dc8ccebfc5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.469431 5606 raft_consensus.cc:2272] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.469563 6231 raft_consensus.cc:493] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.469681 6231 raft_consensus.cc:515] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.470350 6231 leader_election.cc:290] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:53.470494 5606 ts_tablet_manager.cc:1916] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.470920 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d35148d80b44fca9b39a4625d3e61c1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:53.471167 5628 consensus_queue.cc:260] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.473918 5628 ts_tablet_manager.cc:1434] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
W20260927 13:49:53.475881 5045 leader_election.cc:343] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.477213 5625 ts_tablet_manager.cc:1916] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.477262 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
I20260927 13:49:53.478082 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet b0827a26334c42728545a9eaa006fae0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5978cb78bd974d669817def05007d0ea) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:53.478696 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 71268fb7aa9646639ea41dc8ccebfc5c because the tablet was not found. No further retry: Not found: Tablet not found: 71268fb7aa9646639ea41dc8ccebfc5c
I20260927 13:49:53.478771 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet a813939920244be781d546311fe8a33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.479035 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d35148d80b44fca9b39a4625d3e61c1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:53.480108 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b0827a26334c42728545a9eaa006fae0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0827a26334c42728545a9eaa006fae0 already in progress: creating tablet
I20260927 13:49:53.480054 5226 tablet_service.cc:1511] Processing CreateTablet for tablet cf1a58c67bf54493a3c62fb175acabb8 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.481881 5628 tablet_bootstrap.cc:492] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:49:53.482976 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a813939920244be781d546311fe8a33e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a813939920244be781d546311fe8a33e already in progress: creating tablet
I20260927 13:49:53.483234 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet c48ca4b429294782a9e6ed496c6dfb72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.483434 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1a58c67bf54493a3c62fb175acabb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.487498 5228 tablet_service.cc:1511] Processing CreateTablet for tablet 352e564866a747798ad44218133844ba (DEFAULT_TABLE table=default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.489249 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
I20260927 13:49:53.490226 6232 consensus_queue.cc:1048] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:53.482774 5247 raft_consensus.cc:2468] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:53.493616 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352e564866a747798ad44218133844ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.496848 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 187b3ceeccb142c4b798947e584d6044 (DEFAULT_TABLE table=default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.497756 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 187b3ceeccb142c4b798947e584d6044. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:53.497754 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet c48ca4b429294782a9e6ed496c6dfb72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c48ca4b429294782a9e6ed496c6dfb72 already in progress: creating tablet
I20260927 13:49:53.498428 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_b0b2ff4faec94fc9a83fc6271fd5ec6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:53.498719 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 14f5479761f94ee0b339e125d06a808c (DEFAULT_TABLE table=default.Table_73693476f4564e2e8e0f60b0f7e3d474 [id=90f057f5064842a19916355825eb7129]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:53.498998 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0b2ff4faec94fc9a83fc6271fd5ec6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.499074 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f5479761f94ee0b339e125d06a808c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.499095 5628 tablet_bootstrap.cc:654] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.511049 5044 leader_election.cc:304] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.511592 6232 raft_consensus.cc:2804] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:53.511672 6232 raft_consensus.cc:493] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:53.511749 6232 raft_consensus.cc:3060] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:53.517627 5347 tablet_service.cc:1511] Processing CreateTablet for tablet 14f5479761f94ee0b339e125d06a808c (DEFAULT_TABLE table=default.Table_73693476f4564e2e8e0f60b0f7e3d474 [id=90f057f5064842a19916355825eb7129]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.518237 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f5479761f94ee0b339e125d06a808c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.518965 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 14f5479761f94ee0b339e125d06a808c (DEFAULT_TABLE table=default.Table_73693476f4564e2e8e0f60b0f7e3d474 [id=90f057f5064842a19916355825eb7129]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.520141 5606 ts_tablet_manager.cc:1929] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:53.520285 5606 log.cc:1199] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/7011125c78084deca83b1570d1c2d704
I20260927 13:49:53.520722 5606 ts_tablet_manager.cc:1950] T 7011125c78084deca83b1570d1c2d704 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:53.520671 6232 raft_consensus.cc:515] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.522769 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f5479761f94ee0b339e125d06a808c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.526244 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d35148d80b44fca9b39a4625d3e61c1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:53.526460 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d35148d80b44fca9b39a4625d3e61c1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:49:53.527041 5045 leader_election.cc:343] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.505945 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_072a0d2dac43447db9aeb63f44c86152"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.528014 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_072a0d2dac43447db9aeb63f44c86152 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.528322 5248 raft_consensus.cc:3060] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:53.532567 5248 raft_consensus.cc:2468] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:53.533618 5044 leader_election.cc:304] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.533887 6127 raft_consensus.cc:2804] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:53.534005 6127 raft_consensus.cc:697] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:53.534267 6127 consensus_queue.cc:237] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.535823 5628 tablet_bootstrap.cc:492] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:53.535941 5628 ts_tablet_manager.cc:1403] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.054s user 0.018s sys 0.002s
I20260927 13:49:53.536666 5628 raft_consensus.cc:359] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.536832 5628 raft_consensus.cc:385] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.536882 5628 raft_consensus.cc:740] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.537065 5628 consensus_queue.cc:260] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.538266 5628 ts_tablet_manager.cc:1434] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:53.538516 5628 tablet_bootstrap.cc:492] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:53.540093 5628 tablet_bootstrap.cc:654] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.543298 6231 raft_consensus.cc:493] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.543449 6231 raft_consensus.cc:515] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:53.544129 5606 tablet_replica.cc:333] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:53.544544 5606 raft_consensus.cc:2243] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.544741 5606 raft_consensus.cc:2272] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.544764 6231 leader_election.cc:290] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:53.545315 5606 ts_tablet_manager.cc:1916] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.545529 5628 tablet_bootstrap.cc:492] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:53.545641 5628 ts_tablet_manager.cc:1403] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260927 13:49:53.521771 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 7011125c78084deca83b1570d1c2d704 (table default.Table_a09e5155fa1148ef88003c6c1afedce5 [id=c073a79da0b440698186e6856c8c8c68]) successfully deleted
I20260927 13:49:53.546343 5628 raft_consensus.cc:359] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.546485 5628 raft_consensus.cc:385] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.546528 5628 raft_consensus.cc:740] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.546703 6232 leader_election.cc:290] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:53.546700 5628 consensus_queue.cc:260] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.549877 5628 ts_tablet_manager.cc:1434] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:53.550155 5628 tablet_bootstrap.cc:492] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:53.550489 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a48792f4c4525bd563a4dd1062e35" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:53.551227 5045 leader_election.cc:343] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.551826 5628 tablet_bootstrap.cc:654] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:53.555159 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6fdacca4b5bd4afb95c83f6c72091b2f consensus state has no leader
I20260927 13:49:53.557405 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a48792f4c4525bd563a4dd1062e35" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:53.557979 5628 tablet_bootstrap.cc:492] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
W20260927 13:49:53.558101 5044 leader_election.cc:343] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.558194 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_270422451be448a2b25e3952c94c9a61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:53.558301 5044 leader_election.cc:304] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.558657 6232 raft_consensus.cc:2749] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:53.558702 6231 raft_consensus.cc:493] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:49:53.558736 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_270422451be448a2b25e3952c94c9a61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.558825 6231 raft_consensus.cc:515] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.559350 6231 leader_election.cc:290] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:53.558127 5628 ts_tablet_manager.cc:1403] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260927 13:49:53.559836 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575501a5d1f4b0d80f153cf5bde5fa9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:53.560412 5045 leader_election.cc:343] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.560586 5628 raft_consensus.cc:359] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.560727 5628 raft_consensus.cc:385] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.560783 5628 raft_consensus.cc:740] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.560974 5628 consensus_queue.cc:260] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.562816 5628 ts_tablet_manager.cc:1434] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 13:49:53.563077 5628 tablet_bootstrap.cc:492] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:53.564815 5628 tablet_bootstrap.cc:654] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.567546 5625 ts_tablet_manager.cc:1929] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.569186 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575501a5d1f4b0d80f153cf5bde5fa9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:53.569471 5625 log.cc:1199] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/059afd48ac4a41569ed1d3556b7974f0
W20260927 13:49:53.569741 5044 leader_election.cc:343] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.569844 5044 leader_election.cc:304] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.569937 5625 ts_tablet_manager.cc:1950] T 059afd48ac4a41569ed1d3556b7974f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:53.570078 6231 raft_consensus.cc:2749] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:53.571017 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 059afd48ac4a41569ed1d3556b7974f0 (table default.Table_020de70ec7bc4e119d5c6a3e22d8d32d [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
W20260927 13:49:53.572888 4916 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7011125c78084deca83b1570d1c2d704 because the tablet was not found. No further retry: Not found: Tablet not found: 7011125c78084deca83b1570d1c2d704
I20260927 13:49:53.573453 5625 tablet_replica.cc:333] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:53.573729 5625 raft_consensus.cc:2243] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.573951 5625 raft_consensus.cc:2272] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.574344 5606 ts_tablet_manager.cc:1929] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.574486 5606 log.cc:1199] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/129c2f99d5b143b3bd25731cfeb0009e
I20260927 13:49:53.574716 5625 ts_tablet_manager.cc:1916] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.574805 5606 ts_tablet_manager.cc:1950] T 129c2f99d5b143b3bd25731cfeb0009e P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:53.575866 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 129c2f99d5b143b3bd25731cfeb0009e (table default.Table_22d5c80b2b5b4ee09361300740be2ab2 [id=f78659fb9203483aa74b05e453e1fa63]) successfully deleted
I20260927 13:49:53.576002 5606 tablet_replica.cc:333] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:53.576190 5606 raft_consensus.cc:2243] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.576344 5606 raft_consensus.cc:2272] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.577075 5606 ts_tablet_manager.cc:1916] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.581662 5626 tablet_bootstrap.cc:492] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:53.581815 5626 ts_tablet_manager.cc:1403] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.351s user 0.032s sys 0.110s
W20260927 13:49:53.582465 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ee18063dc634385b9e61fae3b3ece99 consensus state has no leader
I20260927 13:49:53.582473 5625 ts_tablet_manager.cc:1929] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.582568 5625 log.cc:1199] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/31ee75d0a39c42b09f2f46a1774f925c
I20260927 13:49:53.582634 5626 raft_consensus.cc:359] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.582816 5626 raft_consensus.cc:385] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.582914 5626 raft_consensus.cc:740] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.582949 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e146c2f2d2614db7912a172c61e3f9f4" } new_table_name: "default.Table_b10075ed74e549249e8a79bac26e367c" modify_external_catalogs: true
I20260927 13:49:53.583189 5626 consensus_queue.cc:260] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.583467 5625 ts_tablet_manager.cc:1950] T 31ee75d0a39c42b09f2f46a1774f925c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:53.583884 5626 ts_tablet_manager.cc:1434] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:53.584162 5626 tablet_bootstrap.cc:492] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.584537 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_bce59a04c83047b9beb7f6762ae2cfac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.585071 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bce59a04c83047b9beb7f6762ae2cfac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.585318 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 31ee75d0a39c42b09f2f46a1774f925c (table default.Table_ee4b85ee72994fe596598538d6755252 [id=c2ce8f3fda214134bf35a2866675d0f7]) successfully deleted
I20260927 13:49:53.585606 5625 tablet_replica.cc:333] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:53.585804 5625 raft_consensus.cc:2243] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.585929 5626 tablet_bootstrap.cc:654] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.585964 5625 raft_consensus.cc:2272] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.583400 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 187b3ceeccb142c4b798947e584d6044 (DEFAULT_TABLE table=default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.586751 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 8e8bf79954c2429f886ac7afc9a8455f
I20260927 13:49:53.586936 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 187b3ceeccb142c4b798947e584d6044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.587311 4928 catalog_manager.cc:6934] ReplaceTablet: tablet 8e8bf79954c2429f886ac7afc9a8455f deleted and replaced by tablet 502fe193f2034e37a53b245bbf049ae8
I20260927 13:49:53.587630 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_03b60a7efdad48f7bcb17007df1f9847"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.588171 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03b60a7efdad48f7bcb17007df1f9847 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.588392 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8bf79954c2429f886ac7afc9a8455f with delete_type TABLET_DATA_DELETED (replaced by tablet 502fe193f2034e37a53b245bbf049ae8) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.588647 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8bf79954c2429f886ac7afc9a8455f with delete_type TABLET_DATA_DELETED (replaced by tablet 502fe193f2034e37a53b245bbf049ae8) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.589325 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b3fbf1e7f5e04122a65f6e192ffdae20
I20260927 13:49:53.589972 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5b53995279b344879742a29046c07039"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.590593 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b53995279b344879742a29046c07039 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:53.591087 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 8e8bf79954c2429f886ac7afc9a8455f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e8bf79954c2429f886ac7afc9a8455f already in progress: creating tablet
I20260927 13:49:53.591398 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet b3fbf1e7f5e04122a65f6e192ffdae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.592283 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ba129b9b5fcd4770aa8afe76f740bb4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.592691 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba129b9b5fcd4770aa8afe76f740bb4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:53.593390 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b3fbf1e7f5e04122a65f6e192ffdae20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3fbf1e7f5e04122a65f6e192ffdae20 already in progress: creating tablet
I20260927 13:49:53.593766 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet b3fbf1e7f5e04122a65f6e192ffdae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.594563 5625 ts_tablet_manager.cc:1916] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.596381 5626 tablet_bootstrap.cc:492] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:53.596542 5626 ts_tablet_manager.cc:1403] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.007s
I20260927 13:49:53.597294 5626 raft_consensus.cc:359] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.597491 5626 raft_consensus.cc:385] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.597560 5626 raft_consensus.cc:740] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.597781 5626 consensus_queue.cc:260] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.599596 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8bf79954c2429f886ac7afc9a8455f with delete_type TABLET_DATA_DELETED (replaced by tablet 502fe193f2034e37a53b245bbf049ae8) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.600278 5626 ts_tablet_manager.cc:1434] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:49:53.600332 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet b3fbf1e7f5e04122a65f6e192ffdae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.600626 5626 tablet_bootstrap.cc:492] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.602346 5626 tablet_bootstrap.cc:654] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.604410 5625 ts_tablet_manager.cc:1929] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.604628 5625 log.cc:1199] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/d1f9ae430c414cdf9370388d51dd7c63
I20260927 13:49:53.605078 5625 ts_tablet_manager.cc:1950] T d1f9ae430c414cdf9370388d51dd7c63 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:53.606370 5606 ts_tablet_manager.cc:1929] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.606521 5606 log.cc:1199] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/8e959f8c6fa74a1bbaf06d91c3e484bc
I20260927 13:49:53.606473 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet d1f9ae430c414cdf9370388d51dd7c63 (table default.Table_e680c915b7b546a7927c1795fa7f3ef4 [id=793fd3b0ccee43a88ba3992caa0408ab]) successfully deleted
I20260927 13:49:53.606859 5606 ts_tablet_manager.cc:1950] T 8e959f8c6fa74a1bbaf06d91c3e484bc P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:53.607591 5626 tablet_bootstrap.cc:492] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:53.607793 5626 ts_tablet_manager.cc:1403] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260927 13:49:53.607980 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 8e959f8c6fa74a1bbaf06d91c3e484bc (table default.Table_3ab0995080774a95967ee1d1ce7c9fdf [id=4dfd5d250a6f4ccd87ae40d6b0061394]) successfully deleted
W20260927 13:49:53.608351 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet c48ca4b429294782a9e6ed496c6dfb72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c48ca4b429294782a9e6ed496c6dfb72 already in progress: creating tablet
W20260927 13:49:53.608645 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 71268fb7aa9646639ea41dc8ccebfc5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71268fb7aa9646639ea41dc8ccebfc5c already in progress: creating tablet
I20260927 13:49:53.608729 5626 raft_consensus.cc:359] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:53.608944 5626 raft_consensus.cc:385] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 13:49:53.608984 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a813939920244be781d546311fe8a33e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a813939920244be781d546311fe8a33e already in progress: creating tablet
I20260927 13:49:53.609036 5626 raft_consensus.cc:740] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
W20260927 13:49:53.609210 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b0827a26334c42728545a9eaa006fae0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0827a26334c42728545a9eaa006fae0 already in progress: creating tablet
I20260927 13:49:53.609254 5626 consensus_queue.cc:260] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:53.609436 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 8e8bf79954c2429f886ac7afc9a8455f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e8bf79954c2429f886ac7afc9a8455f already in progress: creating tablet
W20260927 13:49:53.609997 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b3fbf1e7f5e04122a65f6e192ffdae20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3fbf1e7f5e04122a65f6e192ffdae20 already in progress: creating tablet
I20260927 13:49:53.610925 5625 tablet_replica.cc:333] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:53.611203 5625 raft_consensus.cc:2243] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.611411 5625 raft_consensus.cc:2272] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.612347 5625 ts_tablet_manager.cc:1916] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.615183 6231 raft_consensus.cc:493] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.615303 6231 raft_consensus.cc:515] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.615906 6231 leader_election.cc:290] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:53.616529 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ffe83306e74749b5b3f68e6c2c708c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:53.617179 5045 leader_election.cc:343] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.621171 5626 ts_tablet_manager.cc:1434] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:49:53.621539 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 12dd91ddaeff4f2a9d7a0761c08fc192
I20260927 13:49:53.621716 5626 tablet_bootstrap.cc:492] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.622784 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.623701 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet f3f6a9c5e4be480796f433a68945dd72 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:53.625176 4929 master_service.cc:960] ReplaceTablet: received request to replace tablet f49384587bfa41d6aabfa8ee175d6abe from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:53.626564 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ffe83306e74749b5b3f68e6c2c708c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:53.626601 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.626807 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_add07d0ee556457283038281d97f840b" } modify_external_catalogs: true
I20260927 13:49:53.627007 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_add07d0ee556457283038281d97f840b" } modify_external_catalogs: true
W20260927 13:49:53.627102 5044 leader_election.cc:343] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.627157 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.627226 5044 leader_election.cc:304] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.627424 5079 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f080b4ca9894eae8305d1548010a6cb with delete_type TABLET_DATA_DELETED (replaced by tablet da5d9bda857f467da6930a6c64266f3a) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.627481 6231 raft_consensus.cc:2749] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:53.628284 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12dd91ddaeff4f2a9d7a0761c08fc192 already in progress: creating tablet
W20260927 13:49:53.635109 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cbacda63c0d3427aabf3332b278576c5 consensus state has no leader
I20260927 13:49:53.635468 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_42fee70b5ead49929314182670a6aa7e" } modify_external_catalogs: true
I20260927 13:49:53.635623 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_42fee70b5ead49929314182670a6aa7e" } modify_external_catalogs: true
I20260927 13:49:53.636744 5626 tablet_bootstrap.cc:654] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:53.637635 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12dd91ddaeff4f2a9d7a0761c08fc192 already in progress: creating tablet
I20260927 13:49:53.639442 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e2579c7764f14413988b3e9bfd6ae8d0" } new_table_name: "default.Table_c92956a2abc24a8cb7a86ecae94d3e99" modify_external_catalogs: true
I20260927 13:49:53.643260 6231 raft_consensus.cc:493] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.643399 6231 raft_consensus.cc:515] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.643777 5625 ts_tablet_manager.cc:1929] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.643888 5625 log.cc:1199] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a7a97f4df3a84781bfcbdc768d518ef0
I20260927 13:49:53.643963 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet f49384587bfa41d6aabfa8ee175d6abe
I20260927 13:49:53.644043 6231 leader_election.cc:290] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:53.644502 4929 catalog_manager.cc:6934] ReplaceTablet: tablet f49384587bfa41d6aabfa8ee175d6abe deleted and replaced by tablet dd0126a6df14457ca5c62c129f3275f8
I20260927 13:49:53.644735 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb505472de024c2e9b3861f3225b7e40" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:53.645004 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb505472de024c2e9b3861f3225b7e40" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:53.645196 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet f49384587bfa41d6aabfa8ee175d6abe with delete_type TABLET_DATA_DELETED (replaced by tablet dd0126a6df14457ca5c62c129f3275f8) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:53.645282 5044 leader_election.cc:343] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.645569 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet f49384587bfa41d6aabfa8ee175d6abe with delete_type TABLET_DATA_DELETED (replaced by tablet dd0126a6df14457ca5c62c129f3275f8) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.645737 5619 tablet_bootstrap.cc:492] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:53.645888 5619 ts_tablet_manager.cc:1403] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.249s user 0.004s sys 0.000s
W20260927 13:49:53.646310 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet f49384587bfa41d6aabfa8ee175d6abe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f49384587bfa41d6aabfa8ee175d6abe already in progress: creating tablet
I20260927 13:49:53.646577 5079 tablet_service.cc:1558] Processing DeleteTablet for tablet f49384587bfa41d6aabfa8ee175d6abe with delete_type TABLET_DATA_DELETED (replaced by tablet dd0126a6df14457ca5c62c129f3275f8) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.646705 5619 raft_consensus.cc:359] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.646859 5619 raft_consensus.cc:385] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.646936 5619 raft_consensus.cc:740] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:49:53.647080 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet f49384587bfa41d6aabfa8ee175d6abe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f49384587bfa41d6aabfa8ee175d6abe already in progress: creating tablet
I20260927 13:49:53.647130 5619 consensus_queue.cc:260] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.647652 5619 ts_tablet_manager.cc:1434] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260927 13:49:53.648136 5045 leader_election.cc:343] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.648258 5045 leader_election.cc:304] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.648751 6231 raft_consensus.cc:2749] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:53.649084 5625 ts_tablet_manager.cc:1950] T a7a97f4df3a84781bfcbdc768d518ef0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:53.649524 5625 tablet_replica.cc:333] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:53.649703 5625 raft_consensus.cc:2243] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.649849 5625 raft_consensus.cc:2272] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.650013 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet f3f6a9c5e4be480796f433a68945dd72
I20260927 13:49:53.650537 4921 catalog_manager.cc:6934] ReplaceTablet: tablet f3f6a9c5e4be480796f433a68945dd72 deleted and replaced by tablet 7ef5969312044a2bab451841ec65aa84
I20260927 13:49:53.653159 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet f3f6a9c5e4be480796f433a68945dd72 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef5969312044a2bab451841ec65aa84) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.653973 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a7a97f4df3a84781bfcbdc768d518ef0 (table default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]) successfully deleted
W20260927 13:49:53.656325 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20766b5a757e4a7e954c198f8c9ca41f consensus state has no leader
I20260927 13:49:53.656896 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet f3f6a9c5e4be480796f433a68945dd72 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef5969312044a2bab451841ec65aa84) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.657827 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet f3f6a9c5e4be480796f433a68945dd72 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef5969312044a2bab451841ec65aa84) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:53.658540 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet f3f6a9c5e4be480796f433a68945dd72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3f6a9c5e4be480796f433a68945dd72 already in progress: creating tablet
I20260927 13:49:53.661012 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_030e35baedc24808830ae3843591a919"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.661581 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_030e35baedc24808830ae3843591a919 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.663033 5619 tablet_bootstrap.cc:492] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:53.664196 5625 ts_tablet_manager.cc:1916] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:53.664628 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet f3f6a9c5e4be480796f433a68945dd72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3f6a9c5e4be480796f433a68945dd72 already in progress: creating tablet
I20260927 13:49:53.670748 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet b64d3aa052bf4c48b3802f6006cce9c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 03a1f13b31934baa8ce18fc499e94806) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.671028 5606 tablet_replica.cc:333] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:53.671227 5606 raft_consensus.cc:2243] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.671409 5606 raft_consensus.cc:2272] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.671553 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_bd9a1a5ec36343dd86a068a6875fe17d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:53.672026 5626 tablet_bootstrap.cc:492] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:53.672178 5606 ts_tablet_manager.cc:1916] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.672212 5626 ts_tablet_manager.cc:1403] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.000s
I20260927 13:49:53.672847 6204 raft_consensus.cc:493] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.673013 6204 raft_consensus.cc:515] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.673192 5626 raft_consensus.cc:359] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.673383 5626 raft_consensus.cc:385] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.673453 5626 raft_consensus.cc:740] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.673740 6204 leader_election.cc:290] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:53.673761 5626 consensus_queue.cc:260] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.675079 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6af9b33f0c464683e40adc28037bc8" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:53.675359 5385 raft_consensus.cc:2393] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:49:53.676048 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6af9b33f0c464683e40adc28037bc8" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:53.677210 5184 leader_election.cc:304] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.677515 5626 ts_tablet_manager.cc:1434] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:53.677897 6204 raft_consensus.cc:3060] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:53.678225 5626 tablet_bootstrap.cc:492] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.678550 5606 ts_tablet_manager.cc:1929] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.678664 5606 log.cc:1199] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b64d3aa052bf4c48b3802f6006cce9c9
I20260927 13:49:53.679024 5606 ts_tablet_manager.cc:1950] T b64d3aa052bf4c48b3802f6006cce9c9 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:53.680334 5626 tablet_bootstrap.cc:654] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.681448 6204 raft_consensus.cc:2749] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:53.680024 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b64d3aa052bf4c48b3802f6006cce9c9 (table default.Table_cf1d80366a7743b3b4fea68ea5246139 [id=ded13e9c993046cd891db043b1ff6a95]) successfully deleted
W20260927 13:49:53.682444 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd9a1a5ec36343dd86a068a6875fe17d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.687754 4925 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (table default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f]). Expected version 1 got 0
I20260927 13:49:53.689364 5625 ts_tablet_manager.cc:1929] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.689380 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet b64d3aa052bf4c48b3802f6006cce9c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 03a1f13b31934baa8ce18fc499e94806) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.689491 5625 log.cc:1199] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/1245334728994a60ad641c2e90f8d2df
I20260927 13:49:53.689793 5625 ts_tablet_manager.cc:1950] T 1245334728994a60ad641c2e90f8d2df P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:53.690788 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b64d3aa052bf4c48b3802f6006cce9c9 because the tablet was not found. No further retry: Not found: Tablet not found: b64d3aa052bf4c48b3802f6006cce9c9
I20260927 13:49:53.691428 5619 tablet_bootstrap.cc:654] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.692965 5626 tablet_bootstrap.cc:492] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:53.693166 5626 ts_tablet_manager.cc:1403] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.003s
I20260927 13:49:53.693212 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fe3174f3ee074adf9193e1f8228cdcce" } modify_external_catalogs: true
I20260927 13:49:53.693480 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fe3174f3ee074adf9193e1f8228cdcce" } modify_external_catalogs: true
I20260927 13:49:53.694294 5626 raft_consensus.cc:359] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.694558 5626 raft_consensus.cc:385] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.694681 5626 raft_consensus.cc:740] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.694983 5626 consensus_queue.cc:260] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.695571 4927 master_service.cc:960] ReplaceTablet: received request to replace tablet cf1a58c67bf54493a3c62fb175acabb8 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:53.696377 5626 ts_tablet_manager.cc:1434] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260927 13:49:53.697395 5626 tablet_bootstrap.cc:492] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.699740 5626 tablet_bootstrap.cc:654] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.702525 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 1245334728994a60ad641c2e90f8d2df (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]) successfully deleted
I20260927 13:49:53.702602 5625 tablet_replica.cc:333] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:53.702769 5625 raft_consensus.cc:2243] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:53.702827 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 71268fb7aa9646639ea41dc8ccebfc5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71268fb7aa9646639ea41dc8ccebfc5c already in progress: creating tablet
I20260927 13:49:53.702953 5625 raft_consensus.cc:2272] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:53.703037 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet c48ca4b429294782a9e6ed496c6dfb72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c48ca4b429294782a9e6ed496c6dfb72 already in progress: creating tablet
W20260927 13:49:53.703290 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a813939920244be781d546311fe8a33e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a813939920244be781d546311fe8a33e already in progress: creating tablet
W20260927 13:49:53.703534 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b0827a26334c42728545a9eaa006fae0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0827a26334c42728545a9eaa006fae0 already in progress: creating tablet
W20260927 13:49:53.703739 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 8e8bf79954c2429f886ac7afc9a8455f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e8bf79954c2429f886ac7afc9a8455f already in progress: creating tablet
W20260927 13:49:53.703946 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b3fbf1e7f5e04122a65f6e192ffdae20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3fbf1e7f5e04122a65f6e192ffdae20 already in progress: creating tablet
W20260927 13:49:53.704190 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12dd91ddaeff4f2a9d7a0761c08fc192 already in progress: creating tablet
I20260927 13:49:53.704680 5626 tablet_bootstrap.cc:492] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:53.704901 5626 ts_tablet_manager.cc:1403] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260927 13:49:53.705938 5626 raft_consensus.cc:359] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:53.706231 5626 raft_consensus.cc:385] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.706336 5626 raft_consensus.cc:740] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.706636 5626 consensus_queue.cc:260] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:53.707213 5626 ts_tablet_manager.cc:1434] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:53.709292 5625 ts_tablet_manager.cc:1916] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.710721 5619 tablet_bootstrap.cc:492] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:53.710882 5619 ts_tablet_manager.cc:1403] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.004s
I20260927 13:49:53.711628 5619 raft_consensus.cc:359] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.711826 5619 raft_consensus.cc:385] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.711889 5619 raft_consensus.cc:740] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.715124 4925 master_service.cc:960] ReplaceTablet: received request to replace tablet 08798185a7c641f98d7dc6a6b1b72e0a from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:53.718502 5619 consensus_queue.cc:260] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.719527 4923 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1cc174eab36b46fb8e276b3168fbfbcd (table default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe]). Expected version 3 got 0
I20260927 13:49:53.719599 5626 tablet_bootstrap.cc:492] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.721199 5619 ts_tablet_manager.cc:1434] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260927 13:49:53.721529 5619 tablet_bootstrap.cc:492] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:53.727921 6247 consensus_queue.cc:1048] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:53.733445 6247 consensus_queue.cc:1048] T a49834518ff34b1981d44f3824c131f3 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:53.736353 4923 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b3a305ad4c704bbd8d522515786100c0 (table default.Table_25e6e013310e4ba18a969df5b8ae3901 [id=33df36c4049b4b0a97fc6541b66a362b]). Expected version 1 got 0
I20260927 13:49:53.738189 5361 tablet_service.cc:1511] Processing CreateTablet for tablet dd4ddd064e2c415fb47b694732514582 (DEFAULT_TABLE table=default.Table_c422a4d620fb41f788588f45ad6e57ec [id=78d4b804a72047c3b65aea1d0c259d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.738605 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4ddd064e2c415fb47b694732514582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.739739 4921 catalog_manager.cc:5838] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65). New cstate: current_term: 1 leader_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:53.739899 5077 tablet_service.cc:1511] Processing CreateTablet for tablet dd4ddd064e2c415fb47b694732514582 (DEFAULT_TABLE table=default.Table_c422a4d620fb41f788588f45ad6e57ec [id=78d4b804a72047c3b65aea1d0c259d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.739991 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 9e808336f5b746d486d375695536c052 (DEFAULT_TABLE table=default.Table_82abe0dde56e49ea9af2bb8ddcfa508d [id=d088563f44224b01a3eba63ce70e5681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.740134 4921 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 4d35148d80b44fca9b39a4625d3e61c1 (table default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]). Expected version 1 got 0
I20260927 13:49:53.740247 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4ddd064e2c415fb47b694732514582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.740470 4921 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
I20260927 13:49:53.741710 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 9e808336f5b746d486d375695536c052 (DEFAULT_TABLE table=default.Table_82abe0dde56e49ea9af2bb8ddcfa508d [id=d088563f44224b01a3eba63ce70e5681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.742103 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e808336f5b746d486d375695536c052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.742408 5347 tablet_service.cc:1511] Processing CreateTablet for tablet 9e808336f5b746d486d375695536c052 (DEFAULT_TABLE table=default.Table_82abe0dde56e49ea9af2bb8ddcfa508d [id=d088563f44224b01a3eba63ce70e5681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.742501 5226 tablet_service.cc:1511] Processing CreateTablet for tablet dd4ddd064e2c415fb47b694732514582 (DEFAULT_TABLE table=default.Table_c422a4d620fb41f788588f45ad6e57ec [id=78d4b804a72047c3b65aea1d0c259d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.742735 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e808336f5b746d486d375695536c052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.742972 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4ddd064e2c415fb47b694732514582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.746356 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e808336f5b746d486d375695536c052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.746398 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 0076228c3f224d1f9d76ccf2dd7064ae (DEFAULT_TABLE table=default.Table_bf1d966c56b941bab74f8fe4cef3bbb6 [id=f07c60c3feb741e4b9dda75a2ab5660e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.746691 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0076228c3f224d1f9d76ccf2dd7064ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.748656 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a
I20260927 13:49:53.750666 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.751219 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.753861 6231 raft_consensus.cc:493] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.753895 4926 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b3a305ad4c704bbd8d522515786100c0 (table default.Table_25e6e013310e4ba18a969df5b8ae3901 [id=33df36c4049b4b0a97fc6541b66a362b]). Expected version 1 got 0
I20260927 13:49:53.754007 6231 raft_consensus.cc:515] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:53.754724 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:53.754768 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a already in progress: creating tablet
I20260927 13:49:53.754866 6231 leader_election.cc:290] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:53.755518 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03917a40b5884401a6bc09c7925fd1ae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:53.756186 5044 leader_election.cc:343] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.756868 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03917a40b5884401a6bc09c7925fd1ae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:53.757702 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3539bb21635f41688c4f65412b92c4a6" } new_table_name: "default.Table_44bd8c7b8db24ad5b93798bfebf1d192" modify_external_catalogs: true
W20260927 13:49:53.757903 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a already in progress: creating tablet
W20260927 13:49:53.758257 5045 leader_election.cc:343] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.758364 5045 leader_election.cc:304] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.758569 6231 raft_consensus.cc:2749] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:53.759989 5228 tablet_service.cc:1511] Processing CreateTablet for tablet 0076228c3f224d1f9d76ccf2dd7064ae (DEFAULT_TABLE table=default.Table_bf1d966c56b941bab74f8fe4cef3bbb6 [id=f07c60c3feb741e4b9dda75a2ab5660e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.760372 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0076228c3f224d1f9d76ccf2dd7064ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.761288 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 334b0349bfaa4a9c8b7d280177f1ecae
I20260927 13:49:53.763232 5226 tablet_service.cc:1558] Processing DeleteTablet for tablet 334b0349bfaa4a9c8b7d280177f1ecae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.764001 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 0076228c3f224d1f9d76ccf2dd7064ae (DEFAULT_TABLE table=default.Table_bf1d966c56b941bab74f8fe4cef3bbb6 [id=f07c60c3feb741e4b9dda75a2ab5660e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.764106 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 334b0349bfaa4a9c8b7d280177f1ecae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.764415 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0076228c3f224d1f9d76ccf2dd7064ae. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:53.764722 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 334b0349bfaa4a9c8b7d280177f1ecae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 334b0349bfaa4a9c8b7d280177f1ecae already in progress: creating tablet
W20260927 13:49:53.766678 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 334b0349bfaa4a9c8b7d280177f1ecae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 334b0349bfaa4a9c8b7d280177f1ecae already in progress: creating tablet
I20260927 13:49:53.768994 5076 tablet_service.cc:1511] Processing CreateTablet for tablet bf052a0645154d4c837a372173b8f610 (DEFAULT_TABLE table=default.Table_010dd8cdd9ea470397aeff0f1235bf1e [id=ae14efb404dc420ca7b29717270210a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.769122 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet cf1a58c67bf54493a3c62fb175acabb8
I20260927 13:49:53.769506 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf052a0645154d4c837a372173b8f610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.769522 5215 tablet_service.cc:1511] Processing CreateTablet for tablet bf052a0645154d4c837a372173b8f610 (DEFAULT_TABLE table=default.Table_010dd8cdd9ea470397aeff0f1235bf1e [id=ae14efb404dc420ca7b29717270210a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.769541 5364 tablet_service.cc:1511] Processing CreateTablet for tablet a90d9bb192cf4e26812abb9c2ecc3682 (DEFAULT_TABLE table=default.Table_5ca3c5799145419794585daecfa39d9b [id=38e2b12dc19a402ab27a29fed044186f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.769775 4927 catalog_manager.cc:6934] ReplaceTablet: tablet cf1a58c67bf54493a3c62fb175acabb8 deleted and replaced by tablet 9abb473dbb3d491c9d15a161541fe795
I20260927 13:49:53.769985 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90d9bb192cf4e26812abb9c2ecc3682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.769984 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf052a0645154d4c837a372173b8f610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.770380 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 08798185a7c641f98d7dc6a6b1b72e0a
I20260927 13:49:53.770962 4925 catalog_manager.cc:6934] ReplaceTablet: tablet 08798185a7c641f98d7dc6a6b1b72e0a deleted and replaced by tablet ecb5cdc007074e0c8f44d963e527a955
I20260927 13:49:53.773239 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet d3149f6bbaf043f08970e19fd66c4e2a
I20260927 13:49:53.774394 5085 tablet_service.cc:1511] Processing CreateTablet for tablet 860598d598dd4373b44075a932c7df52 (DEFAULT_TABLE table=default.Table_7881acf83e854c3d86e41bcea92e353d [id=61f811887e744ffe81d330661ab890f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.774431 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 860598d598dd4373b44075a932c7df52 (DEFAULT_TABLE table=default.Table_7881acf83e854c3d86e41bcea92e353d [id=61f811887e744ffe81d330661ab890f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.774425 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 860598d598dd4373b44075a932c7df52 (DEFAULT_TABLE table=default.Table_7881acf83e854c3d86e41bcea92e353d [id=61f811887e744ffe81d330661ab890f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.774731 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860598d598dd4373b44075a932c7df52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.774746 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860598d598dd4373b44075a932c7df52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.774778 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860598d598dd4373b44075a932c7df52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.775439 5351 tablet_service.cc:1511] Processing CreateTablet for tablet bf052a0645154d4c837a372173b8f610 (DEFAULT_TABLE table=default.Table_010dd8cdd9ea470397aeff0f1235bf1e [id=ae14efb404dc420ca7b29717270210a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.778769 5070 tablet_service.cc:1558] Processing DeleteTablet for tablet 08798185a7c641f98d7dc6a6b1b72e0a with delete_type TABLET_DATA_DELETED (replaced by tablet ecb5cdc007074e0c8f44d963e527a955) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.778925 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet cf1a58c67bf54493a3c62fb175acabb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9abb473dbb3d491c9d15a161541fe795) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.779006 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet ec40378eb80c412198d5b66c02e975ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.779126 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet fa9d09ca7952499ba135e15cecb1143e with delete_type TABLET_DATA_DELETED (replaced by tablet 4211f338c6a648c5b3e36c6df0b3c510) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.779156 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet d3149f6bbaf043f08970e19fd66c4e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.779629 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 08798185a7c641f98d7dc6a6b1b72e0a with delete_type TABLET_DATA_DELETED (replaced by tablet ecb5cdc007074e0c8f44d963e527a955) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.779810 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet cf1a58c67bf54493a3c62fb175acabb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9abb473dbb3d491c9d15a161541fe795) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.780032 5213 tablet_service.cc:1558] Processing DeleteTablet for tablet d3149f6bbaf043f08970e19fd66c4e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:53.780735 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 08798185a7c641f98d7dc6a6b1b72e0a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08798185a7c641f98d7dc6a6b1b72e0a already in progress: creating tablet
W20260927 13:49:53.780995 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet cf1a58c67bf54493a3c62fb175acabb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf1a58c67bf54493a3c62fb175acabb8 already in progress: creating tablet
W20260927 13:49:53.781226 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet d3149f6bbaf043f08970e19fd66c4e2a because the tablet was not found. No further retry: Not found: Tablet not found: d3149f6bbaf043f08970e19fd66c4e2a
I20260927 13:49:53.782387 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf052a0645154d4c837a372173b8f610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.787724 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_072a0d2dac43447db9aeb63f44c86152" } new_table_name: "default.Table_9511933508164b64b6d5e6442acc8f95" modify_external_catalogs: true
I20260927 13:49:53.788285 5346 tablet_service.cc:1558] Processing DeleteTablet for tablet d3149f6bbaf043f08970e19fd66c4e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:53.791771 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet d3149f6bbaf043f08970e19fd66c4e2a because the tablet was not found. No further retry: Not found: Tablet not found: d3149f6bbaf043f08970e19fd66c4e2a
I20260927 13:49:53.792744 6204 raft_consensus.cc:493] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.793502 6204 raft_consensus.cc:515] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.794567 6204 leader_election.cc:290] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:53.794888 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a82284e3fd1f4a2f95c7e47320abb30c consensus state has no leader
I20260927 13:49:53.795605 5619 tablet_bootstrap.cc:654] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.796037 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a305ad4c704bbd8d522515786100c0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:53.796324 5382 raft_consensus.cc:2468] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:53.796700 6231 raft_consensus.cc:493] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.796836 6231 raft_consensus.cc:515] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.801421 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_81665809269849e98e48061e93daa488"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.802034 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81665809269849e98e48061e93daa488 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.804003 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_bce59a04c83047b9beb7f6762ae2cfac" } new_table_name: "default.Table_62a5e0b541594ef595869627c9b0b6b7" modify_external_catalogs: true
I20260927 13:49:53.804487 6231 leader_election.cc:290] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:53.805841 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 58acd8932a2647a0a20679614cc2b68a (DEFAULT_TABLE table=default.Table_2e63e80572a047aabb5d20f0417a30cd [id=5cd11f4b179449438728efcb6e9c82c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.806377 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58acd8932a2647a0a20679614cc2b68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.807051 5185 leader_election.cc:304] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:53.807173 5079 tablet_service.cc:1511] Processing CreateTablet for tablet a90d9bb192cf4e26812abb9c2ecc3682 (DEFAULT_TABLE table=default.Table_5ca3c5799145419794585daecfa39d9b [id=38e2b12dc19a402ab27a29fed044186f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.807492 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90d9bb192cf4e26812abb9c2ecc3682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.808616 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564f5c92bf144fa1bfc2e1e07132dd69" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:53.809217 5045 leader_election.cc:343] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.809628 6204 raft_consensus.cc:2804] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:53.809508 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 58acd8932a2647a0a20679614cc2b68a (DEFAULT_TABLE table=default.Table_2e63e80572a047aabb5d20f0417a30cd [id=5cd11f4b179449438728efcb6e9c82c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.809635 4921 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_020de70ec7bc4e119d5c6a3e22d8d32d" } modify_external_catalogs: true
I20260927 13:49:53.809736 6204 raft_consensus.cc:493] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:53.809873 4921 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_020de70ec7bc4e119d5c6a3e22d8d32d" } modify_external_catalogs: true
I20260927 13:49:53.810042 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58acd8932a2647a0a20679614cc2b68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.810806 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet cf1a58c67bf54493a3c62fb175acabb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9abb473dbb3d491c9d15a161541fe795) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.811466 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564f5c92bf144fa1bfc2e1e07132dd69" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:53.811515 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet cf1a58c67bf54493a3c62fb175acabb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf1a58c67bf54493a3c62fb175acabb8 already in progress: creating tablet
W20260927 13:49:53.811901 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd84d3cf740040739d81de2460296d2c has no consensus state
W20260927 13:49:53.812002 5044 leader_election.cc:343] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.812112 5044 leader_election.cc:304] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.812577 6231 raft_consensus.cc:2749] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:53.812580 6204 raft_consensus.cc:3060] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:53.814206 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 08798185a7c641f98d7dc6a6b1b72e0a with delete_type TABLET_DATA_DELETED (replaced by tablet ecb5cdc007074e0c8f44d963e527a955) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:53.816030 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 08798185a7c641f98d7dc6a6b1b72e0a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08798185a7c641f98d7dc6a6b1b72e0a already in progress: creating tablet
I20260927 13:49:53.816340 6204 raft_consensus.cc:515] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.817706 6204 leader_election.cc:290] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:53.817653 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a305ad4c704bbd8d522515786100c0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:53.819885 5382 raft_consensus.cc:3060] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:53.822245 5226 tablet_service.cc:1511] Processing CreateTablet for tablet a90d9bb192cf4e26812abb9c2ecc3682 (DEFAULT_TABLE table=default.Table_5ca3c5799145419794585daecfa39d9b [id=38e2b12dc19a402ab27a29fed044186f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.822688 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90d9bb192cf4e26812abb9c2ecc3682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.823530 5382 raft_consensus.cc:2468] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:53.823910 5185 leader_election.cc:304] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:49:53.824813 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3e6e4b6fb5a49e687f7ca6707471ad3 has no consensus state
I20260927 13:49:53.824993 6204 raft_consensus.cc:2804] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:53.825189 6204 raft_consensus.cc:697] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:53.825511 6204 consensus_queue.cc:237] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.827036 5228 tablet_service.cc:1511] Processing CreateTablet for tablet 58acd8932a2647a0a20679614cc2b68a (DEFAULT_TABLE table=default.Table_2e63e80572a047aabb5d20f0417a30cd [id=5cd11f4b179449438728efcb6e9c82c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.827445 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58acd8932a2647a0a20679614cc2b68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.830217 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a305ad4c704bbd8d522515786100c0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:53.830421 5105 raft_consensus.cc:3060] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:53.831086 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b57886cc11a2423983c2b7bac79150a0
I20260927 13:49:53.832403 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet b57886cc11a2423983c2b7bac79150a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:53.832962 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b57886cc11a2423983c2b7bac79150a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b57886cc11a2423983c2b7bac79150a0 already in progress: creating tablet
I20260927 13:49:53.834168 5619 tablet_bootstrap.cc:492] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:53.834333 5619 ts_tablet_manager.cc:1403] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.113s user 0.005s sys 0.001s
W20260927 13:49:53.835644 6181 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 13:49:53.836150 6181 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260927 13:49:53.837324 5619 raft_consensus.cc:359] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.837518 5619 raft_consensus.cc:385] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.837621 5619 raft_consensus.cc:740] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:49:53.837770 6181 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260927 13:49:53.837903 5619 consensus_queue.cc:260] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.840750 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
I20260927 13:49:53.841950 5619 ts_tablet_manager.cc:1434] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260927 13:49:53.842367 4925 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 4d35148d80b44fca9b39a4625d3e61c1 (table default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]). Expected version 1 got 0
I20260927 13:49:53.842463 5619 tablet_bootstrap.cc:492] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:53.845932 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a5e2dce7a50147989daaa5bcd02f11da" } new_table_name: "default.Table_c700b32dc7b84e708c594f19077a40d1" modify_external_catalogs: true
I20260927 13:49:53.849282 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ccb6887bdbc847159519b36b4f89b414"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:53.849853 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_07ff9b27d4c84273a02178c5797cadb9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.850452 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccb6887bdbc847159519b36b4f89b414 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:53.850526 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07ff9b27d4c84273a02178c5797cadb9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.852124 5619 tablet_bootstrap.cc:654] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.852051 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_23ae01b278734a1e94187c6846ce8f26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.852578 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23ae01b278734a1e94187c6846ce8f26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.853993 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6f6ffa29cd68453094b577c1001a1298"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.854480 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f6ffa29cd68453094b577c1001a1298 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.858364 4926 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 4d35148d80b44fca9b39a4625d3e61c1 (table default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]). Expected version 1 got 0
I20260927 13:49:53.859112 5626 tablet_bootstrap.cc:654] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:53.858803 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2128a705593e4d37a3ca319f72a9f7d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:53.865293 5215 tablet_service.cc:1511] Processing CreateTablet for tablet d3149f6bbaf043f08970e19fd66c4e2a (DEFAULT_TABLE table=default.Table_fe3174f3ee074adf9193e1f8228cdcce [id=ab3279095ebc4b26bc3f83fc7c8ef050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.865890 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3149f6bbaf043f08970e19fd66c4e2a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:53.867290 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2128a705593e4d37a3ca319f72a9f7d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.869055 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a305ad4c704bbd8d522515786100c0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:53.869426 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 334b0349bfaa4a9c8b7d280177f1ecae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.870317 5363 tablet_service.cc:1511] Processing CreateTablet for tablet d3149f6bbaf043f08970e19fd66c4e2a (DEFAULT_TABLE table=default.Table_fe3174f3ee074adf9193e1f8228cdcce [id=ab3279095ebc4b26bc3f83fc7c8ef050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.870849 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3149f6bbaf043f08970e19fd66c4e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.870504 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_bdd9cd69a46646c09a795b8566ba23aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.871543 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdd9cd69a46646c09a795b8566ba23aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.872788 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_15989a15160f4cb5b6809d139795ed4d" } new_table_name: "default.Table_2ed78e0a13974e79ae31fbb791c5ba85" modify_external_catalogs: true
I20260927 13:49:53.874807 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet b57886cc11a2423983c2b7bac79150a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.875088 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_410ddd78682b4d2ebbfad8038609093b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.875656 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_410ddd78682b4d2ebbfad8038609093b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.877102 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8c3b2a8ae18e4aa0a1e71601ac62ea43" } modify_external_catalogs: true
I20260927 13:49:53.877368 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8c3b2a8ae18e4aa0a1e71601ac62ea43" } modify_external_catalogs: true
I20260927 13:49:53.879138 5619 tablet_bootstrap.cc:492] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:53.879681 5619 ts_tablet_manager.cc:1403] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.004s
I20260927 13:49:53.885280 6247 raft_consensus.cc:493] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.885521 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet b57886cc11a2423983c2b7bac79150a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.885690 6247 raft_consensus.cc:515] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.882961 5619 raft_consensus.cc:359] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.886384 5619 raft_consensus.cc:385] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.886482 5619 raft_consensus.cc:740] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:49:53.886536 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b57886cc11a2423983c2b7bac79150a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b57886cc11a2423983c2b7bac79150a0 already in progress: creating tablet
I20260927 13:49:53.886773 5619 consensus_queue.cc:260] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.887508 6247 leader_election.cc:290] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:53.887573 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74226753751a49fa8ce98eafb2ca1250" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:53.887802 5247 raft_consensus.cc:2468] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:53.888295 5319 leader_election.cc:304] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:49:53.894976 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 008516a474cc40f2b9de77b2f3e762cf consensus state has no leader
I20260927 13:49:53.895655 6247 raft_consensus.cc:2804] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:53.896085 6247 raft_consensus.cc:493] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:53.896209 6247 raft_consensus.cc:3060] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:53.896848 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f8cf2e1f9d84401897db63d0a884c6b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.897368 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8cf2e1f9d84401897db63d0a884c6b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:53.895139 5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74226753751a49fa8ce98eafb2ca1250" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:53.900369 6247 raft_consensus.cc:515] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.901582 5104 raft_consensus.cc:2468] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:53.902450 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74226753751a49fa8ce98eafb2ca1250" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:53.902709 5247 raft_consensus.cc:3060] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:53.903457 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e917382b6f3d4e009fa159ed38c342d8 consensus state has no leader
I20260927 13:49:53.905769 5247 raft_consensus.cc:2468] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:53.905861 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet a6af740383384609a354d7f0fae2cd70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.906702 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74226753751a49fa8ce98eafb2ca1250" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
W20260927 13:49:53.906723 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a6af740383384609a354d7f0fae2cd70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6af740383384609a354d7f0fae2cd70 already in progress: creating tablet
I20260927 13:49:53.906857 5109 raft_consensus.cc:3060] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:53.909718 5625 ts_tablet_manager.cc:1929] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:53.909832 5625 log.cc:1199] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/9f080b4ca9894eae8305d1548010a6cb
I20260927 13:49:53.910461 6344 raft_consensus.cc:493] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.910650 6344 raft_consensus.cc:515] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:53.912424 5184 leader_election.cc:343] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 1f5dfa3e80454463908df19a49454764
I20260927 13:49:53.912689 6344 leader_election.cc:290] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:53.915540 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 0880140d99004eb1803d6b5dcf41af13
I20260927 13:49:53.915693 5625 ts_tablet_manager.cc:1950] T 9f080b4ca9894eae8305d1548010a6cb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:53.919852 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 9f080b4ca9894eae8305d1548010a6cb (table default.Table_3e9c701f47c14f53a3e9d39d0ec63a7d [id=42bfb85e0c8f425ea04c34b94ec24c58]) successfully deleted
W20260927 13:49:53.920130 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet f49384587bfa41d6aabfa8ee175d6abe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f49384587bfa41d6aabfa8ee175d6abe already in progress: creating tablet
W20260927 13:49:53.920388 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet f3f6a9c5e4be480796f433a68945dd72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3f6a9c5e4be480796f433a68945dd72 already in progress: creating tablet
I20260927 13:49:53.921506 5223 tablet_service.cc:1511] Processing CreateTablet for tablet d9cb99ad45d1445cb2e2854319a3d73d (DEFAULT_TABLE table=default.Table_74758221c71d4c799da6b76df7746ba3 [id=ba15fdb3f6d9461e85fbef90616b4b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.921981 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cb99ad45d1445cb2e2854319a3d73d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.924016 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 0880140d99004eb1803d6b5dcf41af13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.926051 5319 leader_election.cc:304] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:53.926304 5619 ts_tablet_manager.cc:1434] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.046s user 0.002s sys 0.000s
I20260927 13:49:53.926698 5619 tablet_bootstrap.cc:492] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:53.926811 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 0880140d99004eb1803d6b5dcf41af13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:53.927227 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5dfa3e80454463908df19a49454764" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:53.927292 5364 tablet_service.cc:1511] Processing CreateTablet for tablet d9cb99ad45d1445cb2e2854319a3d73d (DEFAULT_TABLE table=default.Table_74758221c71d4c799da6b76df7746ba3 [id=ba15fdb3f6d9461e85fbef90616b4b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.927776 6145 raft_consensus.cc:2804] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:53.927929 6145 raft_consensus.cc:697] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:53.928186 6145 consensus_queue.cc:237] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:53.929823 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 0880140d99004eb1803d6b5dcf41af13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.930269 5082 tablet_service.cc:1511] Processing CreateTablet for tablet d9cb99ad45d1445cb2e2854319a3d73d (DEFAULT_TABLE table=default.Table_74758221c71d4c799da6b76df7746ba3 [id=ba15fdb3f6d9461e85fbef90616b4b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.930460 5353 tablet_service.cc:1511] Processing CreateTablet for tablet eef853d6e6ce4848927c9de884d39ac2 (DEFAULT_TABLE table=default.Table_9db5a06b3541451089e3b03a35674a16 [id=ec046cb1c7db4739bf79469063f2f287]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:53.931162 5185 leader_election.cc:343] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.931300 5185 leader_election.cc:304] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:53.931597 5085 tablet_service.cc:1511] Processing CreateTablet for tablet d3149f6bbaf043f08970e19fd66c4e2a (DEFAULT_TABLE table=default.Table_fe3174f3ee074adf9193e1f8228cdcce [id=ab3279095ebc4b26bc3f83fc7c8ef050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.931792 5077 tablet_service.cc:1511] Processing CreateTablet for tablet eef853d6e6ce4848927c9de884d39ac2 (DEFAULT_TABLE table=default.Table_9db5a06b3541451089e3b03a35674a16 [id=ec046cb1c7db4739bf79469063f2f287]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.931850 6344 raft_consensus.cc:2749] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:53.932124 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef853d6e6ce4848927c9de884d39ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.932408 6247 leader_election.cc:290] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:53.934141 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cb99ad45d1445cb2e2854319a3d73d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.934485 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 69606adaa96d431791ed5c8455a7c548 (DEFAULT_TABLE table=default.Table_4cd659e994114aa1b042d1f2391b9760 [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.937471 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cb99ad45d1445cb2e2854319a3d73d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.938833 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3149f6bbaf043f08970e19fd66c4e2a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:53.945668 6181 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 13:49:53.945778 6181 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260927 13:49:53.945885 6181 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 13:49:53.945959 6181 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260927 13:49:53.946957 5625 tablet_replica.cc:333] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
W20260927 13:49:53.949021 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 0880140d99004eb1803d6b5dcf41af13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0880140d99004eb1803d6b5dcf41af13 already in progress: creating tablet
I20260927 13:49:53.949640 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_789c5549472f4bf8ab1581eb3903953a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:53.949795 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a already in progress: creating tablet
W20260927 13:49:53.950186 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 08798185a7c641f98d7dc6a6b1b72e0a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08798185a7c641f98d7dc6a6b1b72e0a already in progress: creating tablet
W20260927 13:49:53.950248 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_789c5549472f4bf8ab1581eb3903953a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:53.950538 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet cf1a58c67bf54493a3c62fb175acabb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf1a58c67bf54493a3c62fb175acabb8 already in progress: creating tablet
W20260927 13:49:53.951018 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 0880140d99004eb1803d6b5dcf41af13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0880140d99004eb1803d6b5dcf41af13 already in progress: creating tablet
I20260927 13:49:53.951857 5626 tablet_bootstrap.cc:492] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:53.952020 5626 ts_tablet_manager.cc:1403] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.245s user 0.003s sys 0.002s
I20260927 13:49:53.952912 5626 raft_consensus.cc:359] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.953164 5626 raft_consensus.cc:385] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:53.953320 5626 raft_consensus.cc:740] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:53.954380 5626 consensus_queue.cc:260] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.954942 5626 ts_tablet_manager.cc:1434] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:49:53.957545 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cb2cdf43d4eb4fc1b302363907f746a2" } modify_external_catalogs: true
I20260927 13:49:53.957727 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cb2cdf43d4eb4fc1b302363907f746a2" } modify_external_catalogs: true
I20260927 13:49:53.963274 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b12c6e4211af4ab7b866815072339fe6" } modify_external_catalogs: true
I20260927 13:49:53.963461 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b12c6e4211af4ab7b866815072339fe6" } modify_external_catalogs: true
I20260927 13:49:53.968376 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 5978cb78bd974d669817def05007d0ea
I20260927 13:49:53.969141 6231 raft_consensus.cc:493] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.969957 6231 raft_consensus.cc:515] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.971228 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9d09ca7952499ba135e15cecb1143e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:53.971395 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2657276c4b2f43c1ad64a8c1fd58ada9
W20260927 13:49:53.971758 5044 leader_election.cc:343] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:53.972376 6231 leader_election.cc:290] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:53.973346 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 5978cb78bd974d669817def05007d0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.973505 5625 raft_consensus.cc:2243] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:53.973740 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:53.974334 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 5978cb78bd974d669817def05007d0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:53.974541 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:53.974853 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 5978cb78bd974d669817def05007d0ea because the tablet was not found. No further retry: Not found: Tablet not found: 5978cb78bd974d669817def05007d0ea
W20260927 13:49:53.975143 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2657276c4b2f43c1ad64a8c1fd58ada9 already in progress: creating tablet
I20260927 13:49:53.979133 5105 raft_consensus.cc:2468] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:53.979600 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 69606adaa96d431791ed5c8455a7c548 (DEFAULT_TABLE table=default.Table_4cd659e994114aa1b042d1f2391b9760 [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.980050 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69606adaa96d431791ed5c8455a7c548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.981256 5109 raft_consensus.cc:2468] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:53.982393 5625 raft_consensus.cc:2272] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:53.983980 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 69606adaa96d431791ed5c8455a7c548 (DEFAULT_TABLE table=default.Table_4cd659e994114aa1b042d1f2391b9760 [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.984373 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69606adaa96d431791ed5c8455a7c548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.990386 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaffd54534442e1aa6db158d313fab3 (DEFAULT_TABLE table=default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:53.990917 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaffd54534442e1aa6db158d313fab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:53.991261 5625 ts_tablet_manager.cc:1916] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:53.992925 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_25e6e013310e4ba18a969df5b8ae3901" } modify_external_catalogs: true
I20260927 13:49:53.993188 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_25e6e013310e4ba18a969df5b8ae3901" } modify_external_catalogs: true
I20260927 13:49:53.995584 5626 tablet_bootstrap.cc:492] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:53.998864 6204 raft_consensus.cc:493] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:53.999017 6204 raft_consensus.cc:515] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:53.999445 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ffc1e524e9a84e0a87e674470c4370e9" } new_table_name: "default.Table_ac14a94068db47ec93c7f92b477d620f" modify_external_catalogs: true
I20260927 13:49:54.000061 6204 leader_election.cc:290] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:54.001642 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaffd54534442e1aa6db158d313fab3 (DEFAULT_TABLE table=default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.002869 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b3a305ad4c704bbd8d522515786100c0
I20260927 13:49:54.003023 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaffd54534442e1aa6db158d313fab3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:54.005256 5184 leader_election.cc:343] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 825a73d47bff4246965be82eb482f7aa
I20260927 13:49:54.006433 5226 tablet_service.cc:1511] Processing CreateTablet for tablet 5978cb78bd974d669817def05007d0ea (DEFAULT_TABLE table=default.Table_cb2cdf43d4eb4fc1b302363907f746a2 [id=a2e5f425d1494b40a9b253e6b2d4c86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.006810 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5978cb78bd974d669817def05007d0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.004424 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 5978cb78bd974d669817def05007d0ea (DEFAULT_TABLE table=default.Table_cb2cdf43d4eb4fc1b302363907f746a2 [id=a2e5f425d1494b40a9b253e6b2d4c86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.010188 5626 tablet_bootstrap.cc:654] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:54.012223 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 78c4bbb0512c4411916eb4c48731f32f consensus state has no leader
I20260927 13:49:54.013115 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5978cb78bd974d669817def05007d0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.014492 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2128a705593e4d37a3ca319f72a9f7d0" } new_table_name: "default.Table_8daba74a17de4de1ad4cb175abfb5ef1" modify_external_catalogs: true
I20260927 13:49:54.023517 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_0c9a96d72b0f43e5afec0d076cff390d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:54.024065 5626 tablet_bootstrap.cc:492] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
W20260927 13:49:54.024166 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c9a96d72b0f43e5afec0d076cff390d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.024242 5626 ts_tablet_manager.cc:1403] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.001s
I20260927 13:49:54.025012 5626 raft_consensus.cc:359] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:54.025204 5626 raft_consensus.cc:385] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.025279 5626 raft_consensus.cc:740] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.026324 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3aa8c52bbcea4bdd9b268b8dce338b4b" } new_table_name: "default.Table_aaa8c970b9124f9abcdb193f7539d309" modify_external_catalogs: true
I20260927 13:49:54.033226 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_03b60a7efdad48f7bcb17007df1f9847" } modify_external_catalogs: true
I20260927 13:49:54.033430 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_03b60a7efdad48f7bcb17007df1f9847" } modify_external_catalogs: true
I20260927 13:49:54.039716 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cc6af9b33f0c464683e40adc28037bc8 (table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec]). Expected version 1 got 0
W20260927 13:49:54.044073 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76a397300cdd44eb899f2ef5b9fe8c09 consensus state has no leader
I20260927 13:49:54.044474 4925 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet d2d3db6b1c6c4738b316e69d70a396b7
W20260927 13:49:54.049927 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16743b4513fa4987aee48f03e28cd498 has no consensus state
I20260927 13:49:54.053122 5070 tablet_service.cc:1511] Processing CreateTablet for tablet 1436bcea966646969789e6e09f91c557 (DEFAULT_TABLE table=default.Table_0fcacd34a360441db89b05359f9c8c21 [id=bc5f4effd6604f7aba8706b9bb04bda4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.058841 6181 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.163.84:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.125:42239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.163.125
--webserver_port=43209
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 27 Sep 2026 13:43:25 UTC on bdcb31816ec0
build id 14025
ASAN enabled
I20260927 13:49:54.061812 6181 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 13:49:54.064766 6181 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260927 13:49:54.065129 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1436bcea966646969789e6e09f91c557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.065549 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4494b7e895454f81fef308950729ef (DEFAULT_TABLE table=default.Table_1644e061770e4453a64e74d48c0cd703 [id=ee0789e9d1f34c3791d35794473e2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.066023 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4494b7e895454f81fef308950729ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.072697 5228 tablet_service.cc:1511] Processing CreateTablet for tablet 01b549d0d21d421cba1c830d8e0bd04d (DEFAULT_TABLE table=default.Table_cb043d4ac1634ad497377f4eda030a17 [id=018ce9cba14c46bd8c25ca99237d7335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.072957 5229 tablet_service.cc:1511] Processing CreateTablet for tablet eef853d6e6ce4848927c9de884d39ac2 (DEFAULT_TABLE table=default.Table_9db5a06b3541451089e3b03a35674a16 [id=ec046cb1c7db4739bf79469063f2f287]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.073246 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 45096e907a9c44b7ace81357cdd575d4 (DEFAULT_TABLE table=default.Table_3b716a51ffbe4613a958b62eef4cdcb6 [id=f4ff4dd6b47a4ce9a42f7b13a6a1ce34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.073973 5214 tablet_service.cc:1511] Processing CreateTablet for tablet d3b38f40431f47a0acf1e11092d7717b (DEFAULT_TABLE table=default.Table_f0c950212bbf448eb0f057c01e482ecf [id=5710bb079d1b4ae69be09bac66ca9dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.075089 5619 tablet_bootstrap.cc:654] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.076623 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (DEFAULT_TABLE table=default.Table_54a5f652ce3b4855b55545b034f1e17d [id=d10b0e841c1a4216bb5520929ee59e62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.081337 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9d09ca7952499ba135e15cecb1143e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:54.081452 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 01b549d0d21d421cba1c830d8e0bd04d (DEFAULT_TABLE table=default.Table_cb043d4ac1634ad497377f4eda030a17 [id=018ce9cba14c46bd8c25ca99237d7335]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:54.081947 4914 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_2ed78e0a13974e79ae31fbb791c5ba85 [id=df932e674be6487993e23fe38f4f8e20], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e917382b6f3d4e009fa159ed38c342d8 consensus state has no leader
W20260927 13:49:54.082937 5045 leader_election.cc:343] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:54.083052 5045 leader_election.cc:304] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:54.083992 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 36314f4c93434b1f8d462aa9d838da78 (DEFAULT_TABLE table=default.Table_2e4f0715e1e94f4ca85d9f6c4fbbbc76 [id=750521adcb384c75841d7e1ff89af83d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.086397 6204 raft_consensus.cc:493] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:54.087132 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet b3a305ad4c704bbd8d522515786100c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:54.087718 5212 tablet_service.cc:1511] Processing CreateTablet for tablet fcf4c143d5824458be4a42945c338dc9 (DEFAULT_TABLE table=default.Table_5f2f268fd879476db40bf7a96885d2a5 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.087615 5626 consensus_queue.cc:260] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:54.088454 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b549d0d21d421cba1c830d8e0bd04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.088415 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet b3a305ad4c704bbd8d522515786100c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:54.089313 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b38f40431f47a0acf1e11092d7717b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.089349 5083 tablet_service.cc:1511] Processing CreateTablet for tablet fbde77915c7d4665965bef2298c3491f (DEFAULT_TABLE table=default.Table_694d68f5161840289b065bce1d592d4d [id=b7f691a3fc3d43ca8a3194a1b4174732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.091511 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef853d6e6ce4848927c9de884d39ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.094275 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2ee02044b64e3eaff8136ac43f02e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.094192 5221 tablet_service.cc:1511] Processing CreateTablet for tablet fbde77915c7d4665965bef2298c3491f (DEFAULT_TABLE table=default.Table_694d68f5161840289b065bce1d592d4d [id=b7f691a3fc3d43ca8a3194a1b4174732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.087661 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4494b7e895454f81fef308950729ef (DEFAULT_TABLE table=default.Table_1644e061770e4453a64e74d48c0cd703 [id=ee0789e9d1f34c3791d35794473e2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.096251 5087 tablet_service.cc:1511] Processing CreateTablet for tablet fcf4c143d5824458be4a42945c338dc9 (DEFAULT_TABLE table=default.Table_5f2f268fd879476db40bf7a96885d2a5 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.096597 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b549d0d21d421cba1c830d8e0bd04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.099619 6231 raft_consensus.cc:2749] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:54.100427 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef853d6e6ce4848927c9de884d39ac2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:54.100852 5628 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.535s user 0.068s sys 0.101s
W20260927 13:49:54.100936 5628 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.535s user 0.068s sys 0.101s
I20260927 13:49:54.100981 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet a6af740383384609a354d7f0fae2cd70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.101497 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_22d5c80b2b5b4ee09361300740be2ab2" } new_table_name: "default.Table_1aa6327eb83449ce98d3c403af7ba028" modify_external_catalogs: true
I20260927 13:49:54.103384 5606 tablet_replica.cc:333] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:54.103720 5606 raft_consensus.cc:2243] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:54.103943 5606 raft_consensus.cc:2272] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:54.104837 5606 ts_tablet_manager.cc:1916] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:54.106349 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_1b68a2cb5f1745e3833886667aa5314a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:54.106738 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e6d47becef9f4cfd8311c129ebee35bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.107163 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b68a2cb5f1745e3833886667aa5314a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:54.107290 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6d47becef9f4cfd8311c129ebee35bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.108593 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69606adaa96d431791ed5c8455a7c548. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:54.112249 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46537e1b33f24d50b705d53f6978da3c consensus state has no leader
I20260927 13:49:54.112314 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 45096e907a9c44b7ace81357cdd575d4 (DEFAULT_TABLE table=default.Table_3b716a51ffbe4613a958b62eef4cdcb6 [id=f4ff4dd6b47a4ce9a42f7b13a6a1ce34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.114351 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_56b64738ce624ac98e0b4a4b327ab204" } new_table_name: "default.Table_927f4195b251436bbe7ecee8e22ac35b" modify_external_catalogs: true
I20260927 13:49:54.114881 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8a05998b42404d7aa570c504e6973e38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.115538 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a05998b42404d7aa570c504e6973e38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.115856 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_b81799f423864c5faf4b54c86e95aebc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.116410 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b81799f423864c5faf4b54c86e95aebc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.115984 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 9fdef4f56d9647118afe83ac3cd364fd (DEFAULT_TABLE table=default.Table_a09e5155fa1148ef88003c6c1afedce5 [id=c073a79da0b440698186e6856c8c8c68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.117645 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_26e3d3422d594674a8d1c56b2e6e73ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.118161 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26e3d3422d594674a8d1c56b2e6e73ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.118417 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a73d47bff4246965be82eb482f7aa" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:54.123891 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2c133084fc48484bbe4dd43a4ee2eb1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.124492 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c133084fc48484bbe4dd43a4ee2eb1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.132851 5623 tablet_replica.cc:333] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:54.133986 5628 tablet_bootstrap.cc:492] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:54.134415 5628 ts_tablet_manager.cc:1403] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.571s user 0.070s sys 0.101s
I20260927 13:49:54.138221 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_985a589956d74837978aa757b2b52b61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:54.138810 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1331333f8b0a40f9961974e3407260ca" } modify_external_catalogs: true
W20260927 13:49:54.138937 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_985a589956d74837978aa757b2b52b61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.139052 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1331333f8b0a40f9961974e3407260ca" } modify_external_catalogs: true
I20260927 13:49:54.141197 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d044230007bf424db5c05f31870c84d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.141745 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d044230007bf424db5c05f31870c84d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:54.145593 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4709e969569b43a7aace8d7cfe4e64c5 consensus state has no leader
I20260927 13:49:54.040875 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d9ff32095a554784b91e74012ad8e020 (table default.Table_7567474623ce4d588bb654dc21623cb6 [id=112cd821498b427fb3b0d517cd0d55f3]). Expected version 1 got 0
I20260927 13:49:54.147059 5626 ts_tablet_manager.cc:1434] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.071s user 0.003s sys 0.000s
I20260927 13:49:54.147162 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf4c143d5824458be4a42945c338dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.147498 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 9fdef4f56d9647118afe83ac3cd364fd (DEFAULT_TABLE table=default.Table_a09e5155fa1148ef88003c6c1afedce5 [id=c073a79da0b440698186e6856c8c8c68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.147794 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 1436bcea966646969789e6e09f91c557 (DEFAULT_TABLE table=default.Table_0fcacd34a360441db89b05359f9c8c21 [id=bc5f4effd6604f7aba8706b9bb04bda4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.148013 6204 raft_consensus.cc:515] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:54.148834 6204 leader_election.cc:290] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:54.150381 5219 tablet_service.cc:1511] Processing CreateTablet for tablet b0d6a3af321049b099e72dbfeb6b7a24 (DEFAULT_TABLE table=default.Table_ba83ebe4eac44519a9ebd65f9a503c58 [id=cc2470fce6b24aa786a91531357eecba]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:54.151384 5184 leader_election.cc:343] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: c989f70385f64593a46f633c98267627
I20260927 13:49:54.153313 5078 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (DEFAULT_TABLE table=default.Table_54a5f652ce3b4855b55545b034f1e17d [id=d10b0e841c1a4216bb5520929ee59e62]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:54.154628 5185 leader_election.cc:343] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:54.155040 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fdef4f56d9647118afe83ac3cd364fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.155279 5623 raft_consensus.cc:2243] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:54.155542 5623 pending_rounds.cc:70] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:54.155319 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1436bcea966646969789e6e09f91c557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.158571 5623 pending_rounds.cc:77] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957606712356864 op_type: NO_OP noop_request { }
I20260927 13:49:54.158707 5623 raft_consensus.cc:2889] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:54.157847 5079 tablet_service.cc:1511] Processing CreateTablet for tablet d3b38f40431f47a0acf1e11092d7717b (DEFAULT_TABLE table=default.Table_f0c950212bbf448eb0f057c01e482ecf [id=5710bb079d1b4ae69be09bac66ca9dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.160357 5623 raft_consensus.cc:2272] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:54.161774 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 36314f4c93434b1f8d462aa9d838da78 (DEFAULT_TABLE table=default.Table_2e4f0715e1e94f4ca85d9f6c4fbbbc76 [id=750521adcb384c75841d7e1ff89af83d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.160566 5185 leader_election.cc:304] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:54.163070 5623 ts_tablet_manager.cc:1916] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:54.163208 5185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 43917.4us
I20260927 13:49:54.163278 6204 raft_consensus.cc:2749] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:54.163498 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45096e907a9c44b7ace81357cdd575d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.163586 5626 tablet_bootstrap.cc:492] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:54.163892 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbde77915c7d4665965bef2298c3491f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.165550 5626 tablet_bootstrap.cc:654] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.166299 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4494b7e895454f81fef308950729ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.166879 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36314f4c93434b1f8d462aa9d838da78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.168006 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2ee02044b64e3eaff8136ac43f02e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.171283 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5efb83240eb54eef90123c741672b105"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.172580 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5efb83240eb54eef90123c741672b105 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.182140 5628 raft_consensus.cc:359] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.182505 5628 raft_consensus.cc:385] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.182688 5628 raft_consensus.cc:740] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.183152 5628 consensus_queue.cc:260] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.189344 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf4c143d5824458be4a42945c338dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.192233 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2e56407bf2244b24860c913e16e71016" } modify_external_catalogs: true
I20260927 13:49:54.192492 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2e56407bf2244b24860c913e16e71016" } modify_external_catalogs: true
I20260927 13:49:54.192605 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e11854abc7164d67b4195185f22c8295" } modify_external_catalogs: true
I20260927 13:49:54.192859 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e11854abc7164d67b4195185f22c8295" } modify_external_catalogs: true
I20260927 13:49:54.194093 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d6a3af321049b099e72dbfeb6b7a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.195817 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbde77915c7d4665965bef2298c3491f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.196707 5625 ts_tablet_manager.cc:1929] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:54.196807 5625 log.cc:1199] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/ec40378eb80c412198d5b66c02e975ef
I20260927 13:49:54.197093 5625 ts_tablet_manager.cc:1950] T ec40378eb80c412198d5b66c02e975ef P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:49:54.197933 6363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:54.198647 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 5978cb78bd974d669817def05007d0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:54.201005 6366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:54.203122 5628 ts_tablet_manager.cc:1434] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.069s user 0.003s sys 0.000s
I20260927 13:49:54.203305 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.203423 5628 tablet_bootstrap.cc:492] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:54.204932 5628 tablet_bootstrap.cc:654] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.205801 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_62a5e0b541594ef595869627c9b0b6b7" } modify_external_catalogs: true
I20260927 13:49:54.206085 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_62a5e0b541594ef595869627c9b0b6b7" } modify_external_catalogs: true
I20260927 13:49:54.217682 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5f2f268fd879476db40bf7a96885d2a5" } new_table_name: "default.Table_aab39d4f760b4c78a982e2a5ecdc87d2" modify_external_catalogs: true
I20260927 13:49:54.217923 5077 tablet_service.cc:1511] Processing CreateTablet for tablet b0d6a3af321049b099e72dbfeb6b7a24 (DEFAULT_TABLE table=default.Table_ba83ebe4eac44519a9ebd65f9a503c58 [id=cc2470fce6b24aa786a91531357eecba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.218374 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d6a3af321049b099e72dbfeb6b7a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.218412 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c989f70385f64593a46f633c98267627" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:54.221424 4924 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet f3e6e4b6fb5a49e687f7ca6707471ad3
I20260927 13:49:54.221618 5625 tablet_replica.cc:333] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:54.221654 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaffd54534442e1aa6db158d313fab3 (DEFAULT_TABLE table=default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.223942 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4494b7e895454f81fef308950729ef (DEFAULT_TABLE table=default.Table_1644e061770e4453a64e74d48c0cd703 [id=ee0789e9d1f34c3791d35794473e2246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.224546 5348 tablet_service.cc:1511] Processing CreateTablet for tablet fbde77915c7d4665965bef2298c3491f (DEFAULT_TABLE table=default.Table_694d68f5161840289b065bce1d592d4d [id=b7f691a3fc3d43ca8a3194a1b4174732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.225010 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 36314f4c93434b1f8d462aa9d838da78 (DEFAULT_TABLE table=default.Table_2e4f0715e1e94f4ca85d9f6c4fbbbc76 [id=750521adcb384c75841d7e1ff89af83d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.225103 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 9fdef4f56d9647118afe83ac3cd364fd (DEFAULT_TABLE table=default.Table_a09e5155fa1148ef88003c6c1afedce5 [id=c073a79da0b440698186e6856c8c8c68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.225492 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 01b549d0d21d421cba1c830d8e0bd04d (DEFAULT_TABLE table=default.Table_cb043d4ac1634ad497377f4eda030a17 [id=018ce9cba14c46bd8c25ca99237d7335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.225828 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 1436bcea966646969789e6e09f91c557 (DEFAULT_TABLE table=default.Table_0fcacd34a360441db89b05359f9c8c21 [id=bc5f4effd6604f7aba8706b9bb04bda4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.226863 6145 raft_consensus.cc:493] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:54.229274 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet b3a305ad4c704bbd8d522515786100c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.230062 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaffd54534442e1aa6db158d313fab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.231848 5347 tablet_service.cc:1511] Processing CreateTablet for tablet 5978cb78bd974d669817def05007d0ea (DEFAULT_TABLE table=default.Table_cb2cdf43d4eb4fc1b302363907f746a2 [id=a2e5f425d1494b40a9b253e6b2d4c86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.232251 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 45096e907a9c44b7ace81357cdd575d4 (DEFAULT_TABLE table=default.Table_3b716a51ffbe4613a958b62eef4cdcb6 [id=f4ff4dd6b47a4ce9a42f7b13a6a1ce34]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:54.233538 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fcf4c143d5824458be4a42945c338dc9 consensus state has no leader
I20260927 13:49:54.236545 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet ec40378eb80c412198d5b66c02e975ef (table default.Table_c6bf40a827d4408d9436b87449f15866 [id=27609594a3c74bf895858e5dc48a543e]) successfully deleted
I20260927 13:49:54.236963 5606 ts_tablet_manager.cc:1929] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:49:54.237046 5185 leader_election.cc:343] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:54.237258 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet 1efaf62692c545dcaa5175fcd826785a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:54.237639 5362 tablet_service.cc:1511] Processing CreateTablet for tablet d3b38f40431f47a0acf1e11092d7717b (DEFAULT_TABLE table=default.Table_f0c950212bbf448eb0f057c01e482ecf [id=5710bb079d1b4ae69be09bac66ca9dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.239441 5349 tablet_service.cc:1511] Processing CreateTablet for tablet fcf4c143d5824458be4a42945c338dc9 (DEFAULT_TABLE table=default.Table_5f2f268fd879476db40bf7a96885d2a5 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.240068 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (DEFAULT_TABLE table=default.Table_54a5f652ce3b4855b55545b034f1e17d [id=d10b0e841c1a4216bb5520929ee59e62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.240909 5185 leader_election.cc:304] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:54.241014 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_576d9422be234e3ab93aba4b5f662369"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:54.241622 6204 raft_consensus.cc:2749] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:54.241690 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_576d9422be234e3ab93aba4b5f662369 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.240093 6361 tablet.cc:1751] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:54.244016 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45096e907a9c44b7ace81357cdd575d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.246811 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_16dc00b04267495ea0bf7b352b433889" } modify_external_catalogs: true
I20260927 13:49:54.247032 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_16dc00b04267495ea0bf7b352b433889" } modify_external_catalogs: true
I20260927 13:49:54.248461 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2e63e80572a047aabb5d20f0417a30cd" } new_table_name: "default.Table_05c30257326a4d0d91afbf8182d33a3d" modify_external_catalogs: true
I20260927 13:49:54.250846 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbde77915c7d4665965bef2298c3491f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.251085 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2ee02044b64e3eaff8136ac43f02e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.251634 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c0f38fe9743e42a2a400176803567039" } new_table_name: "default.Table_a8cb85c2ad064149be57407ba25423d6" modify_external_catalogs: true
I20260927 13:49:54.252274 5606 log.cc:1199] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/a6af740383384609a354d7f0fae2cd70
I20260927 13:49:54.252712 5606 ts_tablet_manager.cc:1950] T a6af740383384609a354d7f0fae2cd70 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:54.254542 5358 tablet_service.cc:1511] Processing CreateTablet for tablet b0d6a3af321049b099e72dbfeb6b7a24 (DEFAULT_TABLE table=default.Table_ba83ebe4eac44519a9ebd65f9a503c58 [id=cc2470fce6b24aa786a91531357eecba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.256299 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet a6af740383384609a354d7f0fae2cd70 (table default.Table_de419f4cfd244caeaa7707f22194c5bd [id=1cceb2a28eac4398a1e8d1ddb8afd21b]) successfully deleted
W20260927 13:49:54.256600 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 5978cb78bd974d669817def05007d0ea because the tablet was not found. No further retry: Not found: Tablet not found: 5978cb78bd974d669817def05007d0ea
W20260927 13:49:54.256866 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2657276c4b2f43c1ad64a8c1fd58ada9 already in progress: creating tablet
I20260927 13:49:54.258565 5606 tablet_replica.cc:333] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:54.259107 5606 raft_consensus.cc:2243] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:54.259720 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45096e907a9c44b7ace81357cdd575d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.261694 5606 raft_consensus.cc:2272] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:54.262603 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4494b7e895454f81fef308950729ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.254876 6145 raft_consensus.cc:515] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:54.263051 5606 ts_tablet_manager.cc:1916] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:54.263242 6145 leader_election.cc:290] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:54.261045 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b38f40431f47a0acf1e11092d7717b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.264493 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d35148d80b44fca9b39a4625d3e61c1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
W20260927 13:49:54.265316 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 58acd8932a2647a0a20679614cc2b68a consensus state has no leader
I20260927 13:49:54.266696 5619 tablet_bootstrap.cc:492] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
W20260927 13:49:54.259595 5044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 170671us
I20260927 13:49:54.267180 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36314f4c93434b1f8d462aa9d838da78. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:54.268002 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5e8ae1a0ce2496cb2eed2066eb37a13 consensus state has no leader
I20260927 13:49:54.271889 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d35148d80b44fca9b39a4625d3e61c1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:54.272193 5249 raft_consensus.cc:2393] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:49:54.272811 5619 ts_tablet_manager.cc:1403] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.340s user 0.018s sys 0.030s
I20260927 13:49:54.272847 5319 leader_election.cc:304] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:54.274745 6145 raft_consensus.cc:3060] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:54.274804 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b549d0d21d421cba1c830d8e0bd04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.275112 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fdef4f56d9647118afe83ac3cd364fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.275374 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b38f40431f47a0acf1e11092d7717b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.278627 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fdef4f56d9647118afe83ac3cd364fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.281569 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1436bcea966646969789e6e09f91c557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.292037 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf4c143d5824458be4a42945c338dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.292593 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5978cb78bd974d669817def05007d0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.298636 6181 server_base.cc:1061] running on GCE node
I20260927 13:49:54.304340 5619 raft_consensus.cc:359] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:54.304673 5619 raft_consensus.cc:385] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.305341 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d6a3af321049b099e72dbfeb6b7a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.316349 5628 tablet_bootstrap.cc:492] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:54.316799 5619 raft_consensus.cc:740] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.316515 5628 ts_tablet_manager.cc:1403] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.113s user 0.003s sys 0.000s
I20260927 13:49:54.318573 6231 consensus_queue.cc:1048] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:54.318578 5619 consensus_queue.cc:260] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:54.318569 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2ed78e0a13974e79ae31fbb791c5ba85" } new_table_name: "default.Table_41087e1344494cfb90a27ac4b8478899" modify_external_catalogs: true
I20260927 13:49:54.319882 5628 raft_consensus.cc:359] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.320032 5628 raft_consensus.cc:385] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.320091 5628 raft_consensus.cc:740] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.320327 5628 consensus_queue.cc:260] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.320763 5628 ts_tablet_manager.cc:1434] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:54.321079 5628 tablet_bootstrap.cc:492] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:49:54.335671 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e917382b6f3d4e009fa159ed38c342d8 consensus state has no leader
I20260927 13:49:54.336141 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a635daf12a4a42d5b5ba20c5eb11daa5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:54.336218 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_01a57ba463c7433db27102851328ade7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.336733 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01a57ba463c7433db27102851328ade7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:54.336881 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a635daf12a4a42d5b5ba20c5eb11daa5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.338248 6357 tablet.cc:1751] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:54.340754 5626 tablet_bootstrap.cc:492] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:54.340916 5626 ts_tablet_manager.cc:1403] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.191s user 0.017s sys 0.025s
I20260927 13:49:54.348073 5626 raft_consensus.cc:359] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.348304 5626 raft_consensus.cc:385] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.349373 5626 raft_consensus.cc:740] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.349715 5626 consensus_queue.cc:260] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.362761 5626 ts_tablet_manager.cc:1434] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.021s user 0.002s sys 0.001s
I20260927 13:49:54.369532 6231 consensus_queue.cc:1048] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:54.372558 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_01b5b7db6ed64c46907e0527b4ccede2" } new_table_name: "default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f" modify_external_catalogs: true
I20260927 13:49:54.374541 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_42796c54044b413f89d5ebc6ec7a1c42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.375118 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42796c54044b413f89d5ebc6ec7a1c42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.375290 6375 tablet.cc:1751] T e9b73420c2074d10ab2e78c6f15df93c P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:54.382035 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36314f4c93434b1f8d462aa9d838da78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.382864 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_768760c930ff4aedaa8ecd14252d08f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:54.382822 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f01116bdf8b644238db27fc1b3ae9fc6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.383399 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_768760c930ff4aedaa8ecd14252d08f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:54.383424 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f01116bdf8b644238db27fc1b3ae9fc6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:54.395327 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1a98e712fb3492f9e4ebccfd489c16f consensus state has no leader
I20260927 13:49:54.395860 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_75865dd4349e418896b4469e10a62252"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.396615 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75865dd4349e418896b4469e10a62252 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.399920 5628 tablet_bootstrap.cc:654] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.408670 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_dc256a28952e4b6281f7a89706991293"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.409407 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc256a28952e4b6281f7a89706991293 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.413679 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_1849c92f300e4d10a9e9db98ec234955"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.414222 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1849c92f300e4d10a9e9db98ec234955 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.420171 6361 tablet.cc:1751] T e9b73420c2074d10ab2e78c6f15df93c P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260927 13:49:54.423592 6370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:49:54.424094 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_60e4fad358b94bf5a7dcf5632fabd19d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.424826 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60e4fad358b94bf5a7dcf5632fabd19d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.424830 6181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 13:49:54.426271 5625 raft_consensus.cc:2243] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:54.426466 5625 raft_consensus.cc:2272] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:54.427031 5625 ts_tablet_manager.cc:1916] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:54.438458 6181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 13:49:54.457394 5625 ts_tablet_manager.cc:1929] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:54.457608 5625 log.cc:1199] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/fa9d09ca7952499ba135e15cecb1143e
I20260927 13:49:54.458007 5625 ts_tablet_manager.cc:1950] T fa9d09ca7952499ba135e15cecb1143e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:54.458217 6181 hybrid_clock.cc:648] HybridClock initialized: now 1790516994458096 us; error 101 us; skew 500 ppm
I20260927 13:49:54.458850 6145 raft_consensus.cc:2749] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:54.459064 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet 98ffe83306e74749b5b3f68e6c2c708c from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:54.459453 6181 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 13:49:54.460135 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_aab39d4f760b4c78a982e2a5ecdc87d2" } new_table_name: "default.Table_e785f86cd0ec4345a80293a7f680d655" modify_external_catalogs: true
I20260927 13:49:54.462082 5628 tablet_bootstrap.cc:492] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:54.462136 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2f83c545334d4bc995f6afb456fb190b" } modify_external_catalogs: true
I20260927 13:49:54.462242 5628 ts_tablet_manager.cc:1403] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.141s user 0.005s sys 0.006s
I20260927 13:49:54.462383 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2f83c545334d4bc995f6afb456fb190b" } modify_external_catalogs: true
W20260927 13:49:54.468477 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fcf4c143d5824458be4a42945c338dc9 consensus state has no leader
I20260927 13:49:54.468966 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3242a0694fbc44279128e33f2c62d622"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:54.471158 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c92956a2abc24a8cb7a86ecae94d3e99" } new_table_name: "default.Table_996a1ca374d349c59a00107c906d5175" modify_external_catalogs: true
I20260927 13:49:54.474432 5628 raft_consensus.cc:359] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.474618 5628 raft_consensus.cc:385] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.474673 5628 raft_consensus.cc:740] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.474874 5628 consensus_queue.cc:260] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.475374 5628 ts_tablet_manager.cc:1434] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260927 13:49:54.479547 5625 tablet_replica.cc:333] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:54.479750 5625 raft_consensus.cc:2243] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:54.479899 5625 raft_consensus.cc:2272] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:54.480450 5625 ts_tablet_manager.cc:1916] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:54.478705 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet fa9d09ca7952499ba135e15cecb1143e (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]) successfully deleted
W20260927 13:49:54.482173 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet d3149f6bbaf043f08970e19fd66c4e2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3149f6bbaf043f08970e19fd66c4e2a already in progress: creating tablet
W20260927 13:49:54.482455 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 334b0349bfaa4a9c8b7d280177f1ecae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 334b0349bfaa4a9c8b7d280177f1ecae already in progress: creating tablet
W20260927 13:49:54.482688 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b57886cc11a2423983c2b7bac79150a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b57886cc11a2423983c2b7bac79150a0 already in progress: creating tablet
W20260927 13:49:54.482906 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 0880140d99004eb1803d6b5dcf41af13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0880140d99004eb1803d6b5dcf41af13 already in progress: creating tablet
W20260927 13:49:54.483120 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 5978cb78bd974d669817def05007d0ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5978cb78bd974d669817def05007d0ea already in progress: creating tablet
W20260927 13:49:54.483333 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2657276c4b2f43c1ad64a8c1fd58ada9 already in progress: creating tablet
I20260927 13:49:54.486402 5628 tablet_bootstrap.cc:492] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:49:54.488869 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3242a0694fbc44279128e33f2c62d622 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.497689 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_273d137820cd406fb25a9d5d6f1a53bc" } new_table_name: "default.Table_d0a9564fe50b4e92800203352ad52f81" modify_external_catalogs: true
I20260927 13:49:54.511500 4924 catalog_manager.cc:5838] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:54.512015 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 74226753751a49fa8ce98eafb2ca1250 (table default.Table_000065d7fd1245df945d5c14cf4b881b [id=8c41592b4b4c4d4b9286336ed3c77b4b]). Expected version 2 got 0
I20260927 13:49:54.513455 6365 raft_consensus.cc:493] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:54.513612 6365 raft_consensus.cc:515] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.514474 6365 leader_election.cc:290] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:54.520141 5628 tablet_bootstrap.cc:654] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.524767 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 794da0992403462dbbce644134b8aab3
I20260927 13:49:54.526582 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 8aeb0c2c2be04a598e011a9d99c5492a
I20260927 13:49:54.526985 5619 ts_tablet_manager.cc:1434] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.254s user 0.007s sys 0.021s
I20260927 13:49:54.527319 5619 tablet_bootstrap.cc:492] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:54.527334 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet bb7b3a35b2e94bbea6be4b4a8f158593
I20260927 13:49:54.528092 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 50bc839e0fc54839a5d06c176760f618
I20260927 13:49:54.528855 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 98ffe83306e74749b5b3f68e6c2c708c
I20260927 13:49:54.529239 4923 catalog_manager.cc:6934] ReplaceTablet: tablet 98ffe83306e74749b5b3f68e6c2c708c deleted and replaced by tablet 98b434884a3f4c63a9ba341e53703023
I20260927 13:49:54.531635 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 794da0992403462dbbce644134b8aab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:54.531840 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 8aeb0c2c2be04a598e011a9d99c5492a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:54.532150 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet bb7b3a35b2e94bbea6be4b4a8f158593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:54.532591 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bc839e0fc54839a5d06c176760f618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:54.532812 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ffe83306e74749b5b3f68e6c2c708c with delete_type TABLET_DATA_DELETED (replaced by tablet 98b434884a3f4c63a9ba341e53703023) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:54.533349 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet bf557ac29964453583f224b46178c7dd
I20260927 13:49:54.534471 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet bf557ac29964453583f224b46178c7dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:54.537070 5628 tablet_bootstrap.cc:492] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:54.537277 5628 ts_tablet_manager.cc:1403] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.000s
I20260927 13:49:54.538352 5628 raft_consensus.cc:359] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.538626 5628 raft_consensus.cc:385] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.538632 5606 ts_tablet_manager.cc:1929] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:54.538736 5606 log.cc:1199] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b3a305ad4c704bbd8d522515786100c0
I20260927 13:49:54.538762 5628 raft_consensus.cc:740] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.539175 5606 ts_tablet_manager.cc:1950] T b3a305ad4c704bbd8d522515786100c0 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:54.539171 5628 consensus_queue.cc:260] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:54.539639 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ef5969312044a2bab451841ec65aa84 consensus state has no leader
I20260927 13:49:54.540019 5628 ts_tablet_manager.cc:1434] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:54.540647 5628 tablet_bootstrap.cc:492] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:54.543267 5628 tablet_bootstrap.cc:654] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.553471 5346 tablet_service.cc:1511] Processing CreateTablet for tablet b9a1193719e140beb9b492927adeb78c (DEFAULT_TABLE table=default.Table_789c5549472f4bf8ab1581eb3903953a [id=1af7add99a3441a5888daac021a65214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.553887 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a1193719e140beb9b492927adeb78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.555006 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e112118f207548cc8f013a913a1ac42c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.555564 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e112118f207548cc8f013a913a1ac42c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.544736 5080 tablet_service.cc:1511] Processing CreateTablet for tablet b9a1193719e140beb9b492927adeb78c (DEFAULT_TABLE table=default.Table_789c5549472f4bf8ab1581eb3903953a [id=1af7add99a3441a5888daac021a65214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.557559 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a1193719e140beb9b492927adeb78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.559031 5348 tablet_service.cc:1511] Processing CreateTablet for tablet 73546fba4ac846efbe9a9f4e346e4c21 (DEFAULT_TABLE table=default.Table_81665809269849e98e48061e93daa488 [id=85aa49fa034e41f2bd95fd13dee47b9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.559512 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73546fba4ac846efbe9a9f4e346e4c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.561827 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b3a305ad4c704bbd8d522515786100c0 (table default.Table_25e6e013310e4ba18a969df5b8ae3901 [id=33df36c4049b4b0a97fc6541b66a362b]) successfully deleted
I20260927 13:49:54.547571 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 284f6113fa4b443a869bce6d0c15f273 (DEFAULT_TABLE table=default.Table_ccb6887bdbc847159519b36b4f89b414 [id=a926601129a34cc893754ccd04cd3d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.562413 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 284f6113fa4b443a869bce6d0c15f273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.562580 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bc839e0fc54839a5d06c176760f618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.562564 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8afed1bb46964731b195130b04104855" } new_table_name: "default.Table_d7e2b621de8d45e69f6e88b3e51354d5" modify_external_catalogs: true
I20260927 13:49:54.547986 5075 tablet_service.cc:1511] Processing CreateTablet for tablet d23d0d77dfb548c0b77295f185894c7c (DEFAULT_TABLE table=default.Table_23ae01b278734a1e94187c6846ce8f26 [id=e802f65837444329b9932f23eba2db40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.566201 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ffe83306e74749b5b3f68e6c2c708c with delete_type TABLET_DATA_DELETED (replaced by tablet 98b434884a3f4c63a9ba341e53703023) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.566380 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23d0d77dfb548c0b77295f185894c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.566459 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 8aeb0c2c2be04a598e011a9d99c5492a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.566844 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 284f6113fa4b443a869bce6d0c15f273 (DEFAULT_TABLE table=default.Table_ccb6887bdbc847159519b36b4f89b414 [id=a926601129a34cc893754ccd04cd3d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.567195 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 284f6113fa4b443a869bce6d0c15f273. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:54.567272 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20766b5a757e4a7e954c198f8c9ca41f consensus state has no leader
W20260927 13:49:54.568322 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 50fb1288684c45f6a778d809a5e2c160 consensus state has no leader
I20260927 13:49:54.569041 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet bf557ac29964453583f224b46178c7dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.569370 5349 tablet_service.cc:1511] Processing CreateTablet for tablet d23d0d77dfb548c0b77295f185894c7c (DEFAULT_TABLE table=default.Table_23ae01b278734a1e94187c6846ce8f26 [id=e802f65837444329b9932f23eba2db40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.569738 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23d0d77dfb548c0b77295f185894c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.570191 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet bb7b3a35b2e94bbea6be4b4a8f158593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.570389 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 794da0992403462dbbce644134b8aab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.557178 5625 ts_tablet_manager.cc:1929] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:54.577931 5625 log.cc:1199] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b3a305ad4c704bbd8d522515786100c0
I20260927 13:49:54.578397 5625 ts_tablet_manager.cc:1950] T b3a305ad4c704bbd8d522515786100c0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:54.578991 5626 tablet_bootstrap.cc:492] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:54.579226 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b3a305ad4c704bbd8d522515786100c0 (table default.Table_25e6e013310e4ba18a969df5b8ae3901 [id=33df36c4049b4b0a97fc6541b66a362b]) successfully deleted
I20260927 13:49:54.581786 5628 tablet_bootstrap.cc:492] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:54.584159 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet 76add3b9ef254ece958121a336e87936 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:54.585471 5628 ts_tablet_manager.cc:1403] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260927 13:49:54.586328 5628 raft_consensus.cc:359] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.586529 5628 raft_consensus.cc:385] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.586588 5628 raft_consensus.cc:740] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.582096 5625 tablet_replica.cc:333] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:54.586982 5625 raft_consensus.cc:2243] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:54.587133 5625 raft_consensus.cc:2272] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:54.589501 5625 ts_tablet_manager.cc:1916] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:54.592322 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 76add3b9ef254ece958121a336e87936
I20260927 13:49:54.592878 4930 catalog_manager.cc:6934] ReplaceTablet: tablet 76add3b9ef254ece958121a336e87936 deleted and replaced by tablet 077d2f5c216e46bf8aaa947e83a61708
I20260927 13:49:54.593328 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 76add3b9ef254ece958121a336e87936 with delete_type TABLET_DATA_DELETED (replaced by tablet 077d2f5c216e46bf8aaa947e83a61708) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:54.593398 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 50bc839e0fc54839a5d06c176760f618 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50bc839e0fc54839a5d06c176760f618 already in progress: creating tablet
W20260927 13:49:54.593791 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 98ffe83306e74749b5b3f68e6c2c708c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98ffe83306e74749b5b3f68e6c2c708c already in progress: creating tablet
W20260927 13:49:54.594067 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 8aeb0c2c2be04a598e011a9d99c5492a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aeb0c2c2be04a598e011a9d99c5492a already in progress: creating tablet
W20260927 13:49:54.594328 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet bf557ac29964453583f224b46178c7dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf557ac29964453583f224b46178c7dd already in progress: creating tablet
W20260927 13:49:54.594554 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet bb7b3a35b2e94bbea6be4b4a8f158593 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb7b3a35b2e94bbea6be4b4a8f158593 already in progress: creating tablet
W20260927 13:49:54.594760 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 794da0992403462dbbce644134b8aab3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 794da0992403462dbbce644134b8aab3 already in progress: creating tablet
I20260927 13:49:54.595539 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a226c3e5ff3042b98cc46517327d4610"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.596318 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a226c3e5ff3042b98cc46517327d4610 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.598618 5628 consensus_queue.cc:260] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.599223 5628 ts_tablet_manager.cc:1434] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260927 13:49:54.601143 5628 tablet_bootstrap.cc:492] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:54.601984 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 76add3b9ef254ece958121a336e87936 with delete_type TABLET_DATA_DELETED (replaced by tablet 077d2f5c216e46bf8aaa947e83a61708) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.602593 5606 tablet_replica.cc:333] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:54.602820 5606 raft_consensus.cc:2243] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:54.603137 5606 raft_consensus.cc:2272] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:54.603749 5606 ts_tablet_manager.cc:1916] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:54.604840 5628 tablet_bootstrap.cc:654] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.614486 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 73546fba4ac846efbe9a9f4e346e4c21 (DEFAULT_TABLE table=default.Table_81665809269849e98e48061e93daa488 [id=85aa49fa034e41f2bd95fd13dee47b9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.615150 5348 tablet_service.cc:1511] Processing CreateTablet for tablet 370553521753488ab81e40144f2536ae (DEFAULT_TABLE table=default.Table_030e35baedc24808830ae3843591a919 [id=2a9ee63f4cb44af7be4d45edf37b9bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.615486 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73546fba4ac846efbe9a9f4e346e4c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.615653 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370553521753488ab81e40144f2536ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.618522 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 370553521753488ab81e40144f2536ae (DEFAULT_TABLE table=default.Table_030e35baedc24808830ae3843591a919 [id=2a9ee63f4cb44af7be4d45edf37b9bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.618866 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370553521753488ab81e40144f2536ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.620103 5619 tablet_bootstrap.cc:654] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.623811 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5dfa3e80454463908df19a49454764 with delete_type TABLET_DATA_DELETED (replaced by tablet a813939920244be781d546311fe8a33e) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:54.626207 6344 raft_consensus.cc:493] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:54.626384 6344 raft_consensus.cc:515] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:54.626808 4930 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_1d4328199b424e52bc4ebaf4f317542a [id=77f96d35f95b45f9972f1e5cf494031f] alter complete (version 1)
I20260927 13:49:54.633469 4930 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_ef6bb2dace3141688f83d3494419f619 [id=09f379b76b2f43c8853cd36c6b52e296] alter complete (version 2)
I20260927 13:49:54.636101 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_22e17296fde940779eb9160306ff386d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.636866 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22e17296fde940779eb9160306ff386d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.637174 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet b5cc71e06eb743d2b63e056e88a6498f with delete_type TABLET_DATA_DELETED (replaced by tablet cbacda63c0d3427aabf3332b278576c5) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:54.638881 5184 leader_election.cc:343] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b5cc71e06eb743d2b63e056e88a6498f
I20260927 13:49:54.641223 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_440adeb28a1147c9ae74c2fb6a476219"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.641822 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_440adeb28a1147c9ae74c2fb6a476219 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.646651 5623 ts_tablet_manager.cc:1929] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:54.646785 5623 log.cc:1199] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b3a305ad4c704bbd8d522515786100c0
I20260927 13:49:54.626085 5625 ts_tablet_manager.cc:1929] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:54.649503 5625 log.cc:1199] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/1efaf62692c545dcaa5175fcd826785a
I20260927 13:49:54.649881 5625 ts_tablet_manager.cc:1950] T 1efaf62692c545dcaa5175fcd826785a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:54.650610 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet c989f70385f64593a46f633c98267627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:54.651150 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 1efaf62692c545dcaa5175fcd826785a (table default.Table_b76c0a83f3804d4fa4fab07460d3b61f [id=27d4534550fd49038bcf9101064bfeb6]) successfully deleted
I20260927 13:49:54.634825 5628 tablet_bootstrap.cc:492] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:54.651669 5628 ts_tablet_manager.cc:1403] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.000s
I20260927 13:49:54.652431 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6f6ffa29cd68453094b577c1001a1298" } new_table_name: "default.Table_34ee215f816d43d0a898670a8a9ed63a" modify_external_catalogs: true
I20260927 13:49:54.652503 5628 raft_consensus.cc:359] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.652688 5628 raft_consensus.cc:385] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.652755 5628 raft_consensus.cc:740] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.652992 5628 consensus_queue.cc:260] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.653491 5628 ts_tablet_manager.cc:1434] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:54.653901 5628 tablet_bootstrap.cc:492] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:54.656029 5628 tablet_bootstrap.cc:654] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.659116 6377 raft_consensus.cc:493] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:54.659261 6377 raft_consensus.cc:515] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.659826 6377 leader_election.cc:290] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:54.660269 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 794da0992403462dbbce644134b8aab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:54.660373 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 794da0992403462dbbce644134b8aab3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 794da0992403462dbbce644134b8aab3 already in progress: creating tablet
W20260927 13:49:54.661880 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 8aeb0c2c2be04a598e011a9d99c5492a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aeb0c2c2be04a598e011a9d99c5492a already in progress: creating tablet
I20260927 13:49:54.662475 6344 leader_election.cc:290] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:54.663200 6372 tablet.cc:1751] T e9b73420c2074d10ab2e78c6f15df93c P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260927 13:49:54.664004 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet bb7b3a35b2e94bbea6be4b4a8f158593 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb7b3a35b2e94bbea6be4b4a8f158593 already in progress: creating tablet
W20260927 13:49:54.664659 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 50bc839e0fc54839a5d06c176760f618 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50bc839e0fc54839a5d06c176760f618 already in progress: creating tablet
I20260927 13:49:54.665139 5625 tablet_replica.cc:333] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:54.665390 5625 raft_consensus.cc:2243] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:54.665552 5625 raft_consensus.cc:2272] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:54.666183 5625 ts_tablet_manager.cc:1916] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:54.667034 6377 raft_consensus.cc:493] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:54.667140 6377 raft_consensus.cc:515] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.667672 6377 leader_election.cc:290] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:54.667877 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet bb7b3a35b2e94bbea6be4b4a8f158593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:54.668133 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 8aeb0c2c2be04a598e011a9d99c5492a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:54.671905 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bc839e0fc54839a5d06c176760f618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:54.672868 4754 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 101272us
W20260927 13:49:54.674168 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4f4bc5cefef448d85ff31b7fafaca74 consensus state has no leader
I20260927 13:49:54.676515 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ffe83306e74749b5b3f68e6c2c708c with delete_type TABLET_DATA_DELETED (replaced by tablet 98b434884a3f4c63a9ba341e53703023) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:54.678702 5628 tablet_bootstrap.cc:492] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:54.678857 5628 ts_tablet_manager.cc:1403] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.003s
I20260927 13:49:54.679701 5628 raft_consensus.cc:359] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.679903 5628 raft_consensus.cc:385] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.679975 5628 raft_consensus.cc:740] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.680207 5628 consensus_queue.cc:260] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.683214 5628 ts_tablet_manager.cc:1434] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:54.683570 5628 tablet_bootstrap.cc:492] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:54.685182 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8f9857e0bcfe4d4c960102ea075e0b18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.686010 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f9857e0bcfe4d4c960102ea075e0b18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.686506 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f2000b1332564779b99fef20acf75a9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.687044 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2000b1332564779b99fef20acf75a9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.687402 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_35a9895ba749499586d31bae3003ffdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:54.687899 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35a9895ba749499586d31bae3003ffdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.689378 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed33e78ee5448bcae633cc874c3e171 (DEFAULT_TABLE table=default.Table_f8cf2e1f9d84401897db63d0a884c6b1 [id=1828e2f519ae4cbc810509b126d740e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.689846 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed33e78ee5448bcae633cc874c3e171. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:54.620270 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 287834us
I20260927 13:49:54.694451 5086 tablet_service.cc:1511] Processing CreateTablet for tablet dd0126a6df14457ca5c62c129f3275f8 (DEFAULT_TABLE table=default.Table_8a9f7c16b9ec4d10848c2bb0c661fe27 [id=0cf3d2b79225499f86d3d78ef105ab4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.694798 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0126a6df14457ca5c62c129f3275f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.696121 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c332b6ec9ca94ce398a71e82e20897d4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:54.696178 6375 tablet.cc:1751] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:54.697032 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e512f6e2722c488da1df36462f461d3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:54.697196 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e0e8d6bc744d69a9f41d45459d3b2b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:54.697527 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e512f6e2722c488da1df36462f461d3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.697628 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f7512333e245c4b35018961a510efd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:54.698555 5045 leader_election.cc:343] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:54.698788 6362 consensus_queue.cc:1048] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:54.685285 5346 tablet_service.cc:1558] Processing DeleteTablet for tablet c989f70385f64593a46f633c98267627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:47 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.698918 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_768760c930ff4aedaa8ecd14252d08f7" } new_table_name: "default.Table_4dba712f260c446c902cd0b9dade8e7f" modify_external_catalogs: true
I20260927 13:49:54.698851 6377 consensus_queue.cc:1048] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:49:54.698808 5045 leader_election.cc:343] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:54.699998 6181 webserver.cc:533] Webserver started at http://127.4.163.125:43209/ using document root <none> and password file <none>
W20260927 13:49:54.700908 5045 leader_election.cc:343] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:54.704157 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed33e78ee5448bcae633cc874c3e171 (DEFAULT_TABLE table=default.Table_f8cf2e1f9d84401897db63d0a884c6b1 [id=1828e2f519ae4cbc810509b126d740e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.704660 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed33e78ee5448bcae633cc874c3e171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.706594 4930 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c2fc2734e88e431facdf72e9ef136106 (table default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e]). Expected version 2 got 0
I20260927 13:49:54.712725 5628 tablet_bootstrap.cc:654] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.712980 6181 fs_manager.cc:362] Metadata directory not provided
I20260927 13:49:54.713132 6181 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 13:49:54.714262 5625 ts_tablet_manager.cc:1929] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:54.714380 5625 log.cc:1199] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/98ffe83306e74749b5b3f68e6c2c708c
I20260927 13:49:54.715024 5606 ts_tablet_manager.cc:1929] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:54.715140 5606 log.cc:1199] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/76add3b9ef254ece958121a336e87936
I20260927 13:49:54.715509 5606 ts_tablet_manager.cc:1950] T 76add3b9ef254ece958121a336e87936 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:54.717295 5625 ts_tablet_manager.cc:1950] T 98ffe83306e74749b5b3f68e6c2c708c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:54.717586 5109 raft_consensus.cc:1275] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Refusing update from remote peer bb28c54312c94d7dafb1c2abf7870735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:54.722280 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet bf557ac29964453583f224b46178c7dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:54.722636 5214 tablet_service.cc:1511] Processing CreateTablet for tablet d23d0d77dfb548c0b77295f185894c7c (DEFAULT_TABLE table=default.Table_23ae01b278734a1e94187c6846ce8f26 [id=e802f65837444329b9932f23eba2db40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.725167 5625 tablet_replica.cc:333] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:54.725443 5625 raft_consensus.cc:2243] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:54.725672 5625 raft_consensus.cc:2272] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:54.726346 5625 ts_tablet_manager.cc:1916] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:54.734272 5224 tablet_service.cc:1511] Processing CreateTablet for tablet b9a1193719e140beb9b492927adeb78c (DEFAULT_TABLE table=default.Table_789c5549472f4bf8ab1581eb3903953a [id=1af7add99a3441a5888daac021a65214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.731537 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 284f6113fa4b443a869bce6d0c15f273 (DEFAULT_TABLE table=default.Table_ccb6887bdbc847159519b36b4f89b414 [id=a926601129a34cc893754ccd04cd3d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.735482 6372 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:39418 (request call id 489) took 1084 ms. Trace:
I20260927 13:49:54.738601 5619 tablet_bootstrap.cc:492] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:54.738866 5619 ts_tablet_manager.cc:1403] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.212s user 0.002s sys 0.003s
I20260927 13:49:54.740739 5626 tablet_bootstrap.cc:654] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.743239 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23d0d77dfb548c0b77295f185894c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.744294 6371 consensus_queue.cc:1048] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:54.747135 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 370553521753488ab81e40144f2536ae (DEFAULT_TABLE table=default.Table_030e35baedc24808830ae3843591a919 [id=2a9ee63f4cb44af7be4d45edf37b9bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.748880 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 76add3b9ef254ece958121a336e87936 with delete_type TABLET_DATA_DELETED (replaced by tablet 077d2f5c216e46bf8aaa947e83a61708) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:54.752638 6371 raft_consensus.cc:493] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:54.752785 6371 raft_consensus.cc:515] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:54.753340 6371 leader_election.cc:290] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:54.754057 5623 ts_tablet_manager.cc:1950] T b3a305ad4c704bbd8d522515786100c0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:54.755232 5623 tablet_replica.cc:333] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:54.756619 5623 raft_consensus.cc:2243] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:54.756826 5623 raft_consensus.cc:2272] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:54.756018 6393 raft_consensus.cc:493] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:54.759801 5625 ts_tablet_manager.cc:1929] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:54.759940 5625 log.cc:1199] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/76add3b9ef254ece958121a336e87936
I20260927 13:49:54.760321 5625 ts_tablet_manager.cc:1950] T 76add3b9ef254ece958121a336e87936 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:54.760983 5245 raft_consensus.cc:1275] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Refusing update from remote peer bb28c54312c94d7dafb1c2abf7870735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 13:49:54.763252 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 284f6113fa4b443a869bce6d0c15f273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.767534 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 73546fba4ac846efbe9a9f4e346e4c21 (DEFAULT_TABLE table=default.Table_81665809269849e98e48061e93daa488 [id=85aa49fa034e41f2bd95fd13dee47b9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.768117 5623 ts_tablet_manager.cc:1916] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:54.768414 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370553521753488ab81e40144f2536ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.769884 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a1193719e140beb9b492927adeb78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.772187 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73546fba4ac846efbe9a9f4e346e4c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.763777 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed33e78ee5448bcae633cc874c3e171 (DEFAULT_TABLE table=default.Table_f8cf2e1f9d84401897db63d0a884c6b1 [id=1828e2f519ae4cbc810509b126d740e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.783782 5619 raft_consensus.cc:359] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:54.784049 5619 raft_consensus.cc:385] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.784145 5619 raft_consensus.cc:740] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:49:54.784178 5319 leader_election.cc:343] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: c989f70385f64593a46f633c98267627
I20260927 13:49:54.786670 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c989f70385f64593a46f633c98267627" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:54.795171 6344 raft_consensus.cc:493] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:54.780467 5227 tablet_service.cc:1511] Processing CreateTablet for tablet dd0126a6df14457ca5c62c129f3275f8 (DEFAULT_TABLE table=default.Table_8a9f7c16b9ec4d10848c2bb0c661fe27 [id=0cf3d2b79225499f86d3d78ef105ab4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.804829 5245 raft_consensus.cc:2468] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:54.805238 6344 raft_consensus.cc:515] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:54.805989 6344 leader_election.cc:290] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:54.809329 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ff32095a554784b91e74012ad8e020" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:54.810688 5106 raft_consensus.cc:2468] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:54.784467 5619 consensus_queue.cc:260] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:54.716503 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 76add3b9ef254ece958121a336e87936 (table default.Table_cacde3a39927479095e38a677172ee0f [id=d570c2cfe66d4c0e9fdfaee2c644aab2]) successfully deleted
W20260927 13:49:54.811837 4917 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 95321us
I20260927 13:49:54.812170 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed33e78ee5448bcae633cc874c3e171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.718375 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 98ffe83306e74749b5b3f68e6c2c708c (table default.Table_0956a69da22a495691888f08a70b62dc [id=126aea719ed34308a0742ed1fe5d6970]) successfully deleted
W20260927 13:49:54.813087 4916 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 94658us
I20260927 13:49:54.813581 5628 tablet_bootstrap.cc:492] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:54.813732 5628 ts_tablet_manager.cc:1403] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.130s user 0.012s sys 0.012s
I20260927 13:49:54.814451 5628 raft_consensus.cc:359] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.814446 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef5969312044a2bab451841ec65aa84 (DEFAULT_TABLE table=default.Table_d0a9564fe50b4e92800203352ad52f81 [id=4538e58c268d44b59999b80f295c321d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.814602 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b3a305ad4c704bbd8d522515786100c0 (table default.Table_25e6e013310e4ba18a969df5b8ae3901 [id=33df36c4049b4b0a97fc6541b66a362b]) successfully deleted
I20260927 13:49:54.814651 5628 raft_consensus.cc:385] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.814718 5628 raft_consensus.cc:740] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.814903 5628 consensus_queue.cc:260] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:54.815004 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet bf557ac29964453583f224b46178c7dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf557ac29964453583f224b46178c7dd already in progress: creating tablet
I20260927 13:49:54.802004 5606 tablet_replica.cc:333] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:54.815361 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 76add3b9ef254ece958121a336e87936 (table default.Table_cacde3a39927479095e38a677172ee0f [id=d570c2cfe66d4c0e9fdfaee2c644aab2]) successfully deleted
I20260927 13:49:54.815439 5628 ts_tablet_manager.cc:1434] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:54.815467 5606 raft_consensus.cc:2243] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:54.815639 5606 raft_consensus.cc:2272] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:54.815757 5628 tablet_bootstrap.cc:492] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:54.816026 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef5969312044a2bab451841ec65aa84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.799935 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cc6af9b33f0c464683e40adc28037bc8 (table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec]). Expected version 1 got 0
I20260927 13:49:54.802351 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e5f8007fdae74bbe92a5c011cf80f361" } modify_external_catalogs: true
I20260927 13:49:54.819957 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e5f8007fdae74bbe92a5c011cf80f361" } modify_external_catalogs: true
I20260927 13:49:54.822077 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef5969312044a2bab451841ec65aa84 (DEFAULT_TABLE table=default.Table_d0a9564fe50b4e92800203352ad52f81 [id=4538e58c268d44b59999b80f295c321d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.822487 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef5969312044a2bab451841ec65aa84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.822567 5619 ts_tablet_manager.cc:1434] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.084s user 0.001s sys 0.001s
I20260927 13:49:54.823194 5628 tablet_bootstrap.cc:654] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.823177 5619 tablet_bootstrap.cc:492] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:54.824993 5348 tablet_service.cc:1511] Processing CreateTablet for tablet 76cf11a5af384512b361a83487c8b117 (DEFAULT_TABLE table=default.Table_8d512449c471495286c66f025bfa4621 [id=1ee0716eaa60467ea085de14e7378c76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.825376 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cf11a5af384512b361a83487c8b117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.826333 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 76cf11a5af384512b361a83487c8b117 (DEFAULT_TABLE table=default.Table_8d512449c471495286c66f025bfa4621 [id=1ee0716eaa60467ea085de14e7378c76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.826635 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cf11a5af384512b361a83487c8b117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.829543 6181 fs_manager.cc:714] Time spent opening directory manager: real 0.039s user 0.004s sys 0.002s
I20260927 13:49:54.830538 5606 ts_tablet_manager.cc:1916] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:54.834061 5628 tablet_bootstrap.cc:492] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:54.834232 5628 ts_tablet_manager.cc:1403] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.001s
I20260927 13:49:54.834934 5628 raft_consensus.cc:359] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.835121 5628 raft_consensus.cc:385] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.835188 5628 raft_consensus.cc:740] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.835420 5628 consensus_queue.cc:260] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.835976 5628 ts_tablet_manager.cc:1434] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:54.836288 5628 tablet_bootstrap.cc:492] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:54.834069 6362 raft_consensus.cc:493] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:54.837308 6362 raft_consensus.cc:515] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.837845 5619 tablet_bootstrap.cc:654] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.838078 6362 leader_election.cc:290] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:54.840570 5628 tablet_bootstrap.cc:654] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.847718 6361 tablet.cc:1751] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:54.849839 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 16743b4513fa4987aee48f03e28cd498 (DEFAULT_TABLE table=default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.850086 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 16743b4513fa4987aee48f03e28cd498 (DEFAULT_TABLE table=default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.850257 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16743b4513fa4987aee48f03e28cd498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.850481 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb2045e5d84ed2b51dd88e197e84cb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:54.851711 6373 tablet.cc:1751] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:54.850481 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16743b4513fa4987aee48f03e28cd498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.854089 5349 tablet_service.cc:1511] Processing CreateTablet for tablet dd0126a6df14457ca5c62c129f3275f8 (DEFAULT_TABLE table=default.Table_8a9f7c16b9ec4d10848c2bb0c661fe27 [id=0cf3d2b79225499f86d3d78ef105ab4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.854470 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0126a6df14457ca5c62c129f3275f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.863554 5075 tablet_service.cc:1511] Processing CreateTablet for tablet a4f4bc5cefef448d85ff31b7fafaca74 (DEFAULT_TABLE table=default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.864094 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f4bc5cefef448d85ff31b7fafaca74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.864802 5319 leader_election.cc:304] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:54.864568 6145 consensus_queue.cc:1048] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260927 13:49:54.868794 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 90fb369fec2d43149080ab2ad94ecc57 (DEFAULT_TABLE table=default.Table_b0b2ff4faec94fc9a83fc6271fd5ec6d [id=23ffbb0d3240465cb12a09ffec1f8163]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.869201 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fb369fec2d43149080ab2ad94ecc57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.869866 5080 tablet_service.cc:1511] Processing CreateTablet for tablet db75594e5ee0427a80016bb8a19b6703 (DEFAULT_TABLE table=default.Table_270422451be448a2b25e3952c94c9a61 [id=0233299f43344cb0b577c4c5e25c3020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.870368 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 502fe193f2034e37a53b245bbf049ae8 (DEFAULT_TABLE table=default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.870687 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502fe193f2034e37a53b245bbf049ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.871992 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db75594e5ee0427a80016bb8a19b6703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.875173 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0126a6df14457ca5c62c129f3275f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.758086 6372 rpcz_store.cc:276] 0927 13:49:53.593206 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:53.593263 (+ 57us) service_pool.cc:224] Handling call
0927 13:49:54.677176 (+1083913us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:49:53.667937 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0927 13:49:53.668092 (+ 155us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 13:49:53.668100 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0927 13:49:53.668108 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0927 13:49:53.668148 (+ 40us) alter_schema_op.cc:128] START. Timestamp: 1790516993668110
0927 13:49:53.668151 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:49:53.668427 (+ 276us) log.cc:844] Serialized 173 byte log entry
0927 13:49:54.242254 (+573827us) op_driver.cc:464] REPLICATION: finished
0927 13:49:54.638823 (+396569us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0927 13:49:54.669395 (+ 30572us) log.cc:844] Serialized 5 byte log entry
0927 13:49:54.675287 (+ 5892us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:54.675524 (+ 237us) log.cc:844] Serialized 14 byte log entry
0927 13:49:54.677132 (+ 1608us) alter_schema_op.cc:73] Released schema lock
0927 13:49:54.677138 (+ 6us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":396493,"prepare.queue_time_us":74327,"prepare.run_cpu_time_us":14310,"prepare.run_wall_time_us":163589,"raft.queue_time_us":31548,"raft.run_cpu_time_us":833,"raft.run_wall_time_us":831,"replication_time_us":574061,"thread_start_us":616704,"threads_started":4,"wal-append.queue_time_us":96033}]]}
I20260927 13:49:54.809453 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_694d68f5161840289b065bce1d592d4d" } modify_external_catalogs: true
I20260927 13:49:54.881626 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_694d68f5161840289b065bce1d592d4d" } modify_external_catalogs: true
W20260927 13:49:54.864992 5319 raft_consensus.cc:2686] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:49:54.796411 6393 raft_consensus.cc:515] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
W20260927 13:49:54.884125 5045 leader_election.cc:343] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:54.884790 6375 tablet.cc:1751] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:54.890432 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 502fe193f2034e37a53b245bbf049ae8 (DEFAULT_TABLE table=default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.890962 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502fe193f2034e37a53b245bbf049ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.891417 5347 tablet_service.cc:1511] Processing CreateTablet for tablet 90fb369fec2d43149080ab2ad94ecc57 (DEFAULT_TABLE table=default.Table_b0b2ff4faec94fc9a83fc6271fd5ec6d [id=23ffbb0d3240465cb12a09ffec1f8163]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.891806 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fb369fec2d43149080ab2ad94ecc57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.892923 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 28da0fdf9b4740d7ac461308de572306 (DEFAULT_TABLE table=default.Table_bdd9cd69a46646c09a795b8566ba23aa [id=d64611e8699c410c919a48b0c4441e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.893213 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28da0fdf9b4740d7ac461308de572306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.893275 5358 tablet_service.cc:1511] Processing CreateTablet for tablet db75594e5ee0427a80016bb8a19b6703 (DEFAULT_TABLE table=default.Table_270422451be448a2b25e3952c94c9a61 [id=0233299f43344cb0b577c4c5e25c3020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.893675 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db75594e5ee0427a80016bb8a19b6703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.894459 5357 tablet_service.cc:1511] Processing CreateTablet for tablet a4f4bc5cefef448d85ff31b7fafaca74 (DEFAULT_TABLE table=default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.894825 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f4bc5cefef448d85ff31b7fafaca74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.897845 5184 leader_election.cc:304] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:54.897861 6393 leader_election.cc:290] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:54.904286 4917 catalog_manager.cc:5136] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): alter failed for tablet 7011125c78084deca83b1570d1c2d704 (table default.Table_a09e5155fa1148ef88003c6c1afedce5 [id=c073a79da0b440698186e6856c8c8c68]),no further retry: Not found: Tablet not found: 7011125c78084deca83b1570d1c2d704
I20260927 13:49:54.904513 6373 tablet.cc:1746] T 1cc174eab36b46fb8e276b3168fbfbcd P bb28c54312c94d7dafb1c2abf7870735: Skipping requested alter to schema version 3, tablet already version 3
I20260927 13:49:54.907800 5219 tablet_service.cc:1511] Processing CreateTablet for tablet 76cf11a5af384512b361a83487c8b117 (DEFAULT_TABLE table=default.Table_8d512449c471495286c66f025bfa4621 [id=1ee0716eaa60467ea085de14e7378c76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.909008 6344 raft_consensus.cc:2804] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:54.909159 6344 raft_consensus.cc:493] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:54.909286 6344 raft_consensus.cc:3060] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:54.911792 6375 tablet.cc:1746] T 1cc174eab36b46fb8e276b3168fbfbcd P 34fc5fe0a32d42ab83f4aa6d07341409: Skipping requested alter to schema version 3, tablet already version 3
W20260927 13:49:54.912122 5184 leader_election.cc:343] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 6817fb4caf6a445b899830c6702bf911
I20260927 13:49:54.913650 6344 raft_consensus.cc:515] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:54.914814 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ff32095a554784b91e74012ad8e020" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:54.914991 5109 raft_consensus.cc:3060] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:54.914845 6344 leader_election.cc:290] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:54.916728 4930 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
I20260927 13:49:54.918213 5109 raft_consensus.cc:2468] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:54.918479 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b224b590e5c4a2ab26ea7eaeedd976c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:54.918452 5222 tablet_service.cc:1511] Processing CreateTablet for tablet db75594e5ee0427a80016bb8a19b6703 (DEFAULT_TABLE table=default.Table_270422451be448a2b25e3952c94c9a61 [id=0233299f43344cb0b577c4c5e25c3020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.918753 5625 tablet_replica.cc:333] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:54.918736 5184 leader_election.cc:304] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:54.918932 5625 raft_consensus.cc:2243] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:54.919054 5625 raft_consensus.cc:2272] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:54.919023 6394 log.cc:927] Time spent T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
I20260927 13:49:54.920001 5625 ts_tablet_manager.cc:1916] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:54.920181 6344 raft_consensus.cc:2804] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:54.920488 6344 raft_consensus.cc:697] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:54.920866 6344 consensus_queue.cc:237] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:54.923458 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 16743b4513fa4987aee48f03e28cd498 (DEFAULT_TABLE table=default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.923862 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cf11a5af384512b361a83487c8b117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.925254 5221 tablet_service.cc:1511] Processing CreateTablet for tablet a4f4bc5cefef448d85ff31b7fafaca74 (DEFAULT_TABLE table=default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.925598 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_967519598f9b4c999e93c6f358381116" } modify_external_catalogs: true
I20260927 13:49:54.925845 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_967519598f9b4c999e93c6f358381116" } modify_external_catalogs: true
I20260927 13:49:54.926962 5625 ts_tablet_manager.cc:1929] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:54.927119 5625 log.cc:1199] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/5b224b590e5c4a2ab26ea7eaeedd976c
I20260927 13:49:54.927560 5625 ts_tablet_manager.cc:1950] T 5b224b590e5c4a2ab26ea7eaeedd976c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:54.928920 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 5b224b590e5c4a2ab26ea7eaeedd976c (table default.Table_44d960a4808c41b3857a9d76053fc16a [id=0b26044e99f94ff398a2b411b35887b0]) successfully deleted
I20260927 13:49:54.931033 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d936492f977944a59cdb4de68a75c0a8" } modify_external_catalogs: true
I20260927 13:49:54.931232 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d936492f977944a59cdb4de68a75c0a8" } modify_external_catalogs: true
W20260927 13:49:54.931519 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 97b46497d8254a248df8d421d0b09d8d has no consensus state
I20260927 13:49:54.935387 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 502fe193f2034e37a53b245bbf049ae8 (DEFAULT_TABLE table=default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.936990 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 496cffc2a8774185a0e0f63208bed8a5
I20260927 13:49:54.937912 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet 496cffc2a8774185a0e0f63208bed8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:54.939535 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16743b4513fa4987aee48f03e28cd498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.939949 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f4bc5cefef448d85ff31b7fafaca74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.940346 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 496cffc2a8774185a0e0f63208bed8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:54.940614 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 496cffc2a8774185a0e0f63208bed8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:54.940364 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502fe193f2034e37a53b245bbf049ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.941026 5619 tablet_bootstrap.cc:492] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:54.941166 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db75594e5ee0427a80016bb8a19b6703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.941164 5619 ts_tablet_manager.cc:1403] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.118s user 0.000s sys 0.003s
I20260927 13:49:54.941843 5619 raft_consensus.cc:359] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:54.942000 5619 raft_consensus.cc:385] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.942047 5619 raft_consensus.cc:740] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.944339 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_81665809269849e98e48061e93daa488" } modify_external_catalogs: true
I20260927 13:49:54.944528 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_81665809269849e98e48061e93daa488" } modify_external_catalogs: true
I20260927 13:49:54.946236 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5efb83240eb54eef90123c741672b105" } new_table_name: "default.Table_898704d6564c46279e001e1834d3fcbd" modify_external_catalogs: true
W20260927 13:49:54.946316 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 496cffc2a8774185a0e0f63208bed8a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 496cffc2a8774185a0e0f63208bed8a5 already in progress: creating tablet
I20260927 13:49:54.948647 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_71880460bb5749cf90eed9712c6c61a1" } new_table_name: "default.Table_a11ce43ce6844620ad9e147959b0d952" modify_external_catalogs: true
I20260927 13:49:54.950359 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_10bbf85be3e5407c809f9867c6e1bb3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:54.955677 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3af91c12409e4dbc97a79774e12d3634" } new_table_name: "default.Table_b9c7f24da5d7468ba87025ae9e22a80c" modify_external_catalogs: true
I20260927 13:49:54.956553 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_fa1834afe3c24278ad9e378c9c237e52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:54.958241 6411 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260927 13:49:54.958438 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa1834afe3c24278ad9e378c9c237e52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:54.960012 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10bbf85be3e5407c809f9867c6e1bb3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:54.965523 6181 fs_manager.cc:730] Time spent opening block manager: real 0.133s user 0.005s sys 0.012s
I20260927 13:49:54.966660 5619 consensus_queue.cc:260] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:54.967206 5619 ts_tablet_manager.cc:1434] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260927 13:49:54.971205 5628 tablet_bootstrap.cc:492] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:54.971365 5628 ts_tablet_manager.cc:1403] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.135s user 0.015s sys 0.022s
I20260927 13:49:54.972457 5628 raft_consensus.cc:359] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.972611 5628 raft_consensus.cc:385] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.972656 5628 raft_consensus.cc:740] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.972695 5619 tablet_bootstrap.cc:492] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:54.972887 5628 consensus_queue.cc:260] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:54.973378 5623 ts_tablet_manager.cc:1929] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:54.973524 5623 log.cc:1199] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/1f5dfa3e80454463908df19a49454764
I20260927 13:49:54.966290 6181 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data,/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal
uuid: "e421351a34d1463e9773dcebdeebae3c"
format_stamp: "Formatted at 2026-09-27 13:49:38 on dist-test-slave-bkfv"
I20260927 13:49:54.976110 5628 ts_tablet_manager.cc:1434] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:54.979147 5628 tablet_bootstrap.cc:492] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:54.980938 5628 tablet_bootstrap.cc:654] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.981247 5619 tablet_bootstrap.cc:654] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.983131 6181 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 13:49:54.986548 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 90fb369fec2d43149080ab2ad94ecc57 (DEFAULT_TABLE table=default.Table_b0b2ff4faec94fc9a83fc6271fd5ec6d [id=23ffbb0d3240465cb12a09ffec1f8163]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.987267 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fb369fec2d43149080ab2ad94ecc57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.988986 5628 tablet_bootstrap.cc:492] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:54.989148 5628 ts_tablet_manager.cc:1403] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.001s
I20260927 13:49:54.989961 5628 raft_consensus.cc:359] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:54.990182 5628 raft_consensus.cc:385] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:54.990262 5628 raft_consensus.cc:740] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:54.990899 5628 consensus_queue.cc:260] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:54.992719 5628 ts_tablet_manager.cc:1434] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260927 13:49:54.992748 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef5969312044a2bab451841ec65aa84 (DEFAULT_TABLE table=default.Table_d0a9564fe50b4e92800203352ad52f81 [id=4538e58c268d44b59999b80f295c321d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:54.993213 5628 tablet_bootstrap.cc:492] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:54.993256 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef5969312044a2bab451841ec65aa84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:54.995074 5623 ts_tablet_manager.cc:1950] T 1f5dfa3e80454463908df19a49454764 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:54.996181 5623 tablet_replica.cc:333] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:54.996407 5623 raft_consensus.cc:2243] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:54.996703 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 1f5dfa3e80454463908df19a49454764 (table default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]) successfully deleted
I20260927 13:49:55.003192 5628 tablet_bootstrap.cc:654] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:54.811273 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_52cd6f5926494db78b6f05c29b36d509"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:55.004839 5619 tablet_bootstrap.cc:492] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.004997 5619 ts_tablet_manager.cc:1403] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.001s
W20260927 13:49:55.005502 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52cd6f5926494db78b6f05c29b36d509 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:55.005708 5619 raft_consensus.cc:359] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.005877 5619 raft_consensus.cc:385] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.005939 5619 raft_consensus.cc:740] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.010461 5619 consensus_queue.cc:260] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.012331 5619 ts_tablet_manager.cc:1434] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260927 13:49:55.014730 5623 raft_consensus.cc:2272] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:55.015825 5623 ts_tablet_manager.cc:1916] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:55.016840 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817fb4caf6a445b899830c6702bf911" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:55.017014 5384 raft_consensus.cc:2468] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:55.017071 5619 tablet_bootstrap.cc:492] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.017215 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ff32095a554784b91e74012ad8e020" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:55.017444 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5cc71e06eb743d2b63e056e88a6498f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:55.016817 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ff32095a554784b91e74012ad8e020" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:55.018508 5619 tablet_bootstrap.cc:654] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.021760 5185 leader_election.cc:304] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:55.022286 6395 raft_consensus.cc:2804] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:55.022473 6395 raft_consensus.cc:493] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:55.022677 6395 raft_consensus.cc:3060] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:55.024592 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet fbde77915c7d4665965bef2298c3491f
I20260927 13:49:55.025260 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet 76add3b9ef254ece958121a336e87936 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:55.025943 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_bcd62dc847544c6c95e4c64a53253103"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:55.029453 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcd62dc847544c6c95e4c64a53253103 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:55.029809 6395 raft_consensus.cc:515] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:55.030436 6395 leader_election.cc:290] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:55.030885 5185 leader_election.cc:343] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.031643 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet fbde77915c7d4665965bef2298c3491f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:55.031931 5184 leader_election.cc:343] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 6817fb4caf6a445b899830c6702bf911
W20260927 13:49:55.032092 5185 leader_election.cc:343] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.032255 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet fbde77915c7d4665965bef2298c3491f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:55.032346 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet fbde77915c7d4665965bef2298c3491f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbde77915c7d4665965bef2298c3491f already in progress: creating tablet
I20260927 13:49:55.033033 5628 tablet_bootstrap.cc:492] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.033201 5628 ts_tablet_manager.cc:1403] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20260927 13:49:55.034137 5628 raft_consensus.cc:359] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.034343 5628 raft_consensus.cc:385] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.034407 5628 raft_consensus.cc:740] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.034632 5628 consensus_queue.cc:260] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.035403 5628 ts_tablet_manager.cc:1434] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:49:55.011763 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c332b6ec9ca94ce398a71e82e20897d4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.012537 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e0e8d6bc744d69a9f41d45459d3b2b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.013370 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f7512333e245c4b35018961a510efd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.014153 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb2045e5d84ed2b51dd88e197e84cb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.032879 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet fbde77915c7d4665965bef2298c3491f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:55.036669 5628 tablet_bootstrap.cc:492] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.037019 5185 leader_election.cc:304] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.038975 5628 tablet_bootstrap.cc:654] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:55.039356 5185 raft_consensus.cc:2686] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260927 13:49:55.039850 5185 leader_election.cc:343] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:55.010232 5247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s user 0.003s sys 0.017s
W20260927 13:49:55.040625 5247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s user 0.003s sys 0.017s
I20260927 13:49:55.046656 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817fb4caf6a445b899830c6702bf911" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:55.046880 5383 raft_consensus.cc:3060] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:55.049378 6372 tablet.cc:1751] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:55.049597 5383 raft_consensus.cc:2468] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:55.041085 6375 tablet.cc:1751] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260927 13:49:55.046451 5044 leader_election.cc:343] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.050539 5044 leader_election.cc:304] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.050839 6362 raft_consensus.cc:2749] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:55.051045 5044 leader_election.cc:343] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.051154 5044 leader_election.cc:304] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.051370 6362 raft_consensus.cc:2749] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:55.051575 5044 leader_election.cc:343] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.051671 5044 leader_election.cc:304] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.051865 6362 raft_consensus.cc:2749] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:55.052026 5044 leader_election.cc:343] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.052115 5044 leader_election.cc:304] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.052323 6362 raft_consensus.cc:2749] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.056704 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2b082227264e442a8b1db7a68fb0c3eb
I20260927 13:49:55.057673 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b082227264e442a8b1db7a68fb0c3eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:55.058353 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 2b082227264e442a8b1db7a68fb0c3eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b082227264e442a8b1db7a68fb0c3eb already in progress: creating tablet
I20260927 13:49:55.060505 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b082227264e442a8b1db7a68fb0c3eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:55.061074 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b082227264e442a8b1db7a68fb0c3eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:55.064023 5185 leader_election.cc:304] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:55.066639 6395 raft_consensus.cc:2804] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:55.067065 6395 raft_consensus.cc:697] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:55.067494 6395 consensus_queue.cc:237] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:55.072755 6372 tablet.cc:1751] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:55.078837 6357 tablet.cc:1746] T 1cc174eab36b46fb8e276b3168fbfbcd P 79c1646c9659434b9a659382d2eb1d8a: Skipping requested alter to schema version 3, tablet already version 3
I20260927 13:49:55.083484 5628 tablet_bootstrap.cc:492] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.083634 5628 ts_tablet_manager.cc:1403] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.002s
I20260927 13:49:55.084342 5628 raft_consensus.cc:359] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.084501 5628 raft_consensus.cc:385] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.084553 5628 raft_consensus.cc:740] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.084812 5628 consensus_queue.cc:260] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.085412 5628 ts_tablet_manager.cc:1434] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:55.086473 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8cda445237a34eac8407eedddae90d1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:55.087217 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cda445237a34eac8407eedddae90d1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:55.088559 5628 tablet_bootstrap.cc:492] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.089900 5628 tablet_bootstrap.cc:654] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.093752 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet bb505472de024c2e9b3861f3225b7e40
I20260927 13:49:55.094650 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet bb505472de024c2e9b3861f3225b7e40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:55.094887 5625 tablet_replica.cc:333] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:55.095103 5625 raft_consensus.cc:2243] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:55.095293 5625 raft_consensus.cc:2272] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:55.095736 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet bb505472de024c2e9b3861f3225b7e40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:55.095901 5625 ts_tablet_manager.cc:1916] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:55.096939 5628 tablet_bootstrap.cc:492] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.097041 5628 ts_tablet_manager.cc:1403] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
W20260927 13:49:55.097180 4917 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3ee18063dc634385b9e61fae3b3ece99 consensus state has no leader
I20260927 13:49:55.097580 5628 raft_consensus.cc:359] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.097725 5628 raft_consensus.cc:385] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.097784 5628 raft_consensus.cc:740] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.098738 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cb043d4ac1634ad497377f4eda030a17" } new_table_name: "default.Table_384ae9c2c24745999157e1023e76d208" modify_external_catalogs: true
I20260927 13:49:55.101930 6181 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260927 13:49:55.102389 5625 ts_tablet_manager.cc:1929] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:55.102485 5625 log.cc:1199] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/bb505472de024c2e9b3861f3225b7e40
I20260927 13:49:55.102828 5625 ts_tablet_manager.cc:1950] T bb505472de024c2e9b3861f3225b7e40 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:55.103544 5628 consensus_queue.cc:260] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.104069 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet bb505472de024c2e9b3861f3225b7e40 (table default.Table_d936492f977944a59cdb4de68a75c0a8 [id=3bbc5d02a6d14ec98f4377270e60e6fc]) successfully deleted
I20260927 13:49:55.104640 5628 ts_tablet_manager.cc:1434] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260927 13:49:55.105337 5628 tablet_bootstrap.cc:492] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.105504 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 73546fba4ac846efbe9a9f4e346e4c21
I20260927 13:49:55.106374 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 73546fba4ac846efbe9a9f4e346e4c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:55.106986 5628 tablet_bootstrap.cc:654] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.107380 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 73546fba4ac846efbe9a9f4e346e4c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:55.111145 6181 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 13:49:55.111560 6181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 13:49:55.111935 6373 tablet.cc:1751] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260927 13:49:55.113584 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 73546fba4ac846efbe9a9f4e346e4c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73546fba4ac846efbe9a9f4e346e4c21 already in progress: creating tablet
I20260927 13:49:55.114953 5619 tablet_bootstrap.cc:492] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.115093 5619 ts_tablet_manager.cc:1403] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.098s user 0.002s sys 0.012s
I20260927 13:49:55.119277 5628 tablet_bootstrap.cc:492] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.119467 5628 ts_tablet_manager.cc:1403] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260927 13:49:55.120237 5628 raft_consensus.cc:359] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.120548 5628 raft_consensus.cc:385] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.120664 5628 raft_consensus.cc:740] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.121042 5628 consensus_queue.cc:260] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.121918 6375 tablet.cc:1751] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:55.122848 5628 ts_tablet_manager.cc:1434] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:55.123256 5628 tablet_bootstrap.cc:492] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.126245 5628 tablet_bootstrap.cc:654] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.127830 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 73546fba4ac846efbe9a9f4e346e4c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:55.128913 5619 raft_consensus.cc:359] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:55.129106 5619 raft_consensus.cc:385] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.129173 5619 raft_consensus.cc:740] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.129460 5626 tablet_bootstrap.cc:492] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:55.129428 5619 consensus_queue.cc:260] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:55.129632 5626 ts_tablet_manager.cc:1403] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.765s user 0.008s sys 0.009s
I20260927 13:49:55.132444 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet bb505472de024c2e9b3861f3225b7e40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:55.133496 5619 ts_tablet_manager.cc:1434] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.018s user 0.000s sys 0.002s
I20260927 13:49:55.136710 5619 tablet_bootstrap.cc:492] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.138816 5619 tablet_bootstrap.cc:654] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.141067 5623 ts_tablet_manager.cc:1929] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:49:55.144766 4915 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260927 13:49:55.146157 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_b24ebce499044fc5974be0e77bc778f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:55.147006 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b24ebce499044fc5974be0e77bc778f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:55.147379 5628 tablet_bootstrap.cc:492] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.147495 5628 ts_tablet_manager.cc:1403] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.004s
I20260927 13:49:55.148101 5628 raft_consensus.cc:359] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.148245 5628 raft_consensus.cc:385] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.148286 5628 raft_consensus.cc:740] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.148442 5628 consensus_queue.cc:260] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.154999 5623 log.cc:1199] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b5cc71e06eb743d2b63e056e88a6498f
I20260927 13:49:55.155397 5623 ts_tablet_manager.cc:1950] T b5cc71e06eb743d2b63e056e88a6498f P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:55.156024 5628 ts_tablet_manager.cc:1434] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260927 13:49:55.156651 5626 raft_consensus.cc:359] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.157068 5626 raft_consensus.cc:385] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.157186 5626 raft_consensus.cc:740] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.157490 5626 consensus_queue.cc:260] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.158090 5626 ts_tablet_manager.cc:1434] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260927 13:49:55.159056 5628 tablet_bootstrap.cc:492] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.159870 6357 tablet.cc:1751] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:55.160665 5628 tablet_bootstrap.cc:654] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.169175 6362 raft_consensus.cc:493] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.169358 6362 raft_consensus.cc:515] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.170058 6362 leader_election.cc:290] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.170714 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0851e183315a45f4a85d68d698e74cb7" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:55.171221 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0851e183315a45f4a85d68d698e74cb7" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.171479 6383 raft_consensus.cc:493] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.171607 6383 raft_consensus.cc:515] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:55.171829 5044 leader_election.cc:343] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.172185 6383 leader_election.cc:290] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:55.172183 5045 leader_election.cc:343] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.172299 5045 leader_election.cc:304] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.172659 6362 raft_consensus.cc:2749] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.173023 5628 tablet_bootstrap.cc:492] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.173125 5628 ts_tablet_manager.cc:1403] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.006s
I20260927 13:49:55.173786 5628 raft_consensus.cc:359] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.173924 5628 raft_consensus.cc:385] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.173965 5628 raft_consensus.cc:740] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:49:55.174062 5319 leader_election.cc:343] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 1f5dfa3e80454463908df19a49454764
W20260927 13:49:55.174263 5319 leader_election.cc:343] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 1f5dfa3e80454463908df19a49454764
I20260927 13:49:55.174227 5628 consensus_queue.cc:260] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.174345 5319 leader_election.cc:304] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:55.174826 5628 ts_tablet_manager.cc:1434] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:55.175005 6145 raft_consensus.cc:2749] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.175072 5628 tablet_bootstrap.cc:492] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.175201 5623 tablet_replica.cc:333] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:55.175405 5623 raft_consensus.cc:2243] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:55.175558 5623 raft_consensus.cc:2272] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:55.176100 5623 ts_tablet_manager.cc:1916] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:55.177130 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b5cc71e06eb743d2b63e056e88a6498f (table default.Table_b10075ed74e549249e8a79bac26e367c [id=935f2e2df32c46e58760dba62709c181]) successfully deleted
I20260927 13:49:55.177543 6344 raft_consensus.cc:493] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.177678 6344 raft_consensus.cc:515] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.178534 6344 leader_election.cc:290] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:55.178699 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abe721ef8614d86870a0526de69014f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.179183 5185 leader_election.cc:343] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.180905 5628 tablet_bootstrap.cc:654] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:55.181923 5184 leader_election.cc:343] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 4abe721ef8614d86870a0526de69014f
I20260927 13:49:55.182072 5184 leader_election.cc:304] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.183696 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 8bbe5432474049b7b44aaeaa7393b696 (DEFAULT_TABLE table=default.Table_0c9a96d72b0f43e5afec0d076cff390d [id=81cbbfa2b27445209873c0f322ebf64e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.184095 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bbe5432474049b7b44aaeaa7393b696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.185571 5628 tablet_bootstrap.cc:492] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.185686 5628 ts_tablet_manager.cc:1403] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260927 13:49:55.186331 5628 raft_consensus.cc:359] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.186470 5628 raft_consensus.cc:385] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.186514 5628 raft_consensus.cc:740] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.188203 5628 consensus_queue.cc:260] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.189666 5628 ts_tablet_manager.cc:1434] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:55.190411 6362 raft_consensus.cc:493] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.190516 5628 tablet_bootstrap.cc:492] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.190536 6362 raft_consensus.cc:515] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.191186 6362 leader_election.cc:290] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.191594 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20766b5a757e4a7e954c198f8c9ca41f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.192006 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20766b5a757e4a7e954c198f8c9ca41f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.192503 5045 leader_election.cc:343] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:55.192622 5044 leader_election.cc:343] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.192754 5044 leader_election.cc:304] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.192952 6362 raft_consensus.cc:2749] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.194909 5628 tablet_bootstrap.cc:654] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.196241 6362 raft_consensus.cc:493] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.196410 6362 raft_consensus.cc:515] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.197170 6362 leader_election.cc:290] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.197466 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2885e0829d014765b54124a0eb23a4dc" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:55.197919 5044 leader_election.cc:343] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.197999 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2885e0829d014765b54124a0eb23a4dc" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.198827 5045 leader_election.cc:343] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.198974 5045 leader_election.cc:304] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.199626 6362 raft_consensus.cc:2749] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.201915 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 28da0fdf9b4740d7ac461308de572306 (DEFAULT_TABLE table=default.Table_bdd9cd69a46646c09a795b8566ba23aa [id=d64611e8699c410c919a48b0c4441e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.202164 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 8bbe5432474049b7b44aaeaa7393b696 (DEFAULT_TABLE table=default.Table_0c9a96d72b0f43e5afec0d076cff390d [id=81cbbfa2b27445209873c0f322ebf64e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.202370 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28da0fdf9b4740d7ac461308de572306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.202636 6344 raft_consensus.cc:2749] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.206390 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 8bbe5432474049b7b44aaeaa7393b696 (DEFAULT_TABLE table=default.Table_0c9a96d72b0f43e5afec0d076cff390d [id=81cbbfa2b27445209873c0f322ebf64e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.207172 6395 raft_consensus.cc:493] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.207264 6362 raft_consensus.cc:493] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.207322 6395 raft_consensus.cc:515] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.207420 6362 raft_consensus.cc:515] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.207924 6395 leader_election.cc:290] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:55.208537 6362 leader_election.cc:290] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.208945 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.208927 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2329b988f5d9410d96eca321a7b8f3a6" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.209537 5185 leader_election.cc:343] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:55.209596 5044 leader_election.cc:343] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.209812 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.209842 5184 leader_election.cc:343] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2329b988f5d9410d96eca321a7b8f3a6
I20260927 13:49:55.210028 5184 leader_election.cc:304] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.210402 6391 raft_consensus.cc:2749] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:55.210731 5045 leader_election.cc:343] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.210853 5045 leader_election.cc:304] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.211311 6362 raft_consensus.cc:2749] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:55.211437 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5230aab9688e45b79bd0064716378152 has no consensus state
I20260927 13:49:55.211822 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 28da0fdf9b4740d7ac461308de572306 (DEFAULT_TABLE table=default.Table_bdd9cd69a46646c09a795b8566ba23aa [id=d64611e8699c410c919a48b0c4441e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.213913 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cc6af9b33f0c464683e40adc28037bc8 (table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec]). Expected version 1 got 0
W20260927 13:49:55.218286 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c332b6ec9ca94ce398a71e82e20897d4 consensus state has no leader
I20260927 13:49:55.218652 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c8c6fcc62dfb4536957573f7a410a94a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:55.219153 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8c6fcc62dfb4536957573f7a410a94a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:55.220290 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da75a470ec0c4ec9afa7c18a51cd7276 consensus state has no leader
I20260927 13:49:55.220654 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_65ed372bfab14cbd8ea34e25afdf59d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:55.221114 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65ed372bfab14cbd8ea34e25afdf59d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:55.223285 5606 ts_tablet_manager.cc:1929] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:55.223419 5606 log.cc:1199] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/c989f70385f64593a46f633c98267627
I20260927 13:49:55.223793 5606 ts_tablet_manager.cc:1950] T c989f70385f64593a46f633c98267627 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:55.224581 4921 catalog_manager.cc:5838] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } }
I20260927 13:49:55.225001 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d9ff32095a554784b91e74012ad8e020 (table default.Table_7567474623ce4d588bb654dc21623cb6 [id=112cd821498b427fb3b0d517cd0d55f3]). Expected version 1 got 0
I20260927 13:49:55.225212 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
I20260927 13:49:55.225526 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 74226753751a49fa8ce98eafb2ca1250 (table default.Table_000065d7fd1245df945d5c14cf4b881b [id=8c41592b4b4c4d4b9286336ed3c77b4b]). Expected version 2 got 0
I20260927 13:49:55.225665 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 4d35148d80b44fca9b39a4625d3e61c1 (table default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]). Expected version 1 got 0
I20260927 13:49:55.226689 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bbe5432474049b7b44aaeaa7393b696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.227164 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bbe5432474049b7b44aaeaa7393b696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.212304 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28da0fdf9b4740d7ac461308de572306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.234448 6362 raft_consensus.cc:493] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.234633 6362 raft_consensus.cc:515] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.236217 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d3c47755c94148a488782dbc379011" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:55.236958 5044 leader_election.cc:343] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.237346 6362 leader_election.cc:290] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.238199 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d3c47755c94148a488782dbc379011" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.238811 5045 leader_election.cc:343] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.238979 5045 leader_election.cc:304] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.239661 6362 raft_consensus.cc:2749] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.241830 5348 tablet_service.cc:1511] Processing CreateTablet for tablet cc8de5211f7b4d3daa14b825ce17793a (DEFAULT_TABLE table=default.Table_bd9a1a5ec36343dd86a068a6875fe17d [id=a7317f1ad2b24ce3be56df44e087bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.242221 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8de5211f7b4d3daa14b825ce17793a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.243052 5080 tablet_service.cc:1511] Processing CreateTablet for tablet cc8de5211f7b4d3daa14b825ce17793a (DEFAULT_TABLE table=default.Table_bd9a1a5ec36343dd86a068a6875fe17d [id=a7317f1ad2b24ce3be56df44e087bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.243441 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8de5211f7b4d3daa14b825ce17793a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.247478 5076 tablet_service.cc:1511] Processing CreateTablet for tablet ecb5cdc007074e0c8f44d963e527a955 (DEFAULT_TABLE table=default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.247828 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb5cdc007074e0c8f44d963e527a955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.249460 6362 raft_consensus.cc:493] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.249759 6362 raft_consensus.cc:515] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.249675 5221 tablet_service.cc:1511] Processing CreateTablet for tablet cc8de5211f7b4d3daa14b825ce17793a (DEFAULT_TABLE table=default.Table_bd9a1a5ec36343dd86a068a6875fe17d [id=a7317f1ad2b24ce3be56df44e087bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.250560 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8de5211f7b4d3daa14b825ce17793a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.251061 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04b3a942c404f3894fbbd6ece24a727" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.250231 5214 tablet_service.cc:1511] Processing CreateTablet for tablet ecb5cdc007074e0c8f44d963e527a955 (DEFAULT_TABLE table=default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.251536 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb5cdc007074e0c8f44d963e527a955. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:55.251698 5044 leader_election.cc:343] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.252533 6362 leader_election.cc:290] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.252615 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04b3a942c404f3894fbbd6ece24a727" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.253419 5045 leader_election.cc:343] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.253557 5045 leader_election.cc:304] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.254022 6362 raft_consensus.cc:2749] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.255728 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet c989f70385f64593a46f633c98267627 (table default.Table_2c9769bf8a394c8385b21e36bd7afe18 [id=3653a6192dca4f8b9df5f4862eb512a8]) successfully deleted
W20260927 13:49:55.256624 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 496cffc2a8774185a0e0f63208bed8a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 496cffc2a8774185a0e0f63208bed8a5 already in progress: creating tablet
W20260927 13:49:55.257471 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet fbde77915c7d4665965bef2298c3491f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbde77915c7d4665965bef2298c3491f already in progress: creating tablet
W20260927 13:49:55.258335 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2b082227264e442a8b1db7a68fb0c3eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b082227264e442a8b1db7a68fb0c3eb already in progress: creating tablet
W20260927 13:49:55.259127 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet bb505472de024c2e9b3861f3225b7e40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb505472de024c2e9b3861f3225b7e40 already in progress: creating tablet
W20260927 13:49:55.260095 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 73546fba4ac846efbe9a9f4e346e4c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73546fba4ac846efbe9a9f4e346e4c21 already in progress: creating tablet
I20260927 13:49:55.260501 5626 tablet_bootstrap.cc:492] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:55.273437 5628 tablet_bootstrap.cc:492] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.273581 5628 ts_tablet_manager.cc:1403] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.002s
I20260927 13:49:55.274341 5628 raft_consensus.cc:359] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.274503 5628 raft_consensus.cc:385] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.274549 5628 raft_consensus.cc:740] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.274772 5628 consensus_queue.cc:260] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.275575 5628 ts_tablet_manager.cc:1434] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:55.276528 5628 tablet_bootstrap.cc:492] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.280037 5628 tablet_bootstrap.cc:654] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:55.281101 4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.125:42239, user_credentials={real_user=slave}} blocked reactor thread for 136307us
I20260927 13:49:55.291061 5626 tablet_bootstrap.cc:654] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.293804 5348 tablet_service.cc:1511] Processing CreateTablet for tablet ecb5cdc007074e0c8f44d963e527a955 (DEFAULT_TABLE table=default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.294399 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb5cdc007074e0c8f44d963e527a955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.294866 6362 raft_consensus.cc:493] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.294986 6362 raft_consensus.cc:515] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.295765 6362 leader_election.cc:290] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.296237 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd31e3dd142413c92fce2043e053d32" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.297364 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd31e3dd142413c92fce2043e053d32" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.297672 5044 leader_election.cc:343] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:55.298281 5045 leader_election.cc:343] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.298408 5045 leader_election.cc:304] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.302251 6367 raft_consensus.cc:2749] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.305462 6375 tablet.cc:1751] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:55.308703 5628 tablet_bootstrap.cc:492] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.308871 5628 ts_tablet_manager.cc:1403] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.003s
I20260927 13:49:55.309841 5628 raft_consensus.cc:359] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.309918 6357 tablet.cc:1751] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:55.310062 5628 raft_consensus.cc:385] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.310140 5628 raft_consensus.cc:740] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.310755 5628 consensus_queue.cc:260] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.311292 5628 ts_tablet_manager.cc:1434] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:55.311538 5628 tablet_bootstrap.cc:492] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.315073 6373 tablet.cc:1751] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:55.313010 6377 raft_consensus.cc:493] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.315303 5628 tablet_bootstrap.cc:654] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.315261 6377 raft_consensus.cc:515] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.315811 6377 leader_election.cc:290] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.317754 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "351132ca12924a35910ca5473696a02f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.318308 5045 leader_election.cc:343] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.321333 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "351132ca12924a35910ca5473696a02f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:55.321947 5044 leader_election.cc:343] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.322053 5044 leader_election.cc:304] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.325583 6362 raft_consensus.cc:2749] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:55.330529 4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.125:42239, user_credentials={real_user=slave}} blocked reactor thread for 45313.1us
I20260927 13:49:55.330806 4896 master_runner.cc:187] Error getting master registration for 127.4.163.125:42239: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection refused (error 111),
I20260927 13:49:55.330965 4896 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260927 13:49:55.334100 5221 tablet_service.cc:1511] Processing CreateTablet for tablet bd84d3cf740040739d81de2460296d2c (DEFAULT_TABLE table=default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.334654 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd84d3cf740040739d81de2460296d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.349362 5348 tablet_service.cc:1511] Processing CreateTablet for tablet bd84d3cf740040739d81de2460296d2c (DEFAULT_TABLE table=default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.349917 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd84d3cf740040739d81de2460296d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.380817 5349 tablet_service.cc:1511] Processing CreateTablet for tablet d0a737bef14b4874b61a109305ebb993 (DEFAULT_TABLE table=default.Table_5b53995279b344879742a29046c07039 [id=dbb2510068af4ff1944bd59b3e7d756e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.381218 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a737bef14b4874b61a109305ebb993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.381407 5214 tablet_service.cc:1511] Processing CreateTablet for tablet d0a737bef14b4874b61a109305ebb993 (DEFAULT_TABLE table=default.Table_5b53995279b344879742a29046c07039 [id=dbb2510068af4ff1944bd59b3e7d756e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.381775 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a737bef14b4874b61a109305ebb993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.381950 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 614f1af61461466da975bea681162727 (DEFAULT_TABLE table=default.Table_07ff9b27d4c84273a02178c5797cadb9 [id=7ac77a9ca0b54856a72da7d708fa2e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.382637 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614f1af61461466da975bea681162727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.401762 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 614f1af61461466da975bea681162727 (DEFAULT_TABLE table=default.Table_07ff9b27d4c84273a02178c5797cadb9 [id=7ac77a9ca0b54856a72da7d708fa2e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.402333 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614f1af61461466da975bea681162727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.410491 6362 raft_consensus.cc:493] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.410637 6362 raft_consensus.cc:515] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.411233 6362 leader_election.cc:290] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.411980 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f18e00af74e5c811f774d29422351" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:55.412254 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f18e00af74e5c811f774d29422351" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:55.412938 5044 leader_election.cc:343] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:55.413399 5045 leader_election.cc:343] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.413494 5045 leader_election.cc:304] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.413915 6362 raft_consensus.cc:2749] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:55.414729 4915 consensus_peers.cc:597] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de -> Peer e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239): Couldn't send request to peer e421351a34d1463e9773dcebdeebae3c. Status: Network error: Client connection negotiation failed: client connection to 127.4.163.125:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260927 13:49:55.419739 5623 ts_tablet_manager.cc:1929] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:55.420173 5080 tablet_service.cc:1511] Processing CreateTablet for tablet bd84d3cf740040739d81de2460296d2c (DEFAULT_TABLE table=default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.423794 4929 master_service.cc:960] ReplaceTablet: received request to replace tablet a9503dd46ccf472581d1a667eea300ed from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:55.435412 6362 raft_consensus.cc:493] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.435559 6362 raft_consensus.cc:515] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.435940 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 614f1af61461466da975bea681162727 (DEFAULT_TABLE table=default.Table_07ff9b27d4c84273a02178c5797cadb9 [id=7ac77a9ca0b54856a72da7d708fa2e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.436151 6362 leader_election.cc:290] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.436372 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614f1af61461466da975bea681162727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.436492 5076 tablet_service.cc:1511] Processing CreateTablet for tablet d0a737bef14b4874b61a109305ebb993 (DEFAULT_TABLE table=default.Table_5b53995279b344879742a29046c07039 [id=dbb2510068af4ff1944bd59b3e7d756e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.437166 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aafbbdaa8ac48329ad422cb0c08e518" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.438007 5045 leader_election.cc:343] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.439821 5628 tablet_bootstrap.cc:492] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.439980 5628 ts_tablet_manager.cc:1403] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.128s user 0.035s sys 0.042s
I20260927 13:49:55.440469 5619 tablet_bootstrap.cc:492] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.440954 5619 ts_tablet_manager.cc:1403] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.304s user 0.052s sys 0.107s
I20260927 13:49:55.441035 5628 raft_consensus.cc:359] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.441282 5628 raft_consensus.cc:385] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.441359 5628 raft_consensus.cc:740] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.441709 5628 consensus_queue.cc:260] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.441865 5619 raft_consensus.cc:359] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:55.442487 5628 ts_tablet_manager.cc:1434] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:49:55.442302 5619 raft_consensus.cc:385] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.442884 5619 raft_consensus.cc:740] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.443292 5619 consensus_queue.cc:260] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:55.445123 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_11f8a65c84454dc4a2bbe62a385ba8ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:55.445294 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_9db5a06b3541451089e3b03a35674a16" } new_table_name: "default.Table_41545a521e094a5aaf008a68487f0e03" modify_external_catalogs: true
W20260927 13:49:55.445708 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11f8a65c84454dc4a2bbe62a385ba8ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:55.446962 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a737bef14b4874b61a109305ebb993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.447638 5619 ts_tablet_manager.cc:1434] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260927 13:49:55.450771 5619 tablet_bootstrap.cc:492] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.452898 5619 tablet_bootstrap.cc:654] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.456100 5619 tablet_bootstrap.cc:492] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.456286 5619 ts_tablet_manager.cc:1403] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260927 13:49:55.457082 5619 raft_consensus.cc:359] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.457310 5619 raft_consensus.cc:385] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.457415 5619 raft_consensus.cc:740] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.457682 5619 consensus_queue.cc:260] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.459636 5619 ts_tablet_manager.cc:1434] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 13:49:55.459946 5619 tablet_bootstrap.cc:492] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.461517 5619 tablet_bootstrap.cc:654] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.466428 5628 tablet_bootstrap.cc:492] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.468691 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd84d3cf740040739d81de2460296d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.470350 5628 tablet_bootstrap.cc:654] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:55.474222 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01b549d0d21d421cba1c830d8e0bd04d consensus state has no leader
I20260927 13:49:55.475764 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 9a45a33fe0ca43099924266f704d8c19 (DEFAULT_TABLE table=default.Table_410ddd78682b4d2ebbfad8038609093b [id=49f63147052a489787f3a3935f3c9596]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.476157 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a45a33fe0ca43099924266f704d8c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.477490 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 9a45a33fe0ca43099924266f704d8c19 (DEFAULT_TABLE table=default.Table_410ddd78682b4d2ebbfad8038609093b [id=49f63147052a489787f3a3935f3c9596]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.477782 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 9abb473dbb3d491c9d15a161541fe795 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.477946 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a45a33fe0ca43099924266f704d8c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.478106 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abb473dbb3d491c9d15a161541fe795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.478894 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 9abb473dbb3d491c9d15a161541fe795 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.479286 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abb473dbb3d491c9d15a161541fe795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.483343 5358 tablet_service.cc:1511] Processing CreateTablet for tablet a0575418f5ea4d82b34112e1bc9ab8b4 (DEFAULT_TABLE table=default.Table_ba129b9b5fcd4770aa8afe76f740bb4f [id=91f1f84c40514e0ba6d0ee865f6d9aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.483809 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0575418f5ea4d82b34112e1bc9ab8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.484663 5619 tablet_bootstrap.cc:492] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.484802 5619 ts_tablet_manager.cc:1403] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.001s
I20260927 13:49:55.485741 5619 raft_consensus.cc:359] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.485908 5619 raft_consensus.cc:385] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.485960 5619 raft_consensus.cc:740] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.486243 5619 consensus_queue.cc:260] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.488579 5619 ts_tablet_manager.cc:1434] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:49:55.488884 5619 tablet_bootstrap.cc:492] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.494794 5619 tablet_bootstrap.cc:654] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.499583 6383 raft_consensus.cc:493] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.499781 6383 raft_consensus.cc:515] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:55.500625 6383 leader_election.cc:290] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:55.502269 5319 leader_election.cc:343] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 80b1970a344045389709260c850adc07
I20260927 13:49:55.502884 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_92bf3a9fa895485597b7f5cda3251baf" } modify_external_catalogs: true
I20260927 13:49:55.503085 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_92bf3a9fa895485597b7f5cda3251baf" } modify_external_catalogs: true
I20260927 13:49:55.504469 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_511f1dce0d9445d8af1a859b3b04c3d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:55.505046 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_511f1dce0d9445d8af1a859b3b04c3d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:55.511875 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d044230007bf424db5c05f31870c84d0" } modify_external_catalogs: true
I20260927 13:49:55.512108 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d044230007bf424db5c05f31870c84d0" } modify_external_catalogs: true
I20260927 13:49:55.515107 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d19f692aecb1401a8f49d2595a038ce8" } modify_external_catalogs: true
I20260927 13:49:55.515259 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d19f692aecb1401a8f49d2595a038ce8" } modify_external_catalogs: true
I20260927 13:49:55.523049 4927 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cc6af9b33f0c464683e40adc28037bc8 (table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec]). Expected version 1 got 0
I20260927 13:49:55.523355 4927 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 4d35148d80b44fca9b39a4625d3e61c1 (table default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]). Expected version 1 got 0
I20260927 13:49:55.523412 5623 log.cc:1199] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/c989f70385f64593a46f633c98267627
I20260927 13:49:55.523878 5623 ts_tablet_manager.cc:1950] T c989f70385f64593a46f633c98267627 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:55.525527 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet c989f70385f64593a46f633c98267627 (table default.Table_2c9769bf8a394c8385b21e36bd7afe18 [id=3653a6192dca4f8b9df5f4862eb512a8]) successfully deleted
I20260927 13:49:55.525785 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet 6817fb4caf6a445b899830c6702bf911 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bd182d7cb414f07944072b0c00ee35c) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:55.526100 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 4abe721ef8614d86870a0526de69014f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:55.526300 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 825a73d47bff4246965be82eb482f7aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:55.432955 5626 tablet_bootstrap.cc:492] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:55.437510 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aafbbdaa8ac48329ad422cb0c08e518" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.526580 5626 ts_tablet_manager.cc:1403] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.368s user 0.000s sys 0.005s
W20260927 13:49:55.527009 5044 leader_election.cc:343] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.527134 5044 leader_election.cc:304] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.527355 6362 raft_consensus.cc:2749] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.476954 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 9abb473dbb3d491c9d15a161541fe795 (DEFAULT_TABLE table=default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.527515 5626 raft_consensus.cc:359] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.527666 5626 raft_consensus.cc:385] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.527714 5626 raft_consensus.cc:740] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.527832 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abb473dbb3d491c9d15a161541fe795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.527953 4930 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_996a1ca374d349c59a00107c906d5175 [id=e60348438be94e88be62039a5ac173b5]). Expected version 2 got 0
I20260927 13:49:55.528105 5626 consensus_queue.cc:260] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.528479 4930 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]). Expected version 1 got 0
I20260927 13:49:55.528590 5626 ts_tablet_manager.cc:1434] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:49:55.528762 4930 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 46537e1b33f24d50b705d53f6978da3c (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:49:55.528867 5626 tablet_bootstrap.cc:492] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:55.528945 4930 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 03a1f13b31934baa8ce18fc499e94806 (table default.Table_cf1d80366a7743b3b4fea68ea5246139 [id=ded13e9c993046cd891db043b1ff6a95]). Expected version 1 got 0
I20260927 13:49:55.529745 4930 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cc6af9b33f0c464683e40adc28037bc8 (table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec]). Expected version 1 got 0
I20260927 13:49:55.476953 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 9a45a33fe0ca43099924266f704d8c19 (DEFAULT_TABLE table=default.Table_410ddd78682b4d2ebbfad8038609093b [id=49f63147052a489787f3a3935f3c9596]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.530332 5626 tablet_bootstrap.cc:654] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.530402 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a45a33fe0ca43099924266f704d8c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.530043 4930 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 4d35148d80b44fca9b39a4625d3e61c1 (table default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]). Expected version 1 got 0
W20260927 13:49:55.537472 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 794da0992403462dbbce644134b8aab3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 794da0992403462dbbce644134b8aab3 already in progress: creating tablet
W20260927 13:49:55.538100 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet bb7b3a35b2e94bbea6be4b4a8f158593 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb7b3a35b2e94bbea6be4b4a8f158593 already in progress: creating tablet
I20260927 13:49:55.483829 5229 tablet_service.cc:1511] Processing CreateTablet for tablet a0575418f5ea4d82b34112e1bc9ab8b4 (DEFAULT_TABLE table=default.Table_ba129b9b5fcd4770aa8afe76f740bb4f [id=91f1f84c40514e0ba6d0ee865f6d9aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.538566 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0575418f5ea4d82b34112e1bc9ab8b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:55.538807 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 8aeb0c2c2be04a598e011a9d99c5492a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aeb0c2c2be04a598e011a9d99c5492a already in progress: creating tablet
W20260927 13:49:55.539398 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 50bc839e0fc54839a5d06c176760f618 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50bc839e0fc54839a5d06c176760f618 already in progress: creating tablet
W20260927 13:49:55.539973 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 98ffe83306e74749b5b3f68e6c2c708c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98ffe83306e74749b5b3f68e6c2c708c already in progress: creating tablet
W20260927 13:49:55.540527 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet bf557ac29964453583f224b46178c7dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf557ac29964453583f224b46178c7dd already in progress: creating tablet
I20260927 13:49:55.540946 5623 tablet_replica.cc:333] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:55.541169 5623 raft_consensus.cc:2243] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:55.541397 5623 raft_consensus.cc:2272] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:55.542512 5623 ts_tablet_manager.cc:1916] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:55.548588 4921 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e112118f207548cc8f013a913a1ac42c" } modify_external_catalogs: true
I20260927 13:49:55.548791 4921 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e112118f207548cc8f013a913a1ac42c" } modify_external_catalogs: true
W20260927 13:49:55.559581 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eef853d6e6ce4848927c9de884d39ac2 consensus state has no leader
I20260927 13:49:55.563392 4928 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cc6af9b33f0c464683e40adc28037bc8 (table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec]). Expected version 1 got 0
I20260927 13:49:55.581174 6383 raft_consensus.cc:493] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.581398 6383 raft_consensus.cc:515] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:55.582288 6383 leader_election.cc:290] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:55.583550 5319 leader_election.cc:343] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: b5cc71e06eb743d2b63e056e88a6498f
I20260927 13:49:55.610944 5086 tablet_service.cc:1511] Processing CreateTablet for tablet a0575418f5ea4d82b34112e1bc9ab8b4 (DEFAULT_TABLE table=default.Table_ba129b9b5fcd4770aa8afe76f740bb4f [id=91f1f84c40514e0ba6d0ee865f6d9aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:55.611752 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0575418f5ea4d82b34112e1bc9ab8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:55.613507 5626 tablet_bootstrap.cc:492] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:55.613770 5626 ts_tablet_manager.cc:1403] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.085s user 0.003s sys 0.000s
W20260927 13:49:55.610791 5044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 83783.9us
I20260927 13:49:55.614601 6362 raft_consensus.cc:493] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.614616 5626 raft_consensus.cc:359] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.614730 6362 raft_consensus.cc:515] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.614977 5626 raft_consensus.cc:385] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.615082 5626 raft_consensus.cc:740] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.615432 5626 consensus_queue.cc:260] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.616433 5626 ts_tablet_manager.cc:1434] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:55.617086 6365 raft_consensus.cc:493] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.617211 6365 raft_consensus.cc:515] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.620069 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a9503dd46ccf472581d1a667eea300ed
I20260927 13:49:55.620791 4929 catalog_manager.cc:6934] ReplaceTablet: tablet a9503dd46ccf472581d1a667eea300ed deleted and replaced by tablet 4cb71dd1785841b1b031cb09422a505d
I20260927 13:49:55.620888 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet a9503dd46ccf472581d1a667eea300ed with delete_type TABLET_DATA_DELETED (replaced by tablet 4cb71dd1785841b1b031cb09422a505d) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:55.621327 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cacde3a39927479095e38a677172ee0f" } modify_external_catalogs: true
I20260927 13:49:55.621551 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cacde3a39927479095e38a677172ee0f" } modify_external_catalogs: true
W20260927 13:49:55.622345 5319 leader_election.cc:343] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 80b1970a344045389709260c850adc07
I20260927 13:49:55.622500 5319 leader_election.cc:304] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:55.622972 6145 raft_consensus.cc:2749] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.623602 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 081f18e00af74e5c811f774d29422351
I20260927 13:49:55.624291 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:55.624795 6365 leader_election.cc:290] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.624908 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d8d34c74dce64346bb6939d4e662b864" } new_table_name: "default.Table_715d35be476d48169bb2b22804898cac" modify_external_catalogs: true
I20260927 13:49:55.625094 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet a9503dd46ccf472581d1a667eea300ed with delete_type TABLET_DATA_DELETED (replaced by tablet 4cb71dd1785841b1b031cb09422a505d) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:55.625401 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60de1c28618f4e478aae68ad07fbcf98" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.625916 5045 leader_election.cc:343] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.626914 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46537e1b33f24d50b705d53f6978da3c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.627023 5319 leader_election.cc:343] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b5cc71e06eb743d2b63e056e88a6498f
I20260927 13:49:55.627166 5319 leader_election.cc:304] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:55.627267 5619 tablet_bootstrap.cc:492] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.627401 5619 ts_tablet_manager.cc:1403] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.139s user 0.035s sys 0.042s
I20260927 13:49:55.627593 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 081f18e00af74e5c811f774d29422351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:55.627864 6145 raft_consensus.cc:2749] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.628125 5619 raft_consensus.cc:359] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.628286 5619 raft_consensus.cc:385] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.628342 5619 raft_consensus.cc:740] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.628526 5619 consensus_queue.cc:260] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.628829 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 081f18e00af74e5c811f774d29422351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:55.629042 5619 ts_tablet_manager.cc:1434] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260927 13:49:55.629390 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 081f18e00af74e5c811f774d29422351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 081f18e00af74e5c811f774d29422351 already in progress: creating tablet
I20260927 13:49:55.629932 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet a9503dd46ccf472581d1a667eea300ed with delete_type TABLET_DATA_DELETED (replaced by tablet 4cb71dd1785841b1b031cb09422a505d) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:55.630604 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a9503dd46ccf472581d1a667eea300ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9503dd46ccf472581d1a667eea300ed already in progress: creating tablet
I20260927 13:49:55.631105 5626 tablet_bootstrap.cc:492] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:55.631173 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60de1c28618f4e478aae68ad07fbcf98" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.631680 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46537e1b33f24d50b705d53f6978da3c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:55.631870 5044 leader_election.cc:343] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.632391 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet 081f18e00af74e5c811f774d29422351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:55.632539 5045 leader_election.cc:343] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.632665 5044 leader_election.cc:304] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:55.633077 5044 leader_election.cc:343] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.633179 5044 leader_election.cc:304] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.633391 6362 leader_election.cc:290] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.633420 5626 tablet_bootstrap.cc:654] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.633558 6365 raft_consensus.cc:2749] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.633644 6362 raft_consensus.cc:2749] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.634369 5619 tablet_bootstrap.cc:492] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.637298 5623 ts_tablet_manager.cc:1929] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:55.637403 5623 log.cc:1199] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/76add3b9ef254ece958121a336e87936
I20260927 13:49:55.637744 5623 ts_tablet_manager.cc:1950] T 76add3b9ef254ece958121a336e87936 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:55.641101 5619 tablet_bootstrap.cc:654] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.642863 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 76add3b9ef254ece958121a336e87936 (table default.Table_cacde3a39927479095e38a677172ee0f [id=d570c2cfe66d4c0e9fdfaee2c644aab2]) successfully deleted
W20260927 13:49:55.643580 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 496cffc2a8774185a0e0f63208bed8a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 496cffc2a8774185a0e0f63208bed8a5 already in progress: creating tablet
W20260927 13:49:55.644641 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet fbde77915c7d4665965bef2298c3491f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbde77915c7d4665965bef2298c3491f already in progress: creating tablet
W20260927 13:49:55.645217 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2b082227264e442a8b1db7a68fb0c3eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b082227264e442a8b1db7a68fb0c3eb already in progress: creating tablet
W20260927 13:49:55.645816 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 73546fba4ac846efbe9a9f4e346e4c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73546fba4ac846efbe9a9f4e346e4c21 already in progress: creating tablet
W20260927 13:49:55.646380 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet bb505472de024c2e9b3861f3225b7e40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb505472de024c2e9b3861f3225b7e40 already in progress: creating tablet
I20260927 13:49:55.646627 5623 tablet_replica.cc:333] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:55.646843 5623 raft_consensus.cc:2243] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:55.647089 5623 pending_rounds.cc:70] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:55.647150 5623 pending_rounds.cc:77] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957611798687744 op_type: NO_OP noop_request { }
I20260927 13:49:55.647246 5623 raft_consensus.cc:2889] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:55.647353 5623 raft_consensus.cc:2272] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:55.647890 4926 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet b1395a79e06f473f9c170d55b257bedb
I20260927 13:49:55.648252 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ba129b9b5fcd4770aa8afe76f740bb4f" } new_table_name: "default.Table_43903bb03edc4073b902613a00b900f6" modify_external_catalogs: true
I20260927 13:49:55.648646 5623 ts_tablet_manager.cc:1916] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:55.656371 5628 tablet_bootstrap.cc:492] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.656580 5628 ts_tablet_manager.cc:1403] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.190s user 0.051s sys 0.070s
I20260927 13:49:55.657135 5619 tablet_bootstrap.cc:492] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.657271 5619 ts_tablet_manager.cc:1403] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.003s
I20260927 13:49:55.657461 5628 raft_consensus.cc:359] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.657701 5628 raft_consensus.cc:385] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.657795 5628 raft_consensus.cc:740] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.658232 5619 raft_consensus.cc:359] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.658418 5619 raft_consensus.cc:385] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.658473 5619 raft_consensus.cc:740] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.658753 5619 consensus_queue.cc:260] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.660862 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 7dc140bba42a43758fa0c6540d728275
I20260927 13:49:55.661651 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7a18018de90d47688f3668cb739ddaa5" } new_table_name: "default.Table_162ac02f5d444371ad6d85becb6b16a0" modify_external_catalogs: true
I20260927 13:49:55.663139 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc140bba42a43758fa0c6540d728275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:55.664127 6493 tablet_replica.cc:333] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
W20260927 13:49:55.664484 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a9503dd46ccf472581d1a667eea300ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9503dd46ccf472581d1a667eea300ed already in progress: creating tablet
I20260927 13:49:55.665591 5619 ts_tablet_manager.cc:1434] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 13:49:55.665908 5619 tablet_bootstrap.cc:492] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.667753 5619 tablet_bootstrap.cc:654] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.668129 6493 raft_consensus.cc:2243] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:55.664429 5628 consensus_queue.cc:260] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.669188 4930 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_3612744880954a2fbd6f1d46583fb14b [id=3a103249799f4a5383c5091fda81153e] alter complete (version 2)
I20260927 13:49:55.670295 5619 tablet_bootstrap.cc:492] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.670403 5619 ts_tablet_manager.cc:1403] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260927 13:49:55.671345 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc140bba42a43758fa0c6540d728275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:55.672020 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 7dc140bba42a43758fa0c6540d728275 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dc140bba42a43758fa0c6540d728275 already in progress: creating tablet
I20260927 13:49:55.668403 6493 raft_consensus.cc:2272] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:55.674052 5619 raft_consensus.cc:359] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.671942 5628 ts_tablet_manager.cc:1434] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260927 13:49:55.674261 5619 raft_consensus.cc:385] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.674336 5619 raft_consensus.cc:740] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.674587 5619 consensus_queue.cc:260] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.675081 5619 ts_tablet_manager.cc:1434] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260927 13:49:55.675400 5619 tablet_bootstrap.cc:492] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.676469 6500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.163.125:42239 every 8 connection(s)
I20260927 13:49:55.677170 5628 tablet_bootstrap.cc:492] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.679468 5628 tablet_bootstrap.cc:654] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.680438 5619 tablet_bootstrap.cc:654] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.685653 6181 rpc_server.cc:307] RPC server started. Bound to: 127.4.163.125:42239
I20260927 13:49:55.685760 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc140bba42a43758fa0c6540d728275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:55.685925 6493 ts_tablet_manager.cc:1916] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:55.687732 6145 raft_consensus.cc:493] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.687927 6145 raft_consensus.cc:515] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } }
I20260927 13:49:55.688547 6181 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-1/data/info.pb
I20260927 13:49:55.688781 6145 leader_election.cc:290] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:55.689945 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ff32095a554784b91e74012ad8e020" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:55.690766 4749 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu as pid 6181
I20260927 13:49:55.690874 5619 tablet_bootstrap.cc:492] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.690994 5619 ts_tablet_manager.cc:1403] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.002s
I20260927 13:49:55.692157 5619 raft_consensus.cc:359] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.692351 5619 raft_consensus.cc:385] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.692420 5619 raft_consensus.cc:740] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.692751 5619 consensus_queue.cc:260] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.693069 5107 raft_consensus.cc:2393] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 79c1646c9659434b9a659382d2eb1d8a in this term.
I20260927 13:49:55.693697 5619 ts_tablet_manager.cc:1434] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:49:55.693974 5619 tablet_bootstrap.cc:492] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.694029 6493 ts_tablet_manager.cc:1929] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:55.695816 5619 tablet_bootstrap.cc:654] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.699751 5628 tablet_bootstrap.cc:492] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.699893 5628 ts_tablet_manager.cc:1403] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260927 13:49:55.700374 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_06a788ecdc724adf92a6212315691a25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:55.700632 5628 raft_consensus.cc:359] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.700791 5628 raft_consensus.cc:385] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.700853 5628 raft_consensus.cc:740] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.701102 5628 consensus_queue.cc:260] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:55.701234 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06a788ecdc724adf92a6212315691a25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:55.703926 5628 ts_tablet_manager.cc:1434] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:49:55.704319 5628 tablet_bootstrap.cc:492] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.709682 6493 log.cc:1199] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/081f18e00af74e5c811f774d29422351
I20260927 13:49:55.710515 6493 ts_tablet_manager.cc:1950] T 081f18e00af74e5c811f774d29422351 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:55.710991 5628 tablet_bootstrap.cc:654] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.712210 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 081f18e00af74e5c811f774d29422351 (table default.Table_92bf3a9fa895485597b7f5cda3251baf [id=5900f338a23b46e8a487ec9cfa08b8a8]) successfully deleted
I20260927 13:49:55.712910 6145 raft_consensus.cc:493] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.713054 6145 raft_consensus.cc:515] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:55.714253 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7dc140bba42a43758fa0c6540d728275 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dc140bba42a43758fa0c6540d728275 already in progress: creating tablet
I20260927 13:49:55.714468 6145 leader_election.cc:290] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:55.715894 5319 leader_election.cc:343] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 559ac90ef36d406881dc17ade0560044
I20260927 13:49:55.720052 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559ac90ef36d406881dc17ade0560044" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.720599 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ff32095a554784b91e74012ad8e020" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:55.720743 5319 leader_election.cc:343] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.720839 5319 leader_election.cc:304] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:55.721268 5319 leader_election.cc:304] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:55.721778 6145 raft_consensus.cc:3060] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:55.721305 6383 raft_consensus.cc:2749] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.725991 5619 tablet_bootstrap.cc:492] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.726153 5619 ts_tablet_manager.cc:1403] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.011s
I20260927 13:49:55.726388 6145 raft_consensus.cc:2749] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.728019 6362 raft_consensus.cc:493] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.728189 6362 raft_consensus.cc:515] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.728349 5619 raft_consensus.cc:359] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.728480 5619 raft_consensus.cc:385] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.728525 5619 raft_consensus.cc:740] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.728704 5619 consensus_queue.cc:260] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.728892 6362 leader_election.cc:290] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.729206 5619 ts_tablet_manager.cc:1434] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 13:49:55.729509 5619 tablet_bootstrap.cc:492] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.731185 5619 tablet_bootstrap.cc:654] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.732120 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e30216e0487496f8efdb8a3b06deb5a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.734617 5628 tablet_bootstrap.cc:492] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.735018 5628 ts_tablet_manager.cc:1403] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.010s
W20260927 13:49:55.735082 5044 leader_election.cc:343] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.735834 5623 ts_tablet_manager.cc:1929] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:55.735996 5623 log.cc:1199] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/6817fb4caf6a445b899830c6702bf911
I20260927 13:49:55.735908 5628 raft_consensus.cc:359] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.736100 5628 raft_consensus.cc:385] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.736186 5628 raft_consensus.cc:740] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.736431 5623 ts_tablet_manager.cc:1950] T 6817fb4caf6a445b899830c6702bf911 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:55.736863 5628 consensus_queue.cc:260] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.737553 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 6817fb4caf6a445b899830c6702bf911 (table default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b [id=48d90d1ed51f4b18b9ad5a1b7fc3cde4]) successfully deleted
I20260927 13:49:55.738147 5623 tablet_replica.cc:333] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:55.738343 5623 raft_consensus.cc:2243] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:55.738691 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e30216e0487496f8efdb8a3b06deb5a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.739256 5045 leader_election.cc:343] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.739394 5045 leader_election.cc:304] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.739835 6362 raft_consensus.cc:2749] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.741487 5623 raft_consensus.cc:2272] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:55.742218 5623 ts_tablet_manager.cc:1916] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:55.742484 6504 sys_catalog.cc:263] Verifying existing consensus state
I20260927 13:49:55.745695 5628 ts_tablet_manager.cc:1434] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 13:49:55.749063 6504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Bootstrap starting.
I20260927 13:49:55.750278 5628 tablet_bootstrap.cc:492] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.755975 5628 tablet_bootstrap.cc:654] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.758369 5157 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:55.763109 5628 tablet_bootstrap.cc:492] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.763289 5628 ts_tablet_manager.cc:1403] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20260927 13:49:55.764081 5628 raft_consensus.cc:359] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.764313 5628 raft_consensus.cc:385] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.764400 5628 raft_consensus.cc:740] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.764668 5628 consensus_queue.cc:260] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.769253 6362 raft_consensus.cc:493] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.769404 6362 raft_consensus.cc:515] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.769879 5432 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:55.770033 6362 leader_election.cc:290] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.770798 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cec272546cb4373bf69e3ab344c46e1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.771245 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cec272546cb4373bf69e3ab344c46e1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.771733 5045 leader_election.cc:343] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:55.772002 5044 leader_election.cc:343] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.772111 5044 leader_election.cc:304] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.772563 5626 tablet_bootstrap.cc:492] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:55.772580 6362 raft_consensus.cc:2749] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.772733 5626 ts_tablet_manager.cc:1403] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.142s user 0.002s sys 0.003s
I20260927 13:49:55.773622 5626 raft_consensus.cc:359] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.773844 5626 raft_consensus.cc:385] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.773895 5626 raft_consensus.cc:740] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.774340 5626 consensus_queue.cc:260] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.775825 5432 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:55.778991 5628 ts_tablet_manager.cc:1434] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260927 13:49:55.784621 5628 tablet_bootstrap.cc:492] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.786885 5628 tablet_bootstrap.cc:654] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.787830 5296 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:55.794842 5628 tablet_bootstrap.cc:492] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.794999 5628 ts_tablet_manager.cc:1403] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.001s
I20260927 13:49:55.795786 5628 raft_consensus.cc:359] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.795981 5628 raft_consensus.cc:385] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.796059 5628 raft_consensus.cc:740] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.796329 5628 consensus_queue.cc:260] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.797312 5628 ts_tablet_manager.cc:1434] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:55.797276 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_cbf0b5fb90a54c53a85f0b44822c3ab6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:55.798081 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cbf0b5fb90a54c53a85f0b44822c3ab6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:55.800701 5628 tablet_bootstrap.cc:492] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.804593 5628 tablet_bootstrap.cc:654] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.817668 5623 ts_tablet_manager.cc:1929] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:55.822558 5628 tablet_bootstrap.cc:492] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.822703 5628 ts_tablet_manager.cc:1403] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.002s
I20260927 13:49:55.823252 5628 raft_consensus.cc:359] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.823392 5628 raft_consensus.cc:385] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.823508 5628 raft_consensus.cc:740] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.823740 5628 consensus_queue.cc:260] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.824234 5628 ts_tablet_manager.cc:1434] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 13:49:55.825073 5619 tablet_bootstrap.cc:492] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.825275 5619 ts_tablet_manager.cc:1403] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.096s user 0.033s sys 0.028s
I20260927 13:49:55.826298 5619 raft_consensus.cc:359] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.826534 5619 raft_consensus.cc:385] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.826635 5619 raft_consensus.cc:740] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.828413 5628 tablet_bootstrap.cc:492] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.828673 4921 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet a783f76f72ab445382637a6dfad73cfd
I20260927 13:49:55.828969 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 63a1fca938c34718ae541f0038b56025 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:55.829198 5619 consensus_queue.cc:260] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.829964 5619 ts_tablet_manager.cc:1434] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260927 13:49:55.830317 5619 tablet_bootstrap.cc:492] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.832883 5619 tablet_bootstrap.cc:654] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.833410 5623 log.cc:1199] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/4abe721ef8614d86870a0526de69014f
I20260927 13:49:55.834774 5623 ts_tablet_manager.cc:1950] T 4abe721ef8614d86870a0526de69014f P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:55.837112 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 4abe721ef8614d86870a0526de69014f (table default.Table_15df8518ff4f446cadb3f1c389a17954 [id=fcaf2809390c4d6c9dd836f5bfdacf40]) successfully deleted
I20260927 13:49:55.838263 5623 tablet_replica.cc:333] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:55.838507 5623 raft_consensus.cc:2243] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:55.841960 5628 tablet_bootstrap.cc:654] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.842204 5623 raft_consensus.cc:2272] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:55.845534 4928 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe] alter complete (version 3)
I20260927 13:49:55.845984 5623 ts_tablet_manager.cc:1916] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:55.826498 5626 ts_tablet_manager.cc:1434] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.054s user 0.003s sys 0.000s
I20260927 13:49:55.851368 5626 tablet_bootstrap.cc:492] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:55.852835 5626 tablet_bootstrap.cc:654] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.858443 4929 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 077d2f5c216e46bf8aaa947e83a61708
I20260927 13:49:55.858850 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6c77468a637b4f33a5122599e6ad6d5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:55.859421 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c77468a637b4f33a5122599e6ad6d5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:55.860565 5628 tablet_bootstrap.cc:492] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.860746 5628 ts_tablet_manager.cc:1403] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.000s
I20260927 13:49:55.861503 5628 raft_consensus.cc:359] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.861611 6504 log.cc:826] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Log is configured to *not* fsync() on all Append() calls
I20260927 13:49:55.861707 5628 raft_consensus.cc:385] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.861781 5628 raft_consensus.cc:740] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.862061 5628 consensus_queue.cc:260] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.862905 5628 ts_tablet_manager.cc:1434] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:55.864225 5628 tablet_bootstrap.cc:492] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.866202 5619 tablet_bootstrap.cc:492] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.866348 5619 ts_tablet_manager.cc:1403] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260927 13:49:55.866844 5628 tablet_bootstrap.cc:654] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.867063 5619 raft_consensus.cc:359] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.867219 5619 raft_consensus.cc:385] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.867648 5619 raft_consensus.cc:740] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.867915 5619 consensus_queue.cc:260] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.868476 5619 ts_tablet_manager.cc:1434] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:55.874395 5619 tablet_bootstrap.cc:492] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.875007 6511 raft_consensus.cc:493] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.875125 6511 raft_consensus.cc:515] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.875747 6511 leader_election.cc:290] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:55.877605 5619 tablet_bootstrap.cc:654] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.878134 6511 raft_consensus.cc:493] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.878252 6511 raft_consensus.cc:515] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.878824 6511 leader_election.cc:290] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:55.880103 5319 leader_election.cc:343] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 321b26c89f1a4c8d88f401c8ece448b0
W20260927 13:49:55.880486 5319 leader_election.cc:343] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 825a73d47bff4246965be82eb482f7aa
I20260927 13:49:55.891273 5628 tablet_bootstrap.cc:492] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:55.891462 5628 ts_tablet_manager.cc:1403] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.001s
I20260927 13:49:55.892338 5628 raft_consensus.cc:359] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.892542 5628 raft_consensus.cc:385] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.892643 5628 raft_consensus.cc:740] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.892938 5628 consensus_queue.cc:260] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.893935 5619 tablet_bootstrap.cc:492] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:55.894152 5619 ts_tablet_manager.cc:1403] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.000s
I20260927 13:49:55.894940 5619 raft_consensus.cc:359] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.895183 5619 raft_consensus.cc:385] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:55.895278 5619 raft_consensus.cc:740] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:55.895555 5619 consensus_queue.cc:260] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.896102 5619 ts_tablet_manager.cc:1434] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:55.902737 5619 tablet_bootstrap.cc:492] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:55.904630 5619 tablet_bootstrap.cc:654] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:55.904810 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e3f7ded9d644d749532e0700844bd62 consensus state has no leader
I20260927 13:49:55.905306 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a836a91c61ae4aa699a3e710b418f9cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:55.905977 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a836a91c61ae4aa699a3e710b418f9cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:55.907284 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0575418f5ea4d82b34112e1bc9ab8b4 consensus state has no leader
I20260927 13:49:55.907594 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e525c7913e584c6da2c8275732c10699"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:55.908030 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e525c7913e584c6da2c8275732c10699 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:55.855127 5296 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:55.867815 6344 consensus_queue.cc:1048] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:55.876545 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "321b26c89f1a4c8d88f401c8ece448b0" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.879953 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a73d47bff4246965be82eb482f7aa" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:55.922904 5319 leader_election.cc:343] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.923064 5319 leader_election.cc:304] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:49:55.923815 5319 leader_election.cc:343] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: Tablet not RUNNING: STOPPED
I20260927 13:49:55.923877 5628 ts_tablet_manager.cc:1434] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260927 13:49:55.923921 5319 leader_election.cc:304] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:55.883564 5623 ts_tablet_manager.cc:1929] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:55.924268 6145 raft_consensus.cc:2749] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.924412 5623 log.cc:1199] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/825a73d47bff4246965be82eb482f7aa
I20260927 13:49:55.924453 6145 raft_consensus.cc:2749] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.924794 5623 ts_tablet_manager.cc:1950] T 825a73d47bff4246965be82eb482f7aa P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:55.925941 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 825a73d47bff4246965be82eb482f7aa (table default.Table_de911651b6ff4188876ef1d412e041b7 [id=119de2adb4d24563b76c6099dec2d9a9]) successfully deleted
W20260927 13:49:55.926672 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a9503dd46ccf472581d1a667eea300ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9503dd46ccf472581d1a667eea300ed already in progress: creating tablet
W20260927 13:49:55.926962 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 081f18e00af74e5c811f774d29422351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 081f18e00af74e5c811f774d29422351 already in progress: creating tablet
W20260927 13:49:55.927275 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 7dc140bba42a43758fa0c6540d728275 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dc140bba42a43758fa0c6540d728275 already in progress: creating tablet
I20260927 13:49:55.924310 5628 tablet_bootstrap.cc:492] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:55.934051 5628 tablet_bootstrap.cc:654] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:55.939539 6362 raft_consensus.cc:493] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.939702 6362 raft_consensus.cc:515] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.940407 6362 leader_election.cc:290] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.941161 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730cd78c7b1a49d892a5ecb46fae0812" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.941712 5045 leader_election.cc:343] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.944137 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730cd78c7b1a49d892a5ecb46fae0812" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:55.944931 5044 leader_election.cc:343] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.945088 5044 leader_election.cc:304] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:55.945637 6362 raft_consensus.cc:2749] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:55.946069 6362 raft_consensus.cc:493] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.946267 6362 raft_consensus.cc:515] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.946915 6362 leader_election.cc:290] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.947561 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd182d7cb414f07944072b0c00ee35c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:55.948499 5045 leader_election.cc:343] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.961586 6383 raft_consensus.cc:493] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.961753 6383 raft_consensus.cc:515] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.962611 6383 leader_election.cc:290] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:55.963341 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17153df5ba20458aa0a5c0297e959810" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:55.963529 5248 raft_consensus.cc:2468] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:49:55.963742 5319 leader_election.cc:343] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 17153df5ba20458aa0a5c0297e959810
I20260927 13:49:55.963949 5319 leader_election.cc:304] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:55.964362 6383 raft_consensus.cc:2804] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:55.964481 6383 raft_consensus.cc:493] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:55.964574 6383 raft_consensus.cc:3060] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:55.968200 6383 raft_consensus.cc:515] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:55.970510 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 85130d7ea68545518ca3c255e28a20d3 consensus state has no leader
I20260927 13:49:55.970973 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_74b6e15654414f29ad685955a2c8bd3e" } new_table_name: "default.Table_be356ba34c0348f9bf24f85cddfd1e0d" modify_external_catalogs: true
I20260927 13:49:55.971562 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17153df5ba20458aa0a5c0297e959810" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:55.971750 5248 raft_consensus.cc:3060] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:55.972268 4930 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_000065d7fd1245df945d5c14cf4b881b [id=8c41592b4b4c4d4b9286336ed3c77b4b] alter complete (version 2)
W20260927 13:49:55.972419 5319 leader_election.cc:343] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 17153df5ba20458aa0a5c0297e959810
I20260927 13:49:55.972579 6383 leader_election.cc:290] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:55.972958 6362 raft_consensus.cc:493] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:55.973101 6362 raft_consensus.cc:515] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:55.973724 6362 leader_election.cc:290] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:55.974727 5248 raft_consensus.cc:2468] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:55.975191 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a1f13b31934baa8ce18fc499e94806" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:55.975679 5319 leader_election.cc:304] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
W20260927 13:49:55.975755 5045 leader_election.cc:343] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:55.976092 6383 raft_consensus.cc:2804] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:55.976392 6383 raft_consensus.cc:697] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:55.976774 6383 consensus_queue.cc:237] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:55.979334 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 80b1970a344045389709260c850adc07 with delete_type TABLET_DATA_DELETED (replaced by tablet 081f18e00af74e5c811f774d29422351) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:55.979961 5606 tablet_replica.cc:333] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:55.980156 5606 raft_consensus.cc:2243] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:55.980299 5606 raft_consensus.cc:2272] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:55.980826 5606 ts_tablet_manager.cc:1916] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:55.989691 5606 ts_tablet_manager.cc:1929] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.013048 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd182d7cb414f07944072b0c00ee35c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:56.014158 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a1f13b31934baa8ce18fc499e94806" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:56.014743 5044 leader_election.cc:343] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.014914 5044 leader_election.cc:304] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.015573 6362 raft_consensus.cc:2749] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:56.016119 5044 leader_election.cc:343] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.016237 5044 leader_election.cc:304] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.017148 6362 raft_consensus.cc:2749] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:56.017493 4754 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 65912.4us
I20260927 13:49:56.019238 5628 tablet_bootstrap.cc:492] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:56.019439 5628 ts_tablet_manager.cc:1403] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.095s user 0.000s sys 0.003s
I20260927 13:49:56.020272 5628 raft_consensus.cc:359] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.020475 5628 raft_consensus.cc:385] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.020577 5628 raft_consensus.cc:740] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.020958 5626 tablet_bootstrap.cc:492] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:56.020970 5628 consensus_queue.cc:260] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.021147 5626 ts_tablet_manager.cc:1403] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.170s user 0.002s sys 0.001s
I20260927 13:49:56.021944 5626 raft_consensus.cc:359] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.022234 5628 ts_tablet_manager.cc:1434] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260927 13:49:56.022421 5626 raft_consensus.cc:385] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.022548 5626 raft_consensus.cc:740] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.022890 5626 consensus_queue.cc:260] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.025781 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_21196f9a14bf484fa4aef8a72ac91da6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.026433 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21196f9a14bf484fa4aef8a72ac91da6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.027941 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_0480d2e07b2843fdb6ea6e57d134ac20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.028573 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0480d2e07b2843fdb6ea6e57d134ac20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.039872 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 63a1fca938c34718ae541f0038b56025
I20260927 13:49:56.040467 4921 catalog_manager.cc:6934] ReplaceTablet: tablet 63a1fca938c34718ae541f0038b56025 deleted and replaced by tablet 3002129c9c744881b21da22ddee86589
I20260927 13:49:56.047303 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a1fca938c34718ae541f0038b56025 with delete_type TABLET_DATA_DELETED (replaced by tablet 3002129c9c744881b21da22ddee86589) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.048779 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a1fca938c34718ae541f0038b56025 with delete_type TABLET_DATA_DELETED (replaced by tablet 3002129c9c744881b21da22ddee86589) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:56.049460 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 63a1fca938c34718ae541f0038b56025 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63a1fca938c34718ae541f0038b56025 already in progress: creating tablet
I20260927 13:49:56.050815 6535 consensus_queue.cc:1048] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:56.052142 5619 tablet_bootstrap.cc:492] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:56.052289 5619 ts_tablet_manager.cc:1403] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.150s user 0.021s sys 0.051s
I20260927 13:49:56.053296 5619 raft_consensus.cc:359] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.053514 5619 raft_consensus.cc:385] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.053591 5619 raft_consensus.cc:740] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.053843 6362 raft_consensus.cc:493] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.053864 5619 consensus_queue.cc:260] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.054028 6362 raft_consensus.cc:515] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.054376 5619 ts_tablet_manager.cc:1434] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:49:56.054641 5619 tablet_bootstrap.cc:492] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:56.054734 6362 leader_election.cc:290] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.055344 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3933c0a2fd6547f28528fae7d443a2c1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.055717 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a1fca938c34718ae541f0038b56025 with delete_type TABLET_DATA_DELETED (replaced by tablet 3002129c9c744881b21da22ddee86589) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:56.056089 5045 leader_election.cc:343] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.056339 6493 tablet_replica.cc:333] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:56.056571 6493 raft_consensus.cc:2243] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.056739 6493 raft_consensus.cc:2272] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.057178 5619 tablet_bootstrap.cc:654] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.057235 6493 ts_tablet_manager.cc:1916] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.066692 6493 ts_tablet_manager.cc:1929] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.066912 6493 log.cc:1199] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/63a1fca938c34718ae541f0038b56025
I20260927 13:49:56.070139 5619 tablet_bootstrap.cc:492] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:56.070199 6362 raft_consensus.cc:493] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.070307 5619 ts_tablet_manager.cc:1403] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.004s
I20260927 13:49:56.070312 6362 raft_consensus.cc:515] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.070923 6362 leader_election.cc:290] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.071106 5619 raft_consensus.cc:359] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.071267 5619 raft_consensus.cc:385] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.071319 5619 raft_consensus.cc:740] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.071524 5619 consensus_queue.cc:260] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.072389 6362 raft_consensus.cc:493] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.072472 5619 ts_tablet_manager.cc:1434] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:56.072526 6362 raft_consensus.cc:515] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.072715 5619 tablet_bootstrap.cc:492] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:56.073441 6362 leader_election.cc:290] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.074170 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ea9d56ff62de487fb4f0291ecb728711"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.074977 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea9d56ff62de487fb4f0291ecb728711 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.081151 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3933c0a2fd6547f28528fae7d443a2c1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:56.081858 6532 raft_consensus.cc:493] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.082042 6532 raft_consensus.cc:515] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.082517 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c810fde988439c97a8445fc88626b3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:56.083359 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "351132ca12924a35910ca5473696a02f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:56.083559 5107 raft_consensus.cc:2468] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:56.084566 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8bf79954c2429f886ac7afc9a8455f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:56.084868 5184 leader_election.cc:304] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:56.085566 6524 raft_consensus.cc:2804] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260927 13:49:56.085563 5044 leader_election.cc:343] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.085649 6524 raft_consensus.cc:493] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:56.085666 5044 leader_election.cc:304] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.085719 6524 raft_consensus.cc:3060] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.086040 6362 raft_consensus.cc:2749] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:56.087391 5044 leader_election.cc:343] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:56.087908 5044 leader_election.cc:343] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.088539 6524 raft_consensus.cc:515] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.089138 6524 leader_election.cc:290] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.089540 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "351132ca12924a35910ca5473696a02f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:56.089705 5107 raft_consensus.cc:3060] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.089736 5626 ts_tablet_manager.cc:1434] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.068s user 0.000s sys 0.002s
I20260927 13:49:56.090039 5626 tablet_bootstrap.cc:492] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:56.091691 5626 tablet_bootstrap.cc:654] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.092507 5107 raft_consensus.cc:2468] T 351132ca12924a35910ca5473696a02f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:56.092839 5184 leader_election.cc:304] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:56.093608 6524 raft_consensus.cc:2804] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:56.094563 6524 raft_consensus.cc:697] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:56.094893 6524 consensus_queue.cc:237] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.098529 5628 tablet_bootstrap.cc:492] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:56.098973 6362 raft_consensus.cc:493] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.099181 6362 raft_consensus.cc:515] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.100263 6362 leader_election.cc:290] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.100795 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fa4870d5547a2bbffe1745b964504" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:56.101284 5044 leader_election.cc:343] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.110169 6532 leader_election.cc:290] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.112169 5628 tablet_bootstrap.cc:654] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:56.117451 4916 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 931a48792f4c4525bd563a4dd1062e35 (table default.Table_3b7666d87acf47bda3e3e2545c8cfb25 [id=bed97aef149a417bb3807414f58ba52a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 931a48792f4c4525bd563a4dd1062e35 consensus state has no leader
I20260927 13:49:56.119144 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8bf79954c2429f886ac7afc9a8455f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.118798 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c810fde988439c97a8445fc88626b3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.120347 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "351132ca12924a35910ca5473696a02f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.120505 5385 raft_consensus.cc:2468] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:56.121483 6383 raft_consensus.cc:493] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.121630 5619 tablet_bootstrap.cc:654] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.121779 6383 raft_consensus.cc:515] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.125980 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fa4870d5547a2bbffe1745b964504" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.126507 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "351132ca12924a35910ca5473696a02f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:56.129021 5384 raft_consensus.cc:3060] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.130146 6543 tablet.cc:1751] T cc6af9b33f0c464683e40adc28037bc8 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:56.118216 6362 raft_consensus.cc:493] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:49:56.119825 5045 leader_election.cc:343] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.131148 5045 leader_election.cc:304] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:56.131588 5045 leader_election.cc:343] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:56.131680 5319 leader_election.cc:343] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 4abe721ef8614d86870a0526de69014f
I20260927 13:49:56.131696 5045 leader_election.cc:304] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:56.132050 5045 leader_election.cc:343] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.132134 5045 leader_election.cc:304] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.132440 6365 raft_consensus.cc:2749] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.132623 6365 raft_consensus.cc:2749] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.132756 6365 raft_consensus.cc:2749] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.133158 6362 raft_consensus.cc:515] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.134339 6362 leader_election.cc:290] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.126796 6542 tablet.cc:1751] T cc6af9b33f0c464683e40adc28037bc8 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260927 13:49:56.141803 5319 leader_election.cc:343] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 4abe721ef8614d86870a0526de69014f
I20260927 13:49:56.142028 6383 leader_election.cc:290] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.142534 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0361e3b244a1437b8e402dd8602528fe" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:56.145517 5044 leader_election.cc:343] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.146211 5319 leader_election.cc:304] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:56.146577 5384 raft_consensus.cc:2468] T 351132ca12924a35910ca5473696a02f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:56.150765 6145 raft_consensus.cc:2749] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.156455 5606 log.cc:1199] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/80b1970a344045389709260c850adc07
I20260927 13:49:56.156804 5606 ts_tablet_manager.cc:1950] T 80b1970a344045389709260c850adc07 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.157356 5432 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:56.157871 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 80b1970a344045389709260c850adc07 (table default.Table_92bf3a9fa895485597b7f5cda3251baf [id=5900f338a23b46e8a487ec9cfa08b8a8]) successfully deleted
I20260927 13:49:56.159864 5606 tablet_replica.cc:333] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.160121 5606 raft_consensus.cc:2243] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.160349 5606 raft_consensus.cc:2272] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.161334 5606 ts_tablet_manager.cc:1916] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.161671 5626 tablet_bootstrap.cc:492] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:56.161862 5626 ts_tablet_manager.cc:1403] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.002s
I20260927 13:49:56.162786 6383 raft_consensus.cc:493] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.162961 6383 raft_consensus.cc:515] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.164260 5626 raft_consensus.cc:359] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.164600 5626 raft_consensus.cc:385] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.164690 5626 raft_consensus.cc:740] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
W20260927 13:49:56.165004 5319 leader_election.cc:343] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f70b70eb29cb4361a12ed393eabb82e1
I20260927 13:49:56.164948 5626 consensus_queue.cc:260] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.165226 6383 leader_election.cc:290] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.165987 5626 ts_tablet_manager.cc:1434] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:49:56.178201 6543 tablet.cc:1751] T 9a35fefc73c54d6c9b1907f55add7b92 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260927 13:49:56.179567 4754 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 82668.6us
I20260927 13:49:56.184665 5606 ts_tablet_manager.cc:1929] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.184791 5606 log.cc:1199] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/63a1fca938c34718ae541f0038b56025
I20260927 13:49:56.185102 5606 ts_tablet_manager.cc:1950] T 63a1fca938c34718ae541f0038b56025 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.186218 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 63a1fca938c34718ae541f0038b56025 (table default.Table_69a87aa5933f49eaaa3085e0b505f5ca [id=97c4d9da0cc54c3d842a2001313e9a8a]) successfully deleted
I20260927 13:49:56.189162 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet da75a470ec0c4ec9afa7c18a51cd7276 from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:56.192472 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e3b98290dc74d88856e13f003a1e4c7 consensus state has no leader
I20260927 13:49:56.192641 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5b53995279b344879742a29046c07039" } modify_external_catalogs: true
I20260927 13:49:56.192793 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8a9f7c16b9ec4d10848c2bb0c661fe27" } modify_external_catalogs: true
I20260927 13:49:56.192821 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5b53995279b344879742a29046c07039" } modify_external_catalogs: true
I20260927 13:49:56.192942 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8a9f7c16b9ec4d10848c2bb0c661fe27" } modify_external_catalogs: true
I20260927 13:49:56.193778 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ed2fe75361bf46b9ab3ed0222e2758f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:56.194365 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70b70eb29cb4361a12ed393eabb82e1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:56.194548 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed2fe75361bf46b9ab3ed0222e2758f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.194589 5248 raft_consensus.cc:2468] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:56.195094 5319 leader_election.cc:304] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:56.195592 6383 raft_consensus.cc:2804] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:56.195683 6383 raft_consensus.cc:493] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:56.195760 6383 raft_consensus.cc:3060] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.197847 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_06ee1270c5734798871c56d5e91a8a1d" } modify_external_catalogs: true
I20260927 13:49:56.198091 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_06ee1270c5734798871c56d5e91a8a1d" } modify_external_catalogs: true
I20260927 13:49:56.199088 6383 raft_consensus.cc:515] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.199892 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_b10075ed74e549249e8a79bac26e367c" } new_table_name: "default.Table_05fe23910876400aa7273b1f5e5f84e9" modify_external_catalogs: true
I20260927 13:49:56.200567 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70b70eb29cb4361a12ed393eabb82e1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:56.200791 5245 raft_consensus.cc:3060] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.204942 5245 raft_consensus.cc:2468] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:56.205582 5319 leader_election.cc:304] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:56.205879 6145 raft_consensus.cc:2804] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:56.206001 6145 raft_consensus.cc:697] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:56.206264 6145 consensus_queue.cc:237] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.206450 5619 tablet_bootstrap.cc:492] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:56.206553 5619 ts_tablet_manager.cc:1403] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.134s user 0.004s sys 0.027s
I20260927 13:49:56.207265 5619 raft_consensus.cc:359] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.207407 5619 raft_consensus.cc:385] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.207450 5619 raft_consensus.cc:740] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.207669 5619 consensus_queue.cc:260] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.208436 5619 ts_tablet_manager.cc:1434] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:56.208531 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 08798185a7c641f98d7dc6a6b1b72e0a from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:56.208815 5619 tablet_bootstrap.cc:492] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:56.211238 5619 tablet_bootstrap.cc:654] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.214975 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_0b1ea5a791894bfebc59ed28e5506e20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.215719 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b1ea5a791894bfebc59ed28e5506e20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:56.219231 5319 leader_election.cc:343] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f70b70eb29cb4361a12ed393eabb82e1
I20260927 13:49:56.219393 6383 leader_election.cc:290] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.222366 6551 tablet.cc:1751] T 9a35fefc73c54d6c9b1907f55add7b92 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260927 13:49:56.223517 5045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 91459.4us
I20260927 13:49:56.224238 6383 raft_consensus.cc:493] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.224361 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_07ff9b27d4c84273a02178c5797cadb9" } modify_external_catalogs: true
I20260927 13:49:56.224349 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0361e3b244a1437b8e402dd8602528fe" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.224555 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_07ff9b27d4c84273a02178c5797cadb9" } modify_external_catalogs: true
W20260927 13:49:56.225636 5045 leader_election.cc:343] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.224519 6383 raft_consensus.cc:515] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.227016 6383 leader_election.cc:290] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.227963 5626 tablet_bootstrap.cc:492] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:56.228053 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a443f65eba384b998fdc57ec57e37d87" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:56.228283 5107 raft_consensus.cc:2468] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:56.230418 5626 tablet_bootstrap.cc:654] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.236737 5319 leader_election.cc:304] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:56.237040 6383 raft_consensus.cc:2804] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:56.237130 6383 raft_consensus.cc:493] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:56.237203 6383 raft_consensus.cc:3060] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.239930 4926 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 4cb71dd1785841b1b031cb09422a505d
I20260927 13:49:56.240278 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_030e35baedc24808830ae3843591a919" } modify_external_catalogs: true
I20260927 13:49:56.240444 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_030e35baedc24808830ae3843591a919" } modify_external_catalogs: true
I20260927 13:49:56.241382 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a443f65eba384b998fdc57ec57e37d87" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:56.241608 5245 raft_consensus.cc:2468] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:56.245036 5619 tablet_bootstrap.cc:492] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:56.245163 5619 ts_tablet_manager.cc:1403] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.003s
I20260927 13:49:56.245779 6383 raft_consensus.cc:515] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.245822 5619 raft_consensus.cc:359] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.245942 5619 raft_consensus.cc:385] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.245985 5619 raft_consensus.cc:740] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.246200 5619 consensus_queue.cc:260] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.247057 5619 ts_tablet_manager.cc:1434] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:49:56.247402 5619 tablet_bootstrap.cc:492] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:56.247570 6383 leader_election.cc:290] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.248260 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a443f65eba384b998fdc57ec57e37d87" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:56.248450 5107 raft_consensus.cc:3060] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.249357 5619 tablet_bootstrap.cc:654] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.251524 5107 raft_consensus.cc:2468] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:56.252066 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a443f65eba384b998fdc57ec57e37d87" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:56.252113 5319 leader_election.cc:304] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:56.252307 5245 raft_consensus.cc:3060] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.252336 6145 raft_consensus.cc:493] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.252496 6145 raft_consensus.cc:515] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.253053 6145 leader_election.cc:290] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.253258 6145 raft_consensus.cc:2804] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:56.253518 6145 raft_consensus.cc:697] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:56.253808 6145 consensus_queue.cc:237] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.255620 5245 raft_consensus.cc:2468] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:56.255851 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2329b988f5d9410d96eca321a7b8f3a6" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:56.256062 5247 raft_consensus.cc:2468] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:56.256606 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 76a397300cdd44eb899f2ef5b9fe8c09 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:56.256731 5319 leader_election.cc:304] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:49:56.257102 5319 leader_election.cc:343] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2329b988f5d9410d96eca321a7b8f3a6
I20260927 13:49:56.257339 6383 raft_consensus.cc:2804] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:56.257445 6383 raft_consensus.cc:493] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:56.257532 6383 raft_consensus.cc:3060] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.260250 6383 raft_consensus.cc:515] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.260820 6383 leader_election.cc:290] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.261657 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2329b988f5d9410d96eca321a7b8f3a6" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:56.261804 5247 raft_consensus.cc:3060] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.265761 5247 raft_consensus.cc:2468] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:56.266592 5619 tablet_bootstrap.cc:492] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
W20260927 13:49:56.267735 5319 leader_election.cc:343] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2329b988f5d9410d96eca321a7b8f3a6
I20260927 13:49:56.268749 5319 leader_election.cc:304] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:56.269317 6511 raft_consensus.cc:2804] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:56.268567 5619 ts_tablet_manager.cc:1403] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.007s
I20260927 13:49:56.270782 5619 raft_consensus.cc:359] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.270936 5619 raft_consensus.cc:385] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.270989 5619 raft_consensus.cc:740] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.272336 5619 consensus_queue.cc:260] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.273463 5619 ts_tablet_manager.cc:1434] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:49:56.275151 5619 tablet_bootstrap.cc:492] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:56.276605 5619 tablet_bootstrap.cc:654] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.280768 4927 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cc6af9b33f0c464683e40adc28037bc8 (table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec]). Expected version 1 got 0
I20260927 13:49:56.281157 4927 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a443f65eba384b998fdc57ec57e37d87 (table default.Table_43b89b55155b4b51ab4b271a93f30d59 [id=f7a31bf57f1245cab85dd2c38d85c79f]). Expected version 2 got 0
I20260927 13:49:56.281435 4927 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d9ff32095a554784b91e74012ad8e020 (table default.Table_7567474623ce4d588bb654dc21623cb6 [id=112cd821498b427fb3b0d517cd0d55f3]). Expected version 1 got 0
I20260927 13:49:56.281953 4928 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2] alter complete (version 1)
W20260927 13:49:56.282742 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cbacda63c0d3427aabf3332b278576c5 consensus state has no leader
I20260927 13:49:56.283197 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1644e061770e4453a64e74d48c0cd703" } new_table_name: "default.Table_8e30f259d16146d18136753eb1805e15" modify_external_catalogs: true
W20260927 13:49:56.286057 4930 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.65:47495 (request call id 93) took 954 ms (client timeout 1000 ms). Trace:
I20260927 13:49:56.286368 6377 raft_consensus.cc:493] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.286515 6377 raft_consensus.cc:515] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.286955 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 370553521753488ab81e40144f2536ae
W20260927 13:49:56.286183 4930 rpcz_store.cc:269] 0927 13:49:55.331246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:55.357732 (+ 26486us) service_pool.cc:224] Handling call
0927 13:49:56.285995 (+928263us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:49:55.656798 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:55.660526 (+ 3728us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:55.660530 (+ 4us) write_op.cc:435] Acquired schema lock
0927 13:49:55.660532 (+ 2us) tablet.cc:662] Decoding operations
0927 13:49:55.660629 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:55.660639 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:55.660644 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:49:55.660698 (+ 54us) tablet.cc:701] Row locks acquired
0927 13:49:55.660700 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:49:55.660731 (+ 31us) write_op.cc:270] Start()
0927 13:49:55.660758 (+ 27us) write_op.cc:276] Timestamp: P: 1790516995660689 usec, L: 0
0927 13:49:55.660762 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:49:55.660925 (+ 163us) log.cc:844] Serialized 356 byte log entry
0927 13:49:55.664358 (+ 3433us) op_driver.cc:464] REPLICATION: finished
0927 13:49:55.668643 (+ 4285us) write_op.cc:301] APPLY: starting
0927 13:49:55.668658 (+ 15us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:55.668691 (+ 33us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:55.668713 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:55.668757 (+ 44us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:55.668790 (+ 33us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:55.668801 (+ 11us) write_op.cc:312] APPLY: finished
0927 13:49:55.668944 (+ 143us) log.cc:844] Serialized 23 byte log entry
0927 13:49:55.669008 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:55.669024 (+ 16us) write_op.cc:454] Released schema lock
0927 13:49:55.669030 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:55.670986 (+ 1956us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:55.670991 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0927 13:49:55.939452 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:55.939557 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:55.939563 (+ 6us) write_op.cc:435] Acquired schema lock
0927 13:49:55.939565 (+ 2us) tablet.cc:662] Decoding operations
0927 13:49:55.939647 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:55.939656 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:55.939662 (+ 6us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:49:55.939719 (+ 57us) tablet.cc:701] Row locks acquired
0927 13:49:55.939724 (+ 5us) write_op.cc:260] PREPARE: finished
0927 13:49:55.939759 (+ 35us) write_op.cc:270] Start()
0927 13:49:55.939794 (+ 35us) write_op.cc:276] Timestamp: P: 1790516995939731 usec, L: 0
0927 13:49:55.939800 (+ 6us) op_driver.cc:348] REPLICATION: starting
0927 13:49:55.968306 (+ 28506us) log.cc:844] Serialized 356 byte log entry
0927 13:49:55.969290 (+ 984us) op_driver.cc:464] REPLICATION: finished
0927 13:49:55.969863 (+ 573us) write_op.cc:301] APPLY: starting
0927 13:49:55.969873 (+ 10us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:55.969897 (+ 24us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:55.969916 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:55.969949 (+ 33us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:55.969971 (+ 22us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:55.969977 (+ 6us) write_op.cc:312] APPLY: finished
0927 13:49:55.970018 (+ 41us) log.cc:844] Serialized 23 byte log entry
0927 13:49:55.970047 (+ 29us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:55.970058 (+ 11us) write_op.cc:454] Released schema lock
0927 13:49:55.970063 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:56.002300 (+ 32237us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:56.002313 (+ 13us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":4230,"apply.run_cpu_time_us":424,"apply.run_wall_time_us":2332,"num_ops":1,"prepare.queue_time_us":122998,"prepare.run_cpu_time_us":647,"prepare.run_wall_time_us":6622,"raft.queue_time_us":68,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":213,"replication_time_us":3568}],["op",{"apply.queue_time_us":541,"apply.run_cpu_time_us":243,"apply.run_wall_time_us":243,"num_ops":1,"prepare.queue_time_us":268916,"prepare.run_cpu_time_us":771,"prepare.run_wall_time_us":62799,"raft.queue_time_us":1631,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":364,"replication_time_us":29466}]]}
I20260927 13:49:56.287321 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_977d1a0483e64f658c2eaead2cc16803" } new_table_name: "default.Table_a9dac2f42b2c4641b1d1235ec0f377f2" modify_external_catalogs: true
I20260927 13:49:56.287456 6377 leader_election.cc:290] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.287636 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7567474623ce4d588bb654dc21623cb6" } new_table_name: "default.Table_ee7a89c46e4f454fb0922cafbc796e8e" modify_external_catalogs: true
I20260927 13:49:56.289219 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3700a1f40c0644848da62392cb0c297f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:56.289718 5044 leader_election.cc:343] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.289949 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 370553521753488ab81e40144f2536ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.290436 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 6817fb4caf6a445b899830c6702bf911 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bd182d7cb414f07944072b0c00ee35c) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.290649 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 2329b988f5d9410d96eca321a7b8f3a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ac23ce85393457e8fd5402a9e0f55cb) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:56.290652 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 370553521753488ab81e40144f2536ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 370553521753488ab81e40144f2536ae already in progress: creating tablet
I20260927 13:49:56.290831 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 370553521753488ab81e40144f2536ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.291069 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet efd31e3dd142413c92fce2043e053d32 with delete_type TABLET_DATA_DELETED (replaced by tablet 11d48db9b20a41419d5be703190fadd8) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.291244 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e3fa4870d5547a2bbffe1745b964504 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.291410 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cec272546cb4373bf69e3ab344c46e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.291489 5619 tablet_bootstrap.cc:492] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:56.291561 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e0e8d6bc744d69a9f41d45459d3b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.291608 5619 ts_tablet_manager.cc:1403] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.001s
I20260927 13:49:56.292011 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet 370553521753488ab81e40144f2536ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.292418 5623 tablet_replica.cc:333] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:56.292337 5619 raft_consensus.cc:359] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.292538 5619 raft_consensus.cc:385] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.292598 5619 raft_consensus.cc:740] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.292601 5623 raft_consensus.cc:2243] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.292745 5623 raft_consensus.cc:2272] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.292814 5619 consensus_queue.cc:260] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.293284 5623 ts_tablet_manager.cc:1916] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.293366 5619 ts_tablet_manager.cc:1434] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:56.293653 5619 tablet_bootstrap.cc:492] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:56.295639 5619 tablet_bootstrap.cc:654] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.296875 5628 tablet_bootstrap.cc:492] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:56.297008 5628 ts_tablet_manager.cc:1403] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.274s user 0.004s sys 0.000s
I20260927 13:49:56.297983 5628 raft_consensus.cc:359] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.298168 5628 raft_consensus.cc:385] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.298225 5628 raft_consensus.cc:740] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.298521 5628 consensus_queue.cc:260] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.299005 5628 ts_tablet_manager.cc:1434] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:56.299305 5628 tablet_bootstrap.cc:492] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:56.300889 5628 tablet_bootstrap.cc:654] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.301334 5623 ts_tablet_manager.cc:1929] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.301445 5623 log.cc:1199] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/2329b988f5d9410d96eca321a7b8f3a6
I20260927 13:49:56.301738 5623 ts_tablet_manager.cc:1950] T 2329b988f5d9410d96eca321a7b8f3a6 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
W20260927 13:49:56.304816 4928 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.66:59195 (request call id 109) took 770 ms (client timeout 1000 ms). Trace:
W20260927 13:49:56.304980 4928 rpcz_store.cc:269] 0927 13:49:55.534391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:55.559905 (+ 25514us) service_pool.cc:224] Handling call
0927 13:49:56.304767 (+744862us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:49:55.820139 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:55.820293 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:55.820303 (+ 10us) write_op.cc:435] Acquired schema lock
0927 13:49:55.820308 (+ 5us) tablet.cc:662] Decoding operations
0927 13:49:55.821739 (+ 1431us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:55.821752 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:55.821756 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:49:55.821820 (+ 64us) tablet.cc:701] Row locks acquired
0927 13:49:55.821822 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:49:55.821860 (+ 38us) write_op.cc:270] Start()
0927 13:49:55.821891 (+ 31us) write_op.cc:276] Timestamp: P: 1790516995821800 usec, L: 0
0927 13:49:55.821895 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:49:55.822063 (+ 168us) log.cc:844] Serialized 356 byte log entry
0927 13:49:55.843808 (+ 21745us) op_driver.cc:464] REPLICATION: finished
0927 13:49:55.845026 (+ 1218us) write_op.cc:301] APPLY: starting
0927 13:49:55.845042 (+ 16us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:55.845075 (+ 33us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:55.845101 (+ 26us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:55.845152 (+ 51us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:55.845180 (+ 28us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:55.845187 (+ 7us) write_op.cc:312] APPLY: finished
0927 13:49:55.845249 (+ 62us) log.cc:844] Serialized 23 byte log entry
0927 13:49:55.845311 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:55.845330 (+ 19us) write_op.cc:454] Released schema lock
0927 13:49:55.845336 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:55.846761 (+ 1425us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:55.846768 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0927 13:49:56.076738 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:56.076872 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:56.076876 (+ 4us) write_op.cc:435] Acquired schema lock
0927 13:49:56.076879 (+ 3us) tablet.cc:662] Decoding operations
0927 13:49:56.076994 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:56.077009 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:56.077017 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:49:56.077108 (+ 91us) tablet.cc:701] Row locks acquired
0927 13:49:56.077112 (+ 4us) write_op.cc:260] PREPARE: finished
0927 13:49:56.077153 (+ 41us) write_op.cc:270] Start()
0927 13:49:56.077190 (+ 37us) write_op.cc:276] Timestamp: P: 1790516996077112 usec, L: 0
0927 13:49:56.077196 (+ 6us) op_driver.cc:348] REPLICATION: starting
0927 13:49:56.077436 (+ 240us) log.cc:844] Serialized 356 byte log entry
0927 13:49:56.083894 (+ 6458us) op_driver.cc:464] REPLICATION: finished
0927 13:49:56.084148 (+ 254us) write_op.cc:301] APPLY: starting
0927 13:49:56.084169 (+ 21us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:56.084222 (+ 53us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:56.084257 (+ 35us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:56.084318 (+ 61us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:56.084365 (+ 47us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:56.084391 (+ 26us) write_op.cc:312] APPLY: finished
0927 13:49:56.084479 (+ 88us) log.cc:844] Serialized 23 byte log entry
0927 13:49:56.084548 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:56.084571 (+ 23us) write_op.cc:454] Released schema lock
0927 13:49:56.084580 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:56.087664 (+ 3084us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:56.087671 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21771,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":1171,"apply.run_cpu_time_us":365,"apply.run_wall_time_us":366,"num_ops":1,"prepare.queue_time_us":254410,"prepare.run_cpu_time_us":877,"prepare.run_wall_time_us":26623,"raft.queue_time_us":4475,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"replication_time_us":21885}],["op",{"apply.queue_time_us":193,"apply.run_cpu_time_us":507,"apply.run_wall_time_us":506,"num_ops":1,"prepare.queue_time_us":230242,"prepare.run_cpu_time_us":830,"prepare.run_wall_time_us":10924,"raft.queue_time_us":39,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":824,"replication_time_us":6660}]]}
I20260927 13:49:56.306195 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_cf41b07a629f42719692319b42490645"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:56.306514 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 614f1af61461466da975bea681162727
W20260927 13:49:56.306859 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf41b07a629f42719692319b42490645 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.307289 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a2b9f6b30ac74767998e48a73f5a97db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.307753 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2b9f6b30ac74767998e48a73f5a97db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:56.308930 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 6817fb4caf6a445b899830c6702bf911 because the tablet was not found. No further retry: Not found: Tablet not found: 6817fb4caf6a445b899830c6702bf911
I20260927 13:49:56.309211 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 76a397300cdd44eb899f2ef5b9fe8c09
I20260927 13:49:56.309233 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 614f1af61461466da975bea681162727 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.309616 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 614f1af61461466da975bea681162727 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.309710 4921 catalog_manager.cc:6934] ReplaceTablet: tablet 76a397300cdd44eb899f2ef5b9fe8c09 deleted and replaced by tablet 9858d2c788f54e30b67c1235af8f51af
I20260927 13:49:56.309854 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 17153df5ba20458aa0a5c0297e959810 with delete_type TABLET_DATA_DELETED (replaced by tablet 352e564866a747798ad44218133844ba) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.309899 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet bb6073174dbb4ca1933685b7bd3a22e1 from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:56.310391 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 614f1af61461466da975bea681162727 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 614f1af61461466da975bea681162727 already in progress: creating tablet
I20260927 13:49:56.310468 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 76a397300cdd44eb899f2ef5b9fe8c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 9858d2c788f54e30b67c1235af8f51af) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.310825 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet 614f1af61461466da975bea681162727 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:56.311316 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 76a397300cdd44eb899f2ef5b9fe8c09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76a397300cdd44eb899f2ef5b9fe8c09 already in progress: creating tablet
I20260927 13:49:56.312383 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 76a397300cdd44eb899f2ef5b9fe8c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 9858d2c788f54e30b67c1235af8f51af) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.313644 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet 76a397300cdd44eb899f2ef5b9fe8c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 9858d2c788f54e30b67c1235af8f51af) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.318848 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a1fca938c34718ae541f0038b56025 with delete_type TABLET_DATA_DELETED (replaced by tablet 3002129c9c744881b21da22ddee86589) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.318923 5157 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:56.319023 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 17153df5ba20458aa0a5c0297e959810 with delete_type TABLET_DATA_DELETED (replaced by tablet 352e564866a747798ad44218133844ba) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.318910 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet f70b70eb29cb4361a12ed393eabb82e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.319288 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5dfa3e80454463908df19a49454764 with delete_type TABLET_DATA_DELETED (replaced by tablet a813939920244be781d546311fe8a33e) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.319408 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet b5cc71e06eb743d2b63e056e88a6498f with delete_type TABLET_DATA_DELETED (replaced by tablet cbacda63c0d3427aabf3332b278576c5) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.319478 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 6817fb4caf6a445b899830c6702bf911 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bd182d7cb414f07944072b0c00ee35c) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.319641 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 559ac90ef36d406881dc17ade0560044 with delete_type TABLET_DATA_DELETED (replaced by tablet 3afb800e7ff44aadaed8f8d85aa9efe2) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.319690 5606 tablet_replica.cc:333] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.319796 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet 321b26c89f1a4c8d88f401c8ece448b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.319854 5606 raft_consensus.cc:2243] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:56.319969 5346 tablet_service.cc:1558] Processing DeleteTablet for tablet 2329b988f5d9410d96eca321a7b8f3a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ac23ce85393457e8fd5402a9e0f55cb) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.320093 5606 pending_rounds.cc:70] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:56.320114 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 4abe721ef8614d86870a0526de69014f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.320142 5606 pending_rounds.cc:77] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957615528431616 op_type: NO_OP noop_request { }
I20260927 13:49:56.320230 5606 raft_consensus.cc:2889] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:56.320262 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 825a73d47bff4246965be82eb482f7aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.320298 5606 raft_consensus.cc:2272] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:56.320746 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 63a1fca938c34718ae541f0038b56025 because the tablet was not found. No further retry: Not found: Tablet not found: 63a1fca938c34718ae541f0038b56025
I20260927 13:49:56.321337 5606 ts_tablet_manager.cc:1916] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.321429 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 80b1970a344045389709260c850adc07 with delete_type TABLET_DATA_DELETED (replaced by tablet 081f18e00af74e5c811f774d29422351) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.323777 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 2329b988f5d9410d96eca321a7b8f3a6 (table default.Table_812430ef8c1c4462ae6a6663805f50b8 [id=24cbb4b2dc904080a522c768da9ebe68]) successfully deleted
I20260927 13:49:56.328787 4927 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a443f65eba384b998fdc57ec57e37d87 (table default.Table_43b89b55155b4b51ab4b271a93f30d59 [id=f7a31bf57f1245cab85dd2c38d85c79f]). Expected version 2 got 0
I20260927 13:49:56.330427 5214 tablet_service.cc:1511] Processing CreateTablet for tablet df8ebcb238c846729e2c27e4449bfb47 (DEFAULT_TABLE table=default.Table_c8c6fcc62dfb4536957573f7a410a94a [id=27533fd9eddb45e5afc90177ac5e78a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.330879 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8ebcb238c846729e2c27e4449bfb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.330938 5606 ts_tablet_manager.cc:1929] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:56.331044 5606 log.cc:1199] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/17153df5ba20458aa0a5c0297e959810
I20260927 13:49:56.331408 5606 ts_tablet_manager.cc:1950] T 17153df5ba20458aa0a5c0297e959810 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.332067 5606 tablet_replica.cc:333] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.332244 5606 raft_consensus.cc:2243] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:56.332475 5606 pending_rounds.cc:70] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:56.332525 5606 pending_rounds.cc:77] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957616463388672 op_type: NO_OP noop_request { }
I20260927 13:49:56.332612 5606 raft_consensus.cc:2889] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:56.332688 5606 raft_consensus.cc:2272] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.332911 6511 raft_consensus.cc:697] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:56.333184 6511 consensus_queue.cc:237] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.333534 5606 ts_tablet_manager.cc:1916] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.332002 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 17153df5ba20458aa0a5c0297e959810 (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]) successfully deleted
I20260927 13:49:56.334522 4927 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d9ff32095a554784b91e74012ad8e020 (table default.Table_7567474623ce4d588bb654dc21623cb6 [id=112cd821498b427fb3b0d517cd0d55f3]). Expected version 1 got 0
I20260927 13:49:56.225814 5045 leader_election.cc:304] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:56.335103 5045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 109462us
I20260927 13:49:56.334914 4927 catalog_manager.cc:5838] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
W20260927 13:49:56.336354 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 370553521753488ab81e40144f2536ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 370553521753488ab81e40144f2536ae already in progress: creating tablet
W20260927 13:49:56.336647 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 614f1af61461466da975bea681162727 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 614f1af61461466da975bea681162727 already in progress: creating tablet
I20260927 13:49:56.337455 6546 raft_consensus.cc:2749] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.337597 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3700a1f40c0644848da62392cb0c297f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.340968 5606 ts_tablet_manager.cc:1929] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:56.341063 5606 log.cc:1199] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/f70b70eb29cb4361a12ed393eabb82e1
I20260927 13:49:56.341374 5606 ts_tablet_manager.cc:1950] T f70b70eb29cb4361a12ed393eabb82e1 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.341794 5606 tablet_replica.cc:333] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.341979 5606 raft_consensus.cc:2243] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.342198 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet f70b70eb29cb4361a12ed393eabb82e1 (table default.Table_55aa0cde9170428d848330642e3b171e [id=18b81e3d511942b38a609e5f9552b4d8]) successfully deleted
I20260927 13:49:56.346055 5623 tablet_replica.cc:333] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:56.346268 5623 raft_consensus.cc:2243] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.346442 5623 raft_consensus.cc:2272] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.347138 5623 ts_tablet_manager.cc:1916] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:56.347232 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b4494b7e895454f81fef308950729ef consensus state has no leader
W20260927 13:49:56.350050 5045 leader_election.cc:343] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.350415 5045 leader_election.cc:304] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.351260 6377 raft_consensus.cc:2749] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.342089 5606 raft_consensus.cc:2272] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.353524 5606 ts_tablet_manager.cc:1916] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.356451 5626 tablet_bootstrap.cc:492] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:56.356594 5626 ts_tablet_manager.cc:1403] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.129s user 0.004s sys 0.000s
I20260927 13:49:56.357302 5626 raft_consensus.cc:359] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.357494 5626 raft_consensus.cc:385] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.357553 5626 raft_consensus.cc:740] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.357752 5626 consensus_queue.cc:260] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:56.361194 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 23e3bb24afad4d789041b6a557512618 consensus state has no leader
I20260927 13:49:56.362133 5626 ts_tablet_manager.cc:1434] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:49:56.371703 5606 ts_tablet_manager.cc:1929] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.371731 5626 tablet_bootstrap.cc:492] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:56.371834 5606 log.cc:1199] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/1f5dfa3e80454463908df19a49454764
I20260927 13:49:56.372138 5606 ts_tablet_manager.cc:1950] T 1f5dfa3e80454463908df19a49454764 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.372608 5606 tablet_replica.cc:333] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.372802 5606 raft_consensus.cc:2243] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.372943 5606 raft_consensus.cc:2272] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.372704 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 1f5dfa3e80454463908df19a49454764 (table default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]) successfully deleted
I20260927 13:49:56.373420 5606 ts_tablet_manager.cc:1916] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.379954 6524 raft_consensus.cc:493] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.380121 6524 raft_consensus.cc:515] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.380264 5349 tablet_service.cc:1511] Processing CreateTablet for tablet df8ebcb238c846729e2c27e4449bfb47 (DEFAULT_TABLE table=default.Table_c8c6fcc62dfb4536957573f7a410a94a [id=27533fd9eddb45e5afc90177ac5e78a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.380635 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8ebcb238c846729e2c27e4449bfb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.381114 6524 leader_election.cc:290] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.381933 6565 tablet.cc:1751] T cc6af9b33f0c464683e40adc28037bc8 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:56.386626 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet bb6073174dbb4ca1933685b7bd3a22e1
I20260927 13:49:56.387072 4921 catalog_manager.cc:6934] ReplaceTablet: tablet bb6073174dbb4ca1933685b7bd3a22e1 deleted and replaced by tablet 13ad5733322545f699d980df99ae0dff
W20260927 13:49:56.387848 5184 leader_election.cc:343] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 559ac90ef36d406881dc17ade0560044
I20260927 13:49:56.388242 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6073174dbb4ca1933685b7bd3a22e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 13ad5733322545f699d980df99ae0dff) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.389339 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6073174dbb4ca1933685b7bd3a22e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 13ad5733322545f699d980df99ae0dff) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.389743 5076 tablet_service.cc:1511] Processing CreateTablet for tablet df8ebcb238c846729e2c27e4449bfb47 (DEFAULT_TABLE table=default.Table_c8c6fcc62dfb4536957573f7a410a94a [id=27533fd9eddb45e5afc90177ac5e78a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.390100 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8ebcb238c846729e2c27e4449bfb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.391872 5606 ts_tablet_manager.cc:1929] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.391968 5606 log.cc:1199] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b5cc71e06eb743d2b63e056e88a6498f
I20260927 13:49:56.392239 5606 ts_tablet_manager.cc:1950] T b5cc71e06eb743d2b63e056e88a6498f P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.393134 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff6a19af8ae4c84af4a8095eca4115e (DEFAULT_TABLE table=default.Table_b24ebce499044fc5974be0e77bc778f6 [id=1a584f9450bb4b55aa73495c55b314f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.393464 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff6a19af8ae4c84af4a8095eca4115e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.394388 5606 tablet_replica.cc:333] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.394582 5606 raft_consensus.cc:2243] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.394714 5606 raft_consensus.cc:2272] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.395193 5606 ts_tablet_manager.cc:1916] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.395205 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b5cc71e06eb743d2b63e056e88a6498f (table default.Table_05fe23910876400aa7273b1f5e5f84e9 [id=935f2e2df32c46e58760dba62709c181]) successfully deleted
I20260927 13:49:56.395437 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6073174dbb4ca1933685b7bd3a22e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 13ad5733322545f699d980df99ae0dff) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.395808 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff6a19af8ae4c84af4a8095eca4115e (DEFAULT_TABLE table=default.Table_b24ebce499044fc5974be0e77bc778f6 [id=1a584f9450bb4b55aa73495c55b314f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.396139 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff6a19af8ae4c84af4a8095eca4115e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.400900 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ac04cc7df4cf46dcbec9dbbe9c207d5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.401571 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac04cc7df4cf46dcbec9dbbe9c207d5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.402227 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8b6f31a00cb34848816c0655566a3bbc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:56.402554 5606 ts_tablet_manager.cc:1929] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.402657 5606 log.cc:1199] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/6817fb4caf6a445b899830c6702bf911
W20260927 13:49:56.402722 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b6f31a00cb34848816c0655566a3bbc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.402952 5606 ts_tablet_manager.cc:1950] T 6817fb4caf6a445b899830c6702bf911 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.403478 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 6817fb4caf6a445b899830c6702bf911 (table default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b [id=48d90d1ed51f4b18b9ad5a1b7fc3cde4]) successfully deleted
I20260927 13:49:56.403903 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c241bde0378b4e4c9c963550525f9663"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.404368 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c241bde0378b4e4c9c963550525f9663 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.408461 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff6a19af8ae4c84af4a8095eca4115e (DEFAULT_TABLE table=default.Table_b24ebce499044fc5974be0e77bc778f6 [id=1a584f9450bb4b55aa73495c55b314f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.408759 5626 tablet_bootstrap.cc:654] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.408892 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff6a19af8ae4c84af4a8095eca4115e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.410458 5606 tablet_replica.cc:333] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.410635 5606 raft_consensus.cc:2243] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.410766 5606 raft_consensus.cc:2272] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.410959 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet d0a737bef14b4874b61a109305ebb993
I20260927 13:49:56.411005 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet da75a470ec0c4ec9afa7c18a51cd7276
I20260927 13:49:56.411252 5606 ts_tablet_manager.cc:1916] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.411433 4924 catalog_manager.cc:6934] ReplaceTablet: tablet da75a470ec0c4ec9afa7c18a51cd7276 deleted and replaced by tablet bad30e7310c842e6818471272f5d669e
I20260927 13:49:56.411703 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e039138831b14ad6b5324ce5cb852dd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.412269 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e039138831b14ad6b5324ce5cb852dd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.412444 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a737bef14b4874b61a109305ebb993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.412623 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet da75a470ec0c4ec9afa7c18a51cd7276 with delete_type TABLET_DATA_DELETED (replaced by tablet bad30e7310c842e6818471272f5d669e) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.412930 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet da75a470ec0c4ec9afa7c18a51cd7276 with delete_type TABLET_DATA_DELETED (replaced by tablet bad30e7310c842e6818471272f5d669e) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.413129 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a737bef14b4874b61a109305ebb993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.413406 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet dd0126a6df14457ca5c62c129f3275f8
I20260927 13:49:56.413671 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet da75a470ec0c4ec9afa7c18a51cd7276 with delete_type TABLET_DATA_DELETED (replaced by tablet bad30e7310c842e6818471272f5d669e) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.413864 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a737bef14b4874b61a109305ebb993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.414165 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3e9c701f47c14f53a3e9d39d0ec63a7d" } new_table_name: "default.Table_98a47a6f58fe457395c7f1accbac44eb" modify_external_catalogs: true
I20260927 13:49:56.414328 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet dd0126a6df14457ca5c62c129f3275f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.414791 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet dd0126a6df14457ca5c62c129f3275f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.415143 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet dd0126a6df14457ca5c62c129f3275f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.415499 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 7a40f69bb7d842889be30c4629d6786f (DEFAULT_TABLE table=default.Table_bcd62dc847544c6c95e4c64a53253103 [id=6f7752ce57e9412c94924248c2eb595a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.415890 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a40f69bb7d842889be30c4629d6786f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.416122 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 7a40f69bb7d842889be30c4629d6786f (DEFAULT_TABLE table=default.Table_bcd62dc847544c6c95e4c64a53253103 [id=6f7752ce57e9412c94924248c2eb595a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.416461 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a40f69bb7d842889be30c4629d6786f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.417865 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 7a40f69bb7d842889be30c4629d6786f (DEFAULT_TABLE table=default.Table_bcd62dc847544c6c95e4c64a53253103 [id=6f7752ce57e9412c94924248c2eb595a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.419029 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a40f69bb7d842889be30c4629d6786f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.421233 4929 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d9ff32095a554784b91e74012ad8e020 (table default.Table_7567474623ce4d588bb654dc21623cb6 [id=112cd821498b427fb3b0d517cd0d55f3]). Expected version 1 got 0
I20260927 13:49:56.421416 4929 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:49:56.421586 4929 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 60de1c28618f4e478aae68ad07fbcf98 (table default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]). Expected version 1 got 0
I20260927 13:49:56.421741 4929 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_996a1ca374d349c59a00107c906d5175 [id=e60348438be94e88be62039a5ac173b5]). Expected version 2 got 0
I20260927 13:49:56.421890 4929 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 46537e1b33f24d50b705d53f6978da3c (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:49:56.422005 4929 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 03a1f13b31934baa8ce18fc499e94806 (table default.Table_cf1d80366a7743b3b4fea68ea5246139 [id=ded13e9c993046cd891db043b1ff6a95]). Expected version 1 got 0
I20260927 13:49:56.411731 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_66de536798af449096cd70f50b74a23a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:56.422322 6377 raft_consensus.cc:493] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.422457 6377 raft_consensus.cc:515] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.423149 6377 leader_election.cc:290] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.423981 4929 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 2e30216e0487496f8efdb8a3b06deb5a (table default.Table_0dc6b57a88cc433c8130f52ee6622be2 [id=4997d0b27b0240959549e68dda2f9958]). Expected version 1 got 0
W20260927 13:49:56.426283 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66de536798af449096cd70f50b74a23a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.426625 5606 ts_tablet_manager.cc:1929] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.426717 5606 log.cc:1199] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/559ac90ef36d406881dc17ade0560044
I20260927 13:49:56.427038 5606 ts_tablet_manager.cc:1950] T 559ac90ef36d406881dc17ade0560044 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.427536 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 559ac90ef36d406881dc17ade0560044 (table default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]) successfully deleted
I20260927 13:49:56.430960 6565 tablet.cc:1751] T 9a35fefc73c54d6c9b1907f55add7b92 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:49:56.432071 4921 catalog_manager.cc:5838] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:56.432446 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a443f65eba384b998fdc57ec57e37d87 (table default.Table_43b89b55155b4b51ab4b271a93f30d59 [id=f7a31bf57f1245cab85dd2c38d85c79f]). Expected version 2 got 0
I20260927 13:49:56.433056 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d9ff32095a554784b91e74012ad8e020 (table default.Table_7567474623ce4d588bb654dc21623cb6 [id=112cd821498b427fb3b0d517cd0d55f3]). Expected version 1 got 0
I20260927 13:49:56.433219 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:49:56.434741 5606 tablet_replica.cc:333] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.437295 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbeeadecf3b40c28d0e4f63a22eb4f0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:56.439863 5044 leader_election.cc:343] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.442288 6377 raft_consensus.cc:493] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.442236 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e2b7f375974b46e98696e6eb80244291"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:56.442495 6377 raft_consensus.cc:515] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:56.442816 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2b7f375974b46e98696e6eb80244291 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.443261 6377 leader_election.cc:290] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.451318 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_dc256a28952e4b6281f7a89706991293" } modify_external_catalogs: true
I20260927 13:49:56.451495 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_dc256a28952e4b6281f7a89706991293" } modify_external_catalogs: true
I20260927 13:49:56.456002 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4384df2328734676b60b16fe84947703"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.456604 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4384df2328734676b60b16fe84947703 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.459888 6493 ts_tablet_manager.cc:1950] T 63a1fca938c34718ae541f0038b56025 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:56.460246 5628 tablet_bootstrap.cc:492] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:56.460631 5628 ts_tablet_manager.cc:1403] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.161s user 0.003s sys 0.000s
I20260927 13:49:56.462268 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet 9bd182d7cb414f07944072b0c00ee35c from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:56.462580 5628 raft_consensus.cc:359] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.463356 5628 raft_consensus.cc:385] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.463760 5628 raft_consensus.cc:740] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.464524 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 63a1fca938c34718ae541f0038b56025 (table default.Table_69a87aa5933f49eaaa3085e0b505f5ca [id=97c4d9da0cc54c3d842a2001313e9a8a]) successfully deleted
I20260927 13:49:56.465553 6493 tablet_replica.cc:333] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:56.465608 5628 consensus_queue.cc:260] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.467905 6493 raft_consensus.cc:2243] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.469638 6493 raft_consensus.cc:2272] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.472045 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 76a3568681214fb1943b2c7e903288ea (DEFAULT_TABLE table=default.Table_35a9895ba749499586d31bae3003ffdf [id=724488630f4f462e85698b08da118551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.471772 5628 ts_tablet_manager.cc:1434] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260927 13:49:56.473176 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a3568681214fb1943b2c7e903288ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:56.474915 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da5d9bda857f467da6930a6c64266f3a consensus state has no leader
I20260927 13:49:56.475458 5628 tablet_bootstrap.cc:492] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:56.475795 4927 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec] alter complete (version 1)
I20260927 13:49:56.475135 6493 ts_tablet_manager.cc:1916] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.482808 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2b8dc798fa334079a96ce21a0a5358a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.483594 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b8dc798fa334079a96ce21a0a5358a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.484527 5623 ts_tablet_manager.cc:1929] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.484800 5623 log.cc:1199] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/17153df5ba20458aa0a5c0297e959810
I20260927 13:49:56.485105 6511 raft_consensus.cc:493] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.485250 6511 raft_consensus.cc:515] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.485906 6511 leader_election.cc:290] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.486635 5623 ts_tablet_manager.cc:1950] T 17153df5ba20458aa0a5c0297e959810 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:56.494000 5075 tablet_service.cc:1511] Processing CreateTablet for tablet bb980bca9f16480ba050971b58aa46f3 (DEFAULT_TABLE table=default.Table_8f9857e0bcfe4d4c960102ea075e0b18 [id=110b779fd4fb4343b8c5f143efac3b51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.494437 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb980bca9f16480ba050971b58aa46f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.494165 5628 tablet_bootstrap.cc:654] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.498273 5606 raft_consensus.cc:2243] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.498453 5606 raft_consensus.cc:2272] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.498944 5606 ts_tablet_manager.cc:1916] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.500178 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbeeadecf3b40c28d0e4f63a22eb4f0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.500577 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794da0992403462dbbce644134b8aab3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.501524 4929 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3] alter complete (version 1)
I20260927 13:49:56.501715 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81b44fb2f644dff899d6d4aa435ccee" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:56.501920 5107 raft_consensus.cc:2468] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:56.505151 5319 leader_election.cc:304] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:49:56.505442 5045 leader_election.cc:343] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.505566 5045 leader_election.cc:304] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:56.506021 5045 leader_election.cc:343] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.506238 6377 raft_consensus.cc:2749] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.507059 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 76a3568681214fb1943b2c7e903288ea (DEFAULT_TABLE table=default.Table_35a9895ba749499586d31bae3003ffdf [id=724488630f4f462e85698b08da118551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.507123 5357 tablet_service.cc:1511] Processing CreateTablet for tablet bb980bca9f16480ba050971b58aa46f3 (DEFAULT_TABLE table=default.Table_8f9857e0bcfe4d4c960102ea075e0b18 [id=110b779fd4fb4343b8c5f143efac3b51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.507455 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb980bca9f16480ba050971b58aa46f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.507589 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_0fcacd34a360441db89b05359f9c8c21" } new_table_name: "default.Table_62bb0683032a40b88aaba89d944f831a" modify_external_catalogs: true
I20260927 13:49:56.507827 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bd182d7cb414f07944072b0c00ee35c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.508009 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 2885e0829d014765b54124a0eb23a4dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.510421 5619 tablet_bootstrap.cc:492] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:56.510560 5619 ts_tablet_manager.cc:1403] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.217s user 0.012s sys 0.016s
I20260927 13:49:56.510684 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a3568681214fb1943b2c7e903288ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.511061 6511 raft_consensus.cc:2804] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:56.511140 6511 raft_consensus.cc:493] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:56.511224 6511 raft_consensus.cc:3060] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.511535 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 794da0992403462dbbce644134b8aab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.511711 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 3933c0a2fd6547f28528fae7d443a2c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.511850 5079 tablet_service.cc:1558] Processing DeleteTablet for tablet 3700a1f40c0644848da62392cb0c297f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.511893 5619 raft_consensus.cc:359] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.511996 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1b4494b7e895454f81fef308950729ef) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.512058 5619 raft_consensus.cc:385] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.512118 5619 raft_consensus.cc:740] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.512130 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet bbb4f42522e84964aeb19358ee02dfc2 with delete_type TABLET_DATA_DELETED (replaced by tablet fcf4c143d5824458be4a42945c338dc9) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.512403 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 06c810fde988439c97a8445fc88626b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 0191cfad4e7a4b088b2ecdc246bfa58a) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.512324 5619 consensus_queue.cc:260] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.512813 5619 ts_tablet_manager.cc:1434] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:56.513072 5619 tablet_bootstrap.cc:492] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:56.513111 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8bf79954c2429f886ac7afc9a8455f with delete_type TABLET_DATA_DELETED (replaced by tablet 502fe193f2034e37a53b245bbf049ae8) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.513684 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 0361e3b244a1437b8e402dd8602528fe with delete_type TABLET_DATA_DELETED (replaced by tablet 187b3ceeccb142c4b798947e584d6044) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.520053 5606 ts_tablet_manager.cc:1929] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.520414 5606 log.cc:1199] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/321b26c89f1a4c8d88f401c8ece448b0
I20260927 13:49:56.520839 5606 ts_tablet_manager.cc:1950] T 321b26c89f1a4c8d88f401c8ece448b0 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.521539 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a84034c9d8ab4ec5ada3c6fbb73934e1" } modify_external_catalogs: true
I20260927 13:49:56.521749 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a84034c9d8ab4ec5ada3c6fbb73934e1" } modify_external_catalogs: true
I20260927 13:49:56.524467 5606 tablet_replica.cc:333] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.524689 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 321b26c89f1a4c8d88f401c8ece448b0 (table default.Table_dbe657f659e24156b29a259c4b995402 [id=c1b3466f7acf411dbb7b0a2d63403edf]) successfully deleted
I20260927 13:49:56.524729 5606 raft_consensus.cc:2243] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:56.525108 5606 pending_rounds.cc:70] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:56.525242 5606 pending_rounds.cc:77] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957616984137728 op_type: NO_OP noop_request { }
I20260927 13:49:56.525416 5606 raft_consensus.cc:2889] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:56.525559 5606 raft_consensus.cc:2272] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.524391 6511 raft_consensus.cc:515] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.527345 5606 ts_tablet_manager.cc:1916] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.527303 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81b44fb2f644dff899d6d4aa435ccee" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:56.527482 5107 raft_consensus.cc:3060] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.530318 5107 raft_consensus.cc:2468] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:56.530846 5319 leader_election.cc:304] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:56.531176 6145 raft_consensus.cc:2804] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:56.531287 6145 raft_consensus.cc:697] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:56.531533 6145 consensus_queue.cc:237] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.531934 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet b57886cc11a2423983c2b7bac79150a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.534525 6511 leader_election.cc:290] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.535699 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_bcd62dc847544c6c95e4c64a53253103" } modify_external_catalogs: true
I20260927 13:49:56.535902 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_bcd62dc847544c6c95e4c64a53253103" } modify_external_catalogs: true
I20260927 13:49:56.544051 5619 tablet_bootstrap.cc:654] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.544462 5346 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce893441d5e4d9f89743e75eb762276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.544515 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ee75d0a39c42b09f2f46a1774f925c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.544641 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet b8311ff24259477a9523355908ac14f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.549428 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_42da0aba47fb44198e367fab1533d338" } new_table_name: "default.Table_7251f4705fb24a3fa6018fc2a5364c77" modify_external_catalogs: true
I20260927 13:49:56.557336 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b855dedb8d04145b0c4469b9ba79453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.558032 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 56b9612ffea543b9b0779c46533d91ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.558964 5628 tablet_bootstrap.cc:492] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:56.559103 5628 ts_tablet_manager.cc:1403] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.001s
I20260927 13:49:56.559885 5628 raft_consensus.cc:359] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.560096 5628 raft_consensus.cc:385] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.560163 5628 raft_consensus.cc:740] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.560385 5628 consensus_queue.cc:260] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.560441 4924 catalog_manager.cc:5838] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:56.560871 5628 ts_tablet_manager.cc:1434] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:56.560932 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:49:56.561189 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]). Expected version 1 got 0
I20260927 13:49:56.561551 5628 tablet_bootstrap.cc:492] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:56.563580 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c5e936d61fc244cfb11cf0cc7e465df1" } new_table_name: "default.Table_81772b30c8204e60935c74293cea103f" modify_external_catalogs: true
I20260927 13:49:56.564095 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet c57b60cbc1ca462789fd8e7a235f7119
I20260927 13:49:56.566314 5083 tablet_service.cc:1511] Processing CreateTablet for tablet c57b60cbc1ca462789fd8e7a235f7119 (DEFAULT_TABLE table=default.Table_dc256a28952e4b6281f7a89706991293 [id=5e47a07ea9444cb4b5f9cbee001cc420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.566923 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet c57b60cbc1ca462789fd8e7a235f7119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.567391 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_785ec15814b242ab835f0346e5d32b8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.568043 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_785ec15814b242ab835f0346e5d32b8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.568992 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_43e6c5c3e28d4a2e825ad7e4c9619888"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.569490 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43e6c5c3e28d4a2e825ad7e4c9619888 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.567571 4925 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 3513663de6724b108adcb46cc151163c (table default.Table_a6d8378ddd6f43a9a731014528c1d94a [id=6b9a7948d0b34aa89f9f7c58a2cd2a0e]). Expected version 1 got 0
I20260927 13:49:56.573565 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet c57b60cbc1ca462789fd8e7a235f7119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.574088 5349 tablet_service.cc:1511] Processing CreateTablet for tablet c57b60cbc1ca462789fd8e7a235f7119 (DEFAULT_TABLE table=default.Table_dc256a28952e4b6281f7a89706991293 [id=5e47a07ea9444cb4b5f9cbee001cc420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.574553 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57b60cbc1ca462789fd8e7a235f7119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.577936 5628 tablet_bootstrap.cc:654] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.578709 6493 ts_tablet_manager.cc:1929] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.579803 6493 log.cc:1199] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/efd31e3dd142413c92fce2043e053d32
W20260927 13:49:56.581605 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1436bcea966646969789e6e09f91c557 consensus state has no leader
W20260927 13:49:56.581863 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 consensus state has no leader
I20260927 13:49:56.582724 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 64c7919f5076406186000cd4077aadaf
I20260927 13:49:56.583509 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 7a40f69bb7d842889be30c4629d6786f
I20260927 13:49:56.583609 6493 ts_tablet_manager.cc:1950] T efd31e3dd142413c92fce2043e053d32 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:56.587728 6377 raft_consensus.cc:493] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.587736 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet efd31e3dd142413c92fce2043e053d32 (table default.Table_5dfc30791e4347db940f164882d547d7 [id=4999b783a5ec458a8af3fbd21cf3ea5e]) successfully deleted
I20260927 13:49:56.587863 6377 raft_consensus.cc:515] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.588478 6377 leader_election.cc:290] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.589181 6493 tablet_replica.cc:333] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:56.589838 5619 tablet_bootstrap.cc:492] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:56.590234 5619 ts_tablet_manager.cc:1403] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.007s
I20260927 13:49:56.590934 5619 raft_consensus.cc:359] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.591094 5619 raft_consensus.cc:385] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.591147 5619 raft_consensus.cc:740] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.591403 5619 consensus_queue.cc:260] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.591567 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cf4234fa5e42469ba6b9bdee1e793f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.591900 5619 ts_tablet_manager.cc:1434] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:49:56.592279 5619 tablet_bootstrap.cc:492] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:56.594290 5619 tablet_bootstrap.cc:654] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.589821 5606 ts_tablet_manager.cc:1929] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:56.595624 5606 log.cc:1199] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/2329b988f5d9410d96eca321a7b8f3a6
I20260927 13:49:56.595978 6377 raft_consensus.cc:493] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.596101 6377 raft_consensus.cc:515] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.596557 5606 ts_tablet_manager.cc:1950] T 2329b988f5d9410d96eca321a7b8f3a6 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.596704 6377 leader_election.cc:290] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:56.599112 5045 leader_election.cc:343] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.600855 6493 raft_consensus.cc:2243] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.601187 6493 raft_consensus.cc:2272] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.601743 5626 tablet_bootstrap.cc:492] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:56.602131 5626 ts_tablet_manager.cc:1403] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.231s user 0.004s sys 0.000s
I20260927 13:49:56.602516 6493 ts_tablet_manager.cc:1916] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.602985 5626 raft_consensus.cc:359] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.603226 5626 raft_consensus.cc:385] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.603330 5626 raft_consensus.cc:740] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.603596 5626 consensus_queue.cc:260] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:56.604720 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 44d29459405b4cdd921fb43bf5a2ae81 consensus state has no leader
I20260927 13:49:56.609253 5626 ts_tablet_manager.cc:1434] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 13:49:56.609728 5626 tablet_bootstrap.cc:492] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:56.610357 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3513663de6724b108adcb46cc151163c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:56.611039 5045 leader_election.cc:343] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.612572 5626 tablet_bootstrap.cc:654] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.613884 5619 tablet_bootstrap.cc:492] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:56.614308 5619 ts_tablet_manager.cc:1403] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.005s
I20260927 13:49:56.616614 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8f9857e0bcfe4d4c960102ea075e0b18" } modify_external_catalogs: true
I20260927 13:49:56.616817 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8f9857e0bcfe4d4c960102ea075e0b18" } modify_external_catalogs: true
I20260927 13:49:56.618336 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_be356ba34c0348f9bf24f85cddfd1e0d" } modify_external_catalogs: true
I20260927 13:49:56.618522 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_be356ba34c0348f9bf24f85cddfd1e0d" } modify_external_catalogs: true
I20260927 13:49:56.620368 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57b60cbc1ca462789fd8e7a235f7119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.620823 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a40f69bb7d842889be30c4629d6786f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.621543 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a40f69bb7d842889be30c4629d6786f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.621737 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 059afd48ac4a41569ed1d3556b7974f0 with delete_type TABLET_DATA_DELETED (replaced by tablet b57886cc11a2423983c2b7bac79150a0) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.622838 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c7919f5076406186000cd4077aadaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.623895 5628 tablet_bootstrap.cc:492] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:56.624032 5628 ts_tablet_manager.cc:1403] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.002s
I20260927 13:49:56.624796 5628 raft_consensus.cc:359] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.624970 5628 raft_consensus.cc:385] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.625036 5628 raft_consensus.cc:740] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.625442 5628 consensus_queue.cc:260] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.626650 5628 ts_tablet_manager.cc:1434] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260927 13:49:56.628613 5357 tablet_service.cc:1511] Processing CreateTablet for tablet d9198ace6a264737a990d6fb573faf2d (DEFAULT_TABLE table=default.Table_1849c92f300e4d10a9e9db98ec234955 [id=5d727ab6a2914ec99a7b4ceff223abdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.629056 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9198ace6a264737a990d6fb573faf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.635725 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.636124 6145 raft_consensus.cc:493] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.636272 6145 raft_consensus.cc:515] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.636926 6145 leader_election.cc:290] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.637220 5075 tablet_service.cc:1511] Processing CreateTablet for tablet d9198ace6a264737a990d6fb573faf2d (DEFAULT_TABLE table=default.Table_1849c92f300e4d10a9e9db98ec234955 [id=5d727ab6a2914ec99a7b4ceff223abdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.637214 5628 tablet_bootstrap.cc:492] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:49:56.638003 5319 leader_election.cc:343] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3b855dedb8d04145b0c4469b9ba79453
I20260927 13:49:56.639130 5619 raft_consensus.cc:359] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.640929 5619 raft_consensus.cc:385] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.641635 5619 raft_consensus.cc:740] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.642952 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet bb980bca9f16480ba050971b58aa46f3
I20260927 13:49:56.642683 5606 tablet_replica.cc:333] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.643939 5606 raft_consensus.cc:2243] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.644337 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet bb980bca9f16480ba050971b58aa46f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.644922 5606 raft_consensus.cc:2272] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.644383 5619 consensus_queue.cc:260] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.648164 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet bb980bca9f16480ba050971b58aa46f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.648479 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 2329b988f5d9410d96eca321a7b8f3a6 (table default.Table_812430ef8c1c4462ae6a6663805f50b8 [id=24cbb4b2dc904080a522c768da9ebe68]) successfully deleted
I20260927 13:49:56.648795 6377 raft_consensus.cc:493] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.648938 6377 raft_consensus.cc:515] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.649572 6377 leader_election.cc:290] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.650151 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb4f42522e84964aeb19358ee02dfc2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.650547 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a4d76e32d0c349abafc8f800e4acb8c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.650746 5045 leader_election.cc:343] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:56.651154 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4d76e32d0c349abafc8f800e4acb8c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.651579 5619 ts_tablet_manager.cc:1434] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.037s user 0.000s sys 0.003s
I20260927 13:49:56.659020 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4b4079f348f74177a204289b41a9e534"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.659590 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b4079f348f74177a204289b41a9e534 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.661345 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9198ace6a264737a990d6fb573faf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.662150 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_44bd8c7b8db24ad5b93798bfebf1d192" } new_table_name: "default.Table_f2893fa7f9724a009e6991e50c4152f9" modify_external_catalogs: true
I20260927 13:49:56.666381 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e73d23c994cc4762a1a69683c398766c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.666913 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e73d23c994cc4762a1a69683c398766c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.668031 6145 raft_consensus.cc:493] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.668181 6145 raft_consensus.cc:515] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.668421 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_ed086ec90f0241b2b7b8aa29b27693c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.668857 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed086ec90f0241b2b7b8aa29b27693c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.668888 6145 leader_election.cc:290] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:56.669972 5319 leader_election.cc:343] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 56b9612ffea543b9b0779c46533d91ab
I20260927 13:49:56.671519 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 7e3b98290dc74d88856e13f003a1e4c7
I20260927 13:49:56.672480 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e3b98290dc74d88856e13f003a1e4c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.673171 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e3b98290dc74d88856e13f003a1e4c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.674234 6145 raft_consensus.cc:493] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.674374 6145 raft_consensus.cc:515] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.674965 6145 leader_election.cc:290] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.674932 5628 tablet_bootstrap.cc:654] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:56.675912 5319 leader_election.cc:343] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b8311ff24259477a9523355908ac14f8
I20260927 13:49:56.676067 6504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Bootstrap replayed 1/1 log segments. Stats: ops{read=362 overwritten=0 applied=362 ignored=0} inserts{seen=338 ignored=0} mutations{seen=390 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 13:49:56.679617 6504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Bootstrap complete.
I20260927 13:49:56.683564 5606 ts_tablet_manager.cc:1916] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.683724 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_12c2d12d8eda427d96a28d5d701aeb49" } new_table_name: "default.Table_6e2914ee899a441f927bce219231e7ab" modify_external_catalogs: true
I20260927 13:49:56.684069 5619 tablet_bootstrap.cc:492] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:56.690716 5619 tablet_bootstrap.cc:654] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.690898 6145 raft_consensus.cc:493] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.691115 6145 raft_consensus.cc:515] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.691458 5606 ts_tablet_manager.cc:1929] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.691565 5606 log.cc:1199] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/4abe721ef8614d86870a0526de69014f
I20260927 13:49:56.691861 5606 ts_tablet_manager.cc:1950] T 4abe721ef8614d86870a0526de69014f P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.692577 6145 leader_election.cc:290] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:56.692968 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet 1245334728994a60ad641c2e90f8d2df with delete_type TABLET_DATA_DELETED (replaced by tablet f46f45a0a13b4e05802a08880d7f6a01) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:56.695747 5606 tablet_replica.cc:333] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.695945 5606 raft_consensus.cc:2243] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.696084 5606 raft_consensus.cc:2272] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.696206 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 4abe721ef8614d86870a0526de69014f (table default.Table_15df8518ff4f446cadb3f1c389a17954 [id=fcaf2809390c4d6c9dd836f5bfdacf40]) successfully deleted
I20260927 13:49:56.696636 5606 ts_tablet_manager.cc:1916] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:56.702001 5319 leader_election.cc:343] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 31ee75d0a39c42b09f2f46a1774f925c
I20260927 13:49:56.703761 6493 ts_tablet_manager.cc:1929] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:49:56.706146 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a82284e3fd1f4a2f95c7e47320abb30c consensus state has no leader
I20260927 13:49:56.705662 6493 log.cc:1199] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/5e3fa4870d5547a2bbffe1745b964504
I20260927 13:49:56.708448 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c7919f5076406186000cd4077aadaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.710742 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_be21b5e424724df9868d8ded75617bdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.711303 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be21b5e424724df9868d8ded75617bdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.711033 6493 ts_tablet_manager.cc:1950] T 5e3fa4870d5547a2bbffe1745b964504 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:56.715113 5626 tablet_bootstrap.cc:492] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
W20260927 13:49:56.715901 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b54cf8c485324f798d59edf65d52d7b5 consensus state has no leader
I20260927 13:49:56.715205 6504 raft_consensus.cc:359] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:56.716197 6504 raft_consensus.cc:740] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: e421351a34d1463e9773dcebdeebae3c, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.716238 5626 ts_tablet_manager.cc:1403] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.000s
I20260927 13:49:56.717100 6504 consensus_queue.cc:260] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 362, Last appended: 3.362, Last appended by leader: 362, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
W20260927 13:49:56.719063 5185 leader_election.cc:343] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 559ac90ef36d406881dc17ade0560044
I20260927 13:49:56.719240 5185 leader_election.cc:304] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.719969 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cf4234fa5e42469ba6b9bdee1e793f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:56.720145 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794da0992403462dbbce644134b8aab3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:56.720624 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81b44fb2f644dff899d6d4aa435ccee" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:56.722491 6524 raft_consensus.cc:2749] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.723811 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3513663de6724b108adcb46cc151163c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:56.724364 6577 sys_catalog.cc:455] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:56.725198 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb4f42522e84964aeb19358ee02dfc2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:56.725692 5044 leader_election.cc:343] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.725816 5044 leader_election.cc:304] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.726254 6377 raft_consensus.cc:2749] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.726505 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 17153df5ba20458aa0a5c0297e959810 (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]) successfully deleted
W20260927 13:49:56.726763 5044 leader_election.cc:343] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.726863 5044 leader_election.cc:304] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:56.727043 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 76a397300cdd44eb899f2ef5b9fe8c09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76a397300cdd44eb899f2ef5b9fe8c09 already in progress: creating tablet
I20260927 13:49:56.727205 6377 raft_consensus.cc:2749] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:56.727519 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet bb6073174dbb4ca1933685b7bd3a22e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb6073174dbb4ca1933685b7bd3a22e1 already in progress: creating tablet
I20260927 13:49:56.727710 6577 sys_catalog.cc:458] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:56.727584 6504 sys_catalog.cc:565] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: configured and running, proceeding with master startup.
W20260927 13:49:56.728057 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet da75a470ec0c4ec9afa7c18a51cd7276 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da75a470ec0c4ec9afa7c18a51cd7276 already in progress: creating tablet
W20260927 13:49:56.728541 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet d0a737bef14b4874b61a109305ebb993 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0a737bef14b4874b61a109305ebb993 already in progress: creating tablet
W20260927 13:49:56.729038 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet dd0126a6df14457ca5c62c129f3275f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd0126a6df14457ca5c62c129f3275f8 already in progress: creating tablet
W20260927 13:49:56.729466 5044 leader_election.cc:343] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.729584 5044 leader_election.cc:304] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.729805 6377 raft_consensus.cc:2749] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.733394 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 76a3568681214fb1943b2c7e903288ea (DEFAULT_TABLE table=default.Table_35a9895ba749499586d31bae3003ffdf [id=724488630f4f462e85698b08da118551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.733824 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a3568681214fb1943b2c7e903288ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.734023 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_1e8d21fc0eb44229a3a03b14792918c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.734722 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e8d21fc0eb44229a3a03b14792918c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.738713 5626 raft_consensus.cc:359] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.738979 5626 raft_consensus.cc:385] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.739069 5626 raft_consensus.cc:740] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.740141 5626 consensus_queue.cc:260] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.741017 5626 ts_tablet_manager.cc:1434] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260927 13:49:56.742633 5626 tablet_bootstrap.cc:492] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:56.744910 5626 tablet_bootstrap.cc:654] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.745378 5214 tablet_service.cc:1511] Processing CreateTablet for tablet bb980bca9f16480ba050971b58aa46f3 (DEFAULT_TABLE table=default.Table_8f9857e0bcfe4d4c960102ea075e0b18 [id=110b779fd4fb4343b8c5f143efac3b51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.745810 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 559ac90ef36d406881dc17ade0560044 with delete_type TABLET_DATA_DELETED (replaced by tablet 3afb800e7ff44aadaed8f8d85aa9efe2) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.746187 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet f70b70eb29cb4361a12ed393eabb82e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.748476 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7925881f0cb44436964ec5d3a85ccb31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.749007 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7925881f0cb44436964ec5d3a85ccb31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.749536 6524 raft_consensus.cc:493] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.749696 6524 raft_consensus.cc:515] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.749845 5221 tablet_service.cc:1511] Processing CreateTablet for tablet c57b60cbc1ca462789fd8e7a235f7119 (DEFAULT_TABLE table=default.Table_dc256a28952e4b6281f7a89706991293 [id=5e47a07ea9444cb4b5f9cbee001cc420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.750277 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2106fec9f3fd4ed7abfa52fe5960add5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.750756 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2106fec9f3fd4ed7abfa52fe5960add5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.750797 6524 leader_election.cc:290] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:56.751986 5184 leader_election.cc:343] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 63a1fca938c34718ae541f0038b56025
I20260927 13:49:56.752554 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb980bca9f16480ba050971b58aa46f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.754272 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57b60cbc1ca462789fd8e7a235f7119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.762553 5626 tablet_bootstrap.cc:492] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:56.762732 5626 ts_tablet_manager.cc:1403] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260927 13:49:56.763635 5626 raft_consensus.cc:359] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.763859 5626 raft_consensus.cc:385] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.763932 5626 raft_consensus.cc:740] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.764170 5626 consensus_queue.cc:260] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.764735 5626 ts_tablet_manager.cc:1434] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:56.765091 5626 tablet_bootstrap.cc:492] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:56.767063 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1849c92f300e4d10a9e9db98ec234955" } modify_external_catalogs: true
I20260927 13:49:56.767295 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1849c92f300e4d10a9e9db98ec234955" } modify_external_catalogs: true
I20260927 13:49:56.767593 5626 tablet_bootstrap.cc:654] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.773442 4927 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d9ff32095a554784b91e74012ad8e020 (table default.Table_ee7a89c46e4f454fb0922cafbc796e8e [id=112cd821498b427fb3b0d517cd0d55f3]). Expected version 2 got 0
I20260927 13:49:56.774953 5623 tablet_replica.cc:333] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:56.775298 5623 raft_consensus.cc:2243] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.775553 5623 raft_consensus.cc:2272] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.776221 5623 ts_tablet_manager.cc:1916] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.776744 5626 tablet_bootstrap.cc:492] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:56.776877 5626 ts_tablet_manager.cc:1403] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.004s
I20260927 13:49:56.777588 5626 raft_consensus.cc:359] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.777784 5626 raft_consensus.cc:385] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.777846 5626 raft_consensus.cc:740] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.778043 5626 consensus_queue.cc:260] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.778532 5626 ts_tablet_manager.cc:1434] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:56.778846 5626 tablet_bootstrap.cc:492] T a81b44fb2f644dff899d6d4aa435ccee P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:56.782500 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c7919f5076406186000cd4077aadaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.782972 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a40f69bb7d842889be30c4629d6786f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.785082 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet bb980bca9f16480ba050971b58aa46f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.785516 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e3b98290dc74d88856e13f003a1e4c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.786382 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 97b46497d8254a248df8d421d0b09d8d (DEFAULT_TABLE table=default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.786939 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 059afd48ac4a41569ed1d3556b7974f0 with delete_type TABLET_DATA_DELETED (replaced by tablet b57886cc11a2423983c2b7bac79150a0) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.787434 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a1fca938c34718ae541f0038b56025 with delete_type TABLET_DATA_DELETED (replaced by tablet 3002129c9c744881b21da22ddee86589) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.787839 5626 tablet_bootstrap.cc:654] T a81b44fb2f644dff899d6d4aa435ccee P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.787916 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b46497d8254a248df8d421d0b09d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.788748 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet a7a97f4df3a84781bfcbdc768d518ef0 with delete_type TABLET_DATA_DELETED (replaced by tablet b5a9f864e4274666a86baed43e1623cd) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.789178 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 1245334728994a60ad641c2e90f8d2df with delete_type TABLET_DATA_DELETED (replaced by tablet f46f45a0a13b4e05802a08880d7f6a01) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.790848 5221 tablet_service.cc:1511] Processing CreateTablet for tablet d9198ace6a264737a990d6fb573faf2d (DEFAULT_TABLE table=default.Table_1849c92f300e4d10a9e9db98ec234955 [id=5d727ab6a2914ec99a7b4ceff223abdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.791337 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9198ace6a264737a990d6fb573faf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.794220 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet c57b60cbc1ca462789fd8e7a235f7119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:56.794813 5044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 65341us
W20260927 13:49:56.795086 5044 leader_election.cc:343] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.795186 5044 leader_election.cc:304] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.796399 6493 tablet_replica.cc:333] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:56.796613 6493 raft_consensus.cc:2243] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.796772 6493 raft_consensus.cc:2272] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.796721 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e2b7f375974b46e98696e6eb80244291" } new_table_name: "default.Table_6d1d864c184e45a194cc02929a81a980" modify_external_catalogs: true
I20260927 13:49:56.797312 6493 ts_tablet_manager.cc:1916] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.798234 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a6d8378ddd6f43a9a731014528c1d94a" } new_table_name: "default.Table_dcdd264dd7c84641aac8566bae2bf8b6" modify_external_catalogs: true
I20260927 13:49:56.805791 6377 raft_consensus.cc:2749] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.807783 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_1d4328199b424e52bc4ebaf4f317542a" } new_table_name: "default.Table_27e66012e36e4417a0ff30c28955e58e" modify_external_catalogs: true
I20260927 13:49:56.809468 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e349439f77f540cd8fc369d3f4217757"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.810020 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e349439f77f540cd8fc369d3f4217757 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.811501 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3057055163b742648fbe697cf93a2f0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:56.811645 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 5e3fa4870d5547a2bbffe1745b964504 (table default.Table_009df0f55a87479eab602a85d1503bf9 [id=1ea34fa23bae4ba88424a02d4e54a803]) successfully deleted
W20260927 13:49:56.811956 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3057055163b742648fbe697cf93a2f0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.813156 5628 tablet_bootstrap.cc:492] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:56.813292 5628 ts_tablet_manager.cc:1403] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.177s user 0.008s sys 0.028s
I20260927 13:49:56.813865 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet 7dc140bba42a43758fa0c6540d728275 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:56.817929 6377 raft_consensus.cc:493] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.818055 6377 raft_consensus.cc:515] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.818949 6377 leader_election.cc:290] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.820014 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57886cc11a2423983c2b7bac79150a0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:56.820662 5044 leader_election.cc:343] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.823843 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 97b46497d8254a248df8d421d0b09d8d (DEFAULT_TABLE table=default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.824237 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cf1d80366a7743b3b4fea68ea5246139" } modify_external_catalogs: true
I20260927 13:49:56.824747 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b46497d8254a248df8d421d0b09d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.825917 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cf1d80366a7743b3b4fea68ea5246139" } modify_external_catalogs: true
I20260927 13:49:56.827152 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_43b89b55155b4b51ab4b271a93f30d59" } modify_external_catalogs: true
I20260927 13:49:56.845818 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_43b89b55155b4b51ab4b271a93f30d59" } modify_external_catalogs: true
W20260927 13:49:56.844033 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4fe7d3f3a6ec49438d0a710b45163d0b has no consensus state
I20260927 13:49:56.844326 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet d9198ace6a264737a990d6fb573faf2d
W20260927 13:49:56.845633 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3513663de6724b108adcb46cc151163c consensus state has no leader
I20260927 13:49:56.850076 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet d9198ace6a264737a990d6fb573faf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.854413 6493 ts_tablet_manager.cc:1929] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.854535 6493 log.cc:1199] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/2cec272546cb4373bf69e3ab344c46e1
I20260927 13:49:56.854830 6493 ts_tablet_manager.cc:1950] T 2cec272546cb4373bf69e3ab344c46e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:56.855266 6493 tablet_replica.cc:333] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:56.855472 6493 raft_consensus.cc:2243] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.855620 6493 raft_consensus.cc:2272] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.856582 6493 ts_tablet_manager.cc:1916] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.860031 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 2cec272546cb4373bf69e3ab344c46e1 (table default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]) successfully deleted
I20260927 13:49:56.860327 4924 master_service.cc:960] ReplaceTablet: received request to replace tablet 4d35148d80b44fca9b39a4625d3e61c1 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:56.861517 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_26e3d3422d594674a8d1c56b2e6e73ab" } modify_external_catalogs: true
I20260927 13:49:56.861763 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_26e3d3422d594674a8d1c56b2e6e73ab" } modify_external_catalogs: true
I20260927 13:49:56.863147 5628 raft_consensus.cc:359] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.863332 5628 raft_consensus.cc:385] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.863392 5628 raft_consensus.cc:740] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.863591 5628 consensus_queue.cc:260] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.864068 5628 ts_tablet_manager.cc:1434] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.051s user 0.000s sys 0.000s
I20260927 13:49:56.868453 6493 ts_tablet_manager.cc:1929] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.868569 6493 log.cc:1199] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f3e0e8d6bc744d69a9f41d45459d3b2b
I20260927 13:49:56.868857 6493 ts_tablet_manager.cc:1950] T f3e0e8d6bc744d69a9f41d45459d3b2b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:56.872035 6591 tablet.cc:1751] T d9ff32095a554784b91e74012ad8e020 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:56.874503 5075 tablet_service.cc:1511] Processing CreateTablet for tablet e38aa46c6ab34ece89397d3940d847db (DEFAULT_TABLE table=default.Table_01a57ba463c7433db27102851328ade7 [id=81d5856bf3614409aa1a141334159b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.874584 6546 raft_consensus.cc:493] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.874748 6546 raft_consensus.cc:515] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.874928 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38aa46c6ab34ece89397d3940d847db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.875489 6546 leader_election.cc:290] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.876560 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 2d64750141d74d988612304ce050688d (DEFAULT_TABLE table=default.Table_576d9422be234e3ab93aba4b5f662369 [id=ca91bc8468d040cb9e2e93293057452f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.876881 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d64750141d74d988612304ce050688d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.878772 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2657276c4b2f43c1ad64a8c1fd58ada9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:56.879711 5044 leader_election.cc:343] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.881225 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_576d9422be234e3ab93aba4b5f662369" } modify_external_catalogs: true
I20260927 13:49:56.881531 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_576d9422be234e3ab93aba4b5f662369" } modify_external_catalogs: true
I20260927 13:49:56.888850 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet bb25bb5ee153494d803130f1ad4f7c2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:56.894999 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57886cc11a2423983c2b7bac79150a0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.895408 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2657276c4b2f43c1ad64a8c1fd58ada9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.895555 5628 tablet_bootstrap.cc:492] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:56.895536 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet d9198ace6a264737a990d6fb573faf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:56.896023 5045 leader_election.cc:343] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.896152 5045 leader_election.cc:304] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.896397 6377 raft_consensus.cc:2749] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:56.896551 5045 leader_election.cc:343] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.896464 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3bd7d29894a24011b97fb7157002b917"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:56.896642 5045 leader_election.cc:304] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.896855 6377 raft_consensus.cc:2749] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:56.897094 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bd7d29894a24011b97fb7157002b917 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.897624 5347 tablet_service.cc:1511] Processing CreateTablet for tablet 97b46497d8254a248df8d421d0b09d8d (DEFAULT_TABLE table=default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:56.898398 5185 leader_election.cc:343] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 63a1fca938c34718ae541f0038b56025
I20260927 13:49:56.898514 5185 leader_election.cc:304] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:56.898738 6524 raft_consensus.cc:2749] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:56.898960 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_83075bfe4fcb4d80b6a90c020b475e1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:56.899537 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83075bfe4fcb4d80b6a90c020b475e1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:56.899953 5359 tablet_service.cc:1511] Processing CreateTablet for tablet e38aa46c6ab34ece89397d3940d847db (DEFAULT_TABLE table=default.Table_01a57ba463c7433db27102851328ade7 [id=81d5856bf3614409aa1a141334159b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.900324 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38aa46c6ab34ece89397d3940d847db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.901152 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 321b26c89f1a4c8d88f401c8ece448b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.901417 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b46497d8254a248df8d421d0b09d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.901367 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet d9198ace6a264737a990d6fb573faf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:56.901966 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 2d64750141d74d988612304ce050688d (DEFAULT_TABLE table=default.Table_576d9422be234e3ab93aba4b5f662369 [id=ca91bc8468d040cb9e2e93293057452f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.902367 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d64750141d74d988612304ce050688d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.902647 5619 tablet_bootstrap.cc:492] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:56.902766 5619 ts_tablet_manager.cc:1403] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.219s user 0.000s sys 0.007s
I20260927 13:49:56.903182 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 2d64750141d74d988612304ce050688d (DEFAULT_TABLE table=default.Table_576d9422be234e3ab93aba4b5f662369 [id=ca91bc8468d040cb9e2e93293057452f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.903498 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d64750141d74d988612304ce050688d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.903740 5619 raft_consensus.cc:359] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.903903 5619 raft_consensus.cc:385] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:56.903951 5619 raft_consensus.cc:740] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:56.904145 5619 consensus_queue.cc:260] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.904639 5619 ts_tablet_manager.cc:1434] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:49:56.904947 5619 tablet_bootstrap.cc:492] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:56.909137 6145 raft_consensus.cc:493] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.909269 6145 raft_consensus.cc:515] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:56.909855 5628 tablet_bootstrap.cc:654] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.909890 6145 leader_election.cc:290] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:56.912899 5319 leader_election.cc:343] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 6ce893441d5e4d9f89743e75eb762276
I20260927 13:49:56.913350 5229 tablet_service.cc:1511] Processing CreateTablet for tablet e38aa46c6ab34ece89397d3940d847db (DEFAULT_TABLE table=default.Table_01a57ba463c7433db27102851328ade7 [id=81d5856bf3614409aa1a141334159b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.913684 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38aa46c6ab34ece89397d3940d847db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.922837 5606 ts_tablet_manager.cc:1929] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:56.922998 5606 log.cc:1199] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/825a73d47bff4246965be82eb482f7aa
I20260927 13:49:56.923375 5606 ts_tablet_manager.cc:1950] T 825a73d47bff4246965be82eb482f7aa P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:56.925197 5619 tablet_bootstrap.cc:654] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:56.926941 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f3e0e8d6bc744d69a9f41d45459d3b2b (table default.Table_d294f0cb024e426592bf4bf7f261f4be [id=56da4ca311574a50af8ec358752e07a4]) successfully deleted
W20260927 13:49:56.929611 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 370553521753488ab81e40144f2536ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 370553521753488ab81e40144f2536ae already in progress: creating tablet
W20260927 13:49:56.930685 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 614f1af61461466da975bea681162727 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 614f1af61461466da975bea681162727 already in progress: creating tablet
W20260927 13:49:56.932333 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 76a397300cdd44eb899f2ef5b9fe8c09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76a397300cdd44eb899f2ef5b9fe8c09 already in progress: creating tablet
W20260927 13:49:56.933755 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet bb6073174dbb4ca1933685b7bd3a22e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb6073174dbb4ca1933685b7bd3a22e1 already in progress: creating tablet
W20260927 13:49:56.935133 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet da75a470ec0c4ec9afa7c18a51cd7276 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da75a470ec0c4ec9afa7c18a51cd7276 already in progress: creating tablet
W20260927 13:49:56.936553 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet d0a737bef14b4874b61a109305ebb993 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0a737bef14b4874b61a109305ebb993 already in progress: creating tablet
I20260927 13:49:56.936735 6524 raft_consensus.cc:493] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.936882 6524 raft_consensus.cc:515] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.937668 6524 leader_election.cc:290] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:56.938342 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet dd0126a6df14457ca5c62c129f3275f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd0126a6df14457ca5c62c129f3275f8 already in progress: creating tablet
I20260927 13:49:56.938580 6145 raft_consensus.cc:493] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.938740 6145 raft_consensus.cc:515] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.939471 6145 leader_election.cc:290] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:56.940881 5319 leader_election.cc:343] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 059afd48ac4a41569ed1d3556b7974f0
I20260927 13:49:56.942286 6493 tablet_replica.cc:333] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
W20260927 13:49:56.942262 5184 leader_election.cc:343] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 059afd48ac4a41569ed1d3556b7974f0
I20260927 13:49:56.942499 6493 raft_consensus.cc:2243] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.942687 6493 raft_consensus.cc:2272] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.943225 6493 ts_tablet_manager.cc:1916] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.946627 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 445f0b64c0564670842aa582c998c2de (DEFAULT_TABLE table=default.Table_985a589956d74837978aa757b2b52b61 [id=0babbde1882745c7ac6712c82da30d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.947853 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 26a8aca52f8c4566b274d13e6bb13ce5 (DEFAULT_TABLE table=default.Table_fa1834afe3c24278ad9e378c9c237e52 [id=1872fc9804f24237a1677f96da08b24c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.947853 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 445f0b64c0564670842aa582c998c2de (DEFAULT_TABLE table=default.Table_985a589956d74837978aa757b2b52b61 [id=0babbde1882745c7ac6712c82da30d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.948220 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f0b64c0564670842aa582c998c2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.949005 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 26a8aca52f8c4566b274d13e6bb13ce5 (DEFAULT_TABLE table=default.Table_fa1834afe3c24278ad9e378c9c237e52 [id=1872fc9804f24237a1677f96da08b24c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.949352 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a8aca52f8c4566b274d13e6bb13ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.956341 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059afd48ac4a41569ed1d3556b7974f0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.956611 5384 raft_consensus.cc:2468] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:56.957216 5185 leader_election.cc:304] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:56.957744 6524 raft_consensus.cc:2804] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:56.957854 6524 raft_consensus.cc:493] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:56.957927 6524 raft_consensus.cc:3060] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.959313 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f0b64c0564670842aa582c998c2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.960175 5606 tablet_replica.cc:333] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:56.960413 5606 raft_consensus.cc:2243] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:56.960587 5606 raft_consensus.cc:2272] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:56.961229 5606 ts_tablet_manager.cc:1916] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:56.961251 6524 raft_consensus.cc:515] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.962239 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a8aca52f8c4566b274d13e6bb13ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.962740 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 825a73d47bff4246965be82eb482f7aa (table default.Table_de911651b6ff4188876ef1d412e041b7 [id=119de2adb4d24563b76c6099dec2d9a9]) successfully deleted
W20260927 13:49:56.963032 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 80b1970a344045389709260c850adc07 because the tablet was not found. No further retry: Not found: Tablet not found: 80b1970a344045389709260c850adc07
W20260927 13:49:56.963225 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet bb6073174dbb4ca1933685b7bd3a22e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb6073174dbb4ca1933685b7bd3a22e1 already in progress: creating tablet
W20260927 13:49:56.963389 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet d0a737bef14b4874b61a109305ebb993 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0a737bef14b4874b61a109305ebb993 already in progress: creating tablet
W20260927 13:49:56.963590 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet da75a470ec0c4ec9afa7c18a51cd7276 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da75a470ec0c4ec9afa7c18a51cd7276 already in progress: creating tablet
W20260927 13:49:56.963816 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet dd0126a6df14457ca5c62c129f3275f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd0126a6df14457ca5c62c129f3275f8 already in progress: creating tablet
I20260927 13:49:56.966280 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059afd48ac4a41569ed1d3556b7974f0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:56.966460 5384 raft_consensus.cc:3060] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.969364 5384 raft_consensus.cc:2468] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:56.970515 5185 leader_election.cc:304] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:56.972296 6524 leader_election.cc:290] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.972527 6524 raft_consensus.cc:2804] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:56.972638 6524 raft_consensus.cc:697] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:56.972899 6524 consensus_queue.cc:237] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:49:56.974409 5184 leader_election.cc:343] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 059afd48ac4a41569ed1d3556b7974f0
I20260927 13:49:56.977464 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 26a8aca52f8c4566b274d13e6bb13ce5 (DEFAULT_TABLE table=default.Table_fa1834afe3c24278ad9e378c9c237e52 [id=1872fc9804f24237a1677f96da08b24c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:56.977866 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a8aca52f8c4566b274d13e6bb13ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:56.983507 6377 raft_consensus.cc:493] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:56.983667 6377 raft_consensus.cc:515] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.984390 6377 leader_election.cc:290] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.985136 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03917a40b5884401a6bc09c7925fd1ae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:56.985972 5044 leader_election.cc:343] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:56.986912 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03917a40b5884401a6bc09c7925fd1ae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:56.987177 5384 raft_consensus.cc:2468] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:56.990485 5045 leader_election.cc:304] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:56.991081 6377 raft_consensus.cc:2804] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:56.991171 6377 raft_consensus.cc:493] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:56.991246 6377 raft_consensus.cc:3060] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:56.994728 6377 raft_consensus.cc:515] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:56.995817 6377 leader_election.cc:290] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:56.995955 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03917a40b5884401a6bc09c7925fd1ae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:56.996171 5384 raft_consensus.cc:3060] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.000609 5384 raft_consensus.cc:2468] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:57.001206 5045 leader_election.cc:304] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:57.001591 6377 raft_consensus.cc:2804] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:57.002079 6377 raft_consensus.cc:697] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:57.002435 6377 consensus_queue.cc:237] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.003607 5619 tablet_bootstrap.cc:492] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.003743 5619 ts_tablet_manager.cc:1403] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.099s user 0.000s sys 0.007s
I20260927 13:49:57.004581 5619 raft_consensus.cc:359] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.004745 5619 raft_consensus.cc:385] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.004799 5619 raft_consensus.cc:740] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.005102 5619 consensus_queue.cc:260] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.005595 5619 ts_tablet_manager.cc:1434] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:57.012176 5432 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:57.014865 5619 tablet_bootstrap.cc:492] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.019874 6592 tablet.cc:1751] T d9ff32095a554784b91e74012ad8e020 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:57.025776 5619 tablet_bootstrap.cc:654] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.027491 5606 ts_tablet_manager.cc:1929] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.027643 5606 log.cc:1199] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/6ce893441d5e4d9f89743e75eb762276
I20260927 13:49:57.027987 5606 ts_tablet_manager.cc:1950] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:57.029433 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 6ce893441d5e4d9f89743e75eb762276 (table default.Table_6f968553a801422ba747b1d4516c2074 [id=b330cf549e3842ad9e82aed396bcba89]) successfully deleted
I20260927 13:49:57.029876 5606 tablet_replica.cc:333] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:57.030175 5606 raft_consensus.cc:2243] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.030439 5606 raft_consensus.cc:2272] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.031109 5606 ts_tablet_manager.cc:1916] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.034597 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_761013ba2d1f4a3ebfb61cc1e4089f8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:57.035197 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_761013ba2d1f4a3ebfb61cc1e4089f8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:57.037267 4754 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 54513.3us
I20260927 13:49:57.038856 5628 tablet_bootstrap.cc:492] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:57.039031 5628 ts_tablet_manager.cc:1403] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.144s user 0.002s sys 0.006s
I20260927 13:49:57.039065 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ffe83306e74749b5b3f68e6c2c708c with delete_type TABLET_DATA_DELETED (replaced by tablet 98b434884a3f4c63a9ba341e53703023) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:57.039945 5628 raft_consensus.cc:359] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.040126 5628 raft_consensus.cc:385] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.040189 5628 raft_consensus.cc:740] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.040453 5628 consensus_queue.cc:260] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.044304 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03917a40b5884401a6bc09c7925fd1ae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:49:57.044785 5044 leader_election.cc:343] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.050693 5628 ts_tablet_manager.cc:1434] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 13:49:57.050979 5628 tablet_bootstrap.cc:492] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:57.051213 6546 raft_consensus.cc:493] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.051340 6546 raft_consensus.cc:515] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.051965 6546 leader_election.cc:290] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:57.053221 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575501a5d1f4b0d80f153cf5bde5fa9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:57.053757 5044 leader_election.cc:343] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.053773 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575501a5d1f4b0d80f153cf5bde5fa9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:57.054265 5045 leader_election.cc:343] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.054374 5045 leader_election.cc:304] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:57.054724 6546 raft_consensus.cc:2749] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.057054 5626 tablet_bootstrap.cc:492] T a81b44fb2f644dff899d6d4aa435ccee P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.057181 5626 ts_tablet_manager.cc:1403] T a81b44fb2f644dff899d6d4aa435ccee P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.278s user 0.024s sys 0.072s
I20260927 13:49:57.057675 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81b44fb2f644dff899d6d4aa435ccee" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:57.057859 5626 raft_consensus.cc:359] T a81b44fb2f644dff899d6d4aa435ccee P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.058024 5626 raft_consensus.cc:385] T a81b44fb2f644dff899d6d4aa435ccee P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.058911 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b855dedb8d04145b0c4469b9ba79453" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:57.059477 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b9612ffea543b9b0779c46533d91ab" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:57.059911 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8311ff24259477a9523355908ac14f8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:57.060393 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ee75d0a39c42b09f2f46a1774f925c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:57.061216 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce893441d5e4d9f89743e75eb762276" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:57.061645 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059afd48ac4a41569ed1d3556b7974f0" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:57.063875 6493 ts_tablet_manager.cc:1929] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.058084 5626 raft_consensus.cc:740] T a81b44fb2f644dff899d6d4aa435ccee P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.069991 5626 consensus_queue.cc:260] T a81b44fb2f644dff899d6d4aa435ccee P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.070849 6493 log.cc:1199] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/9bd182d7cb414f07944072b0c00ee35c
I20260927 13:49:57.070756 5214 tablet_service.cc:1511] Processing CreateTablet for tablet a5feae3a28cd44ff9392a1574a444db3 (DEFAULT_TABLE table=default.Table_8a05998b42404d7aa570c504e6973e38 [id=13d176473e094cb1b8215bc984f49c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.071182 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5feae3a28cd44ff9392a1574a444db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.071632 5626 ts_tablet_manager.cc:1434] T a81b44fb2f644dff899d6d4aa435ccee P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260927 13:49:57.072021 5626 tablet_bootstrap.cc:492] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.076452 6578 consensus_queue.cc:1048] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:57.080816 5626 tablet_bootstrap.cc:654] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.084342 5296 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
W20260927 13:49:57.096728 5319 leader_election.cc:343] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.098042 6493 ts_tablet_manager.cc:1950] T 9bd182d7cb414f07944072b0c00ee35c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:57.098524 6493 tablet_replica.cc:333] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:57.098722 6493 raft_consensus.cc:2243] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.098884 6493 raft_consensus.cc:2272] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.099443 6493 ts_tablet_manager.cc:1916] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.100250 5626 tablet_bootstrap.cc:492] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.100422 5626 ts_tablet_manager.cc:1403] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.003s
W20260927 13:49:57.098061 5319 leader_election.cc:343] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:57.101037 5319 leader_election.cc:343] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.101195 5319 leader_election.cc:304] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:57.069248 5628 tablet_bootstrap.cc:654] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.102303 6607 raft_consensus.cc:2749] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.103746 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 9bd182d7cb414f07944072b0c00ee35c (table default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b [id=48d90d1ed51f4b18b9ad5a1b7fc3cde4]) successfully deleted
I20260927 13:49:57.101222 5626 raft_consensus.cc:359] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.105526 5626 raft_consensus.cc:385] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.105602 5626 raft_consensus.cc:740] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.105885 5626 consensus_queue.cc:260] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.106462 5626 ts_tablet_manager.cc:1434] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260927 13:49:57.106815 5626 tablet_bootstrap.cc:492] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.108619 5626 tablet_bootstrap.cc:654] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:57.112389 5319 leader_election.cc:343] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.112581 5319 leader_election.cc:304] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:49:57.113027 5319 leader_election.cc:343] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.114300 6612 tablet.cc:1751] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:57.113334 6607 raft_consensus.cc:2749] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.122941 5628 tablet_bootstrap.cc:492] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:57.123082 5628 ts_tablet_manager.cc:1403] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.002s
I20260927 13:49:57.123898 5628 raft_consensus.cc:359] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.124058 5628 raft_consensus.cc:385] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.124109 5628 raft_consensus.cc:740] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.124637 5626 tablet_bootstrap.cc:492] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.124817 5626 ts_tablet_manager.cc:1403] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
I20260927 13:49:57.113821 6611 tablet.cc:1751] T d9ff32095a554784b91e74012ad8e020 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:57.125523 4923 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 931a48792f4c4525bd563a4dd1062e35 (table default.Table_3b7666d87acf47bda3e3e2545c8cfb25 [id=bed97aef149a417bb3807414f58ba52a]). Expected version 2 got 0
I20260927 13:49:57.125645 5626 raft_consensus.cc:359] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.125846 5626 raft_consensus.cc:385] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.125934 5626 raft_consensus.cc:740] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.126192 5626 consensus_queue.cc:260] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.127889 5606 ts_tablet_manager.cc:1929] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.128024 5606 log.cc:1199] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b8311ff24259477a9523355908ac14f8
I20260927 13:49:57.128046 4923 catalog_manager.cc:5838] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65). New cstate: current_term: 1 leader_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:57.128409 5606 ts_tablet_manager.cc:1950] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:57.128495 4923 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]). Expected version 1 got 0
I20260927 13:49:57.128983 5606 tablet_replica.cc:333] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:57.119091 5319 leader_election.cc:304] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:49:57.129401 5319 raft_consensus.cc:2686] T b8311ff24259477a9523355908ac14f8 P bb28c54312c94d7dafb1c2abf7870735: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260927 13:49:57.129784 5319 leader_election.cc:343] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.129874 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b8311ff24259477a9523355908ac14f8 (table default.Table_2e1239a5183b45839ad4a031b7398f95 [id=deaa0ccfa31b4763887d5bfd6418ce26]) successfully deleted
W20260927 13:49:57.130247 4914 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_162ac02f5d444371ad6d85becb6b16a0 [id=de8b7ce50f8c4bb4a105d25f701d4d82], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 85130d7ea68545518ca3c255e28a20d3 consensus state has no leader
I20260927 13:49:57.131618 5626 ts_tablet_manager.cc:1434] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 13:49:57.124871 5628 consensus_queue.cc:260] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.132876 5626 tablet_bootstrap.cc:492] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.134179 5319 leader_election.cc:304] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:57.134562 6607 raft_consensus.cc:493] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.134729 6607 raft_consensus.cc:515] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.134897 6608 raft_consensus.cc:2749] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.135440 6607 leader_election.cc:290] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:57.138648 5626 tablet_bootstrap.cc:654] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:57.139706 5319 leader_election.cc:343] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.140070 5319 leader_election.cc:304] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:49:57.140478 5319 raft_consensus.cc:2686] T 6ce893441d5e4d9f89743e75eb762276 P bb28c54312c94d7dafb1c2abf7870735: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:49:57.142151 5628 ts_tablet_manager.cc:1434] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.019s user 0.002s sys 0.001s
I20260927 13:49:57.142925 5319 leader_election.cc:304] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:57.144691 5623 ts_tablet_manager.cc:1929] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.144881 5623 log.cc:1199] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/559ac90ef36d406881dc17ade0560044
I20260927 13:49:57.145277 5623 ts_tablet_manager.cc:1950] T 559ac90ef36d406881dc17ade0560044 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:57.143996 5606 raft_consensus.cc:2243] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.145915 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 559ac90ef36d406881dc17ade0560044 (table default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]) successfully deleted
I20260927 13:49:57.146188 6608 raft_consensus.cc:2749] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.147356 5606 raft_consensus.cc:2272] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.148123 5606 ts_tablet_manager.cc:1916] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.149848 5628 tablet_bootstrap.cc:492] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:57.151378 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a48792f4c4525bd563a4dd1062e35" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:57.151693 5107 raft_consensus.cc:2468] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:57.153724 5357 tablet_service.cc:1511] Processing CreateTablet for tablet a5feae3a28cd44ff9392a1574a444db3 (DEFAULT_TABLE table=default.Table_8a05998b42404d7aa570c504e6973e38 [id=13d176473e094cb1b8215bc984f49c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.153848 5626 tablet_bootstrap.cc:492] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.154026 5626 ts_tablet_manager.cc:1403] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.001s
I20260927 13:49:57.154168 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5feae3a28cd44ff9392a1574a444db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.154956 5626 raft_consensus.cc:359] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.155172 5626 raft_consensus.cc:385] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.155249 5626 raft_consensus.cc:740] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.155478 5626 consensus_queue.cc:260] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.161900 5319 leader_election.cc:304] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:57.162061 5626 ts_tablet_manager.cc:1434] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260927 13:49:57.162410 5626 tablet_bootstrap.cc:492] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.162583 6611 tablet.cc:1751] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:57.163074 6608 raft_consensus.cc:2804] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:57.163178 6608 raft_consensus.cc:493] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:57.163280 6608 raft_consensus.cc:3060] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.164194 5626 tablet_bootstrap.cc:654] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.166675 6608 raft_consensus.cc:515] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.167487 6608 leader_election.cc:290] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:57.168110 6608 consensus_queue.cc:1048] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:57.173180 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a48792f4c4525bd563a4dd1062e35" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:57.173425 5107 raft_consensus.cc:3060] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.177130 6597 raft_consensus.cc:493] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.177284 6597 raft_consensus.cc:515] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.178139 6597 leader_election.cc:290] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.178743 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f9ae430c414cdf9370388d51dd7c63" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:57.178895 5184 leader_election.cc:343] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: d1f9ae430c414cdf9370388d51dd7c63
I20260927 13:49:57.178912 5107 raft_consensus.cc:2468] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:49:57.179323 5185 leader_election.cc:343] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.179445 5185 leader_election.cc:304] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:57.180006 6597 raft_consensus.cc:2749] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.182719 6493 ts_tablet_manager.cc:1929] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.182847 6493 log.cc:1199] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/2885e0829d014765b54124a0eb23a4dc
I20260927 13:49:57.183171 6493 ts_tablet_manager.cc:1950] T 2885e0829d014765b54124a0eb23a4dc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:57.183401 5319 leader_election.cc:304] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:57.184552 5628 tablet_bootstrap.cc:654] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.184870 6608 raft_consensus.cc:2804] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:57.185178 6608 raft_consensus.cc:697] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:57.185576 6608 consensus_queue.cc:237] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.197184 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a48792f4c4525bd563a4dd1062e35" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:57.198680 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a48792f4c4525bd563a4dd1062e35" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:57.199373 5247 raft_consensus.cc:1275] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Refusing update from remote peer bb28c54312c94d7dafb1c2abf7870735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260927 13:49:57.199859 5319 leader_election.cc:343] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.201959 5083 tablet_service.cc:1511] Processing CreateTablet for tablet a5feae3a28cd44ff9392a1574a444db3 (DEFAULT_TABLE table=default.Table_8a05998b42404d7aa570c504e6973e38 [id=13d176473e094cb1b8215bc984f49c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.205768 5606 ts_tablet_manager.cc:1929] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.205910 5606 log.cc:1199] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/31ee75d0a39c42b09f2f46a1774f925c
I20260927 13:49:57.210968 6591 tablet.cc:1751] T 06b8d6958e6f44d3a98ed96d89d4c1b4 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:57.206300 5606 ts_tablet_manager.cc:1950] T 31ee75d0a39c42b09f2f46a1774f925c P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:57.216141 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 2885e0829d014765b54124a0eb23a4dc (table default.Table_c193f6d7a86a41b58650b5be4520226d [id=ed36c1596e8346f787aaa6271352fe40]) successfully deleted
I20260927 13:49:57.216462 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 31ee75d0a39c42b09f2f46a1774f925c (table default.Table_ee4b85ee72994fe596598538d6755252 [id=c2ce8f3fda214134bf35a2866675d0f7]) successfully deleted
I20260927 13:49:57.218474 5619 tablet_bootstrap.cc:492] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.219056 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a443f65eba384b998fdc57ec57e37d87
I20260927 13:49:57.220793 5619 ts_tablet_manager.cc:1403] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.206s user 0.017s sys 0.010s
I20260927 13:49:57.221697 5619 raft_consensus.cc:359] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.221928 5619 raft_consensus.cc:385] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.221995 5619 raft_consensus.cc:740] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.218752 5606 tablet_replica.cc:333] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:57.222438 5606 raft_consensus.cc:2243] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.222612 5606 raft_consensus.cc:2272] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.223259 5606 ts_tablet_manager.cc:1916] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.224924 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet a443f65eba384b998fdc57ec57e37d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:57.225476 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet a443f65eba384b998fdc57ec57e37d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:57.220567 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet a443f65eba384b998fdc57ec57e37d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:57.228287 5619 consensus_queue.cc:260] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.228397 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a11ce43ce6844620ad9e147959b0d952" } new_table_name: "default.Table_ba46c52966764f5989cc55eed4059edf" modify_external_catalogs: true
I20260927 13:49:57.229816 5619 ts_tablet_manager.cc:1434] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260927 13:49:57.230485 6603 tablet.cc:1751] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:57.235579 5619 tablet_bootstrap.cc:492] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.238961 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 03a1f13b31934baa8ce18fc499e94806
I20260927 13:49:57.241321 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet 03a1f13b31934baa8ce18fc499e94806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:57.241571 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet 03a1f13b31934baa8ce18fc499e94806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:57.241820 6524 consensus_queue.cc:1048] T 351132ca12924a35910ca5473696a02f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:57.243052 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 03a1f13b31934baa8ce18fc499e94806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:57.250010 5619 tablet_bootstrap.cc:654] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.260751 5229 tablet_service.cc:1511] Processing CreateTablet for tablet d237de6ef27c49c4a330c07cb75c103d (DEFAULT_TABLE table=default.Table_e6d47becef9f4cfd8311c129ebee35bd [id=738dc980eaa54501a3c8f944bb5882f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.261200 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d237de6ef27c49c4a330c07cb75c103d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:57.265985 5319 leader_election.cc:343] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.266808 6145 consensus_queue.cc:1048] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:57.270928 5357 tablet_service.cc:1511] Processing CreateTablet for tablet d237de6ef27c49c4a330c07cb75c103d (DEFAULT_TABLE table=default.Table_e6d47becef9f4cfd8311c129ebee35bd [id=738dc980eaa54501a3c8f944bb5882f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.271413 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d237de6ef27c49c4a330c07cb75c103d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.272924 5606 ts_tablet_manager.cc:1929] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.273072 5606 log.cc:1199] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/3b855dedb8d04145b0c4469b9ba79453
I20260927 13:49:57.273473 5606 ts_tablet_manager.cc:1950] T 3b855dedb8d04145b0c4469b9ba79453 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:57.274644 5606 tablet_replica.cc:333] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:57.274823 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 3b855dedb8d04145b0c4469b9ba79453 (table default.Table_fec7020fbf30493cbe6a218ae1cc9dab [id=05951559c98143f5bf067109c7ce2e28]) successfully deleted
I20260927 13:49:57.274899 5606 raft_consensus.cc:2243] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.275063 5606 raft_consensus.cc:2272] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.275722 5606 ts_tablet_manager.cc:1916] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.281229 5157 heartbeater.cc:344] Connected to a master server at 127.4.163.125:42239
I20260927 13:49:57.283427 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 445f0b64c0564670842aa582c998c2de (DEFAULT_TABLE table=default.Table_985a589956d74837978aa757b2b52b61 [id=0babbde1882745c7ac6712c82da30d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.284121 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f0b64c0564670842aa582c998c2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.287158 5619 tablet_bootstrap.cc:492] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.287348 5619 ts_tablet_manager.cc:1403] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.000s
I20260927 13:49:57.288239 5619 raft_consensus.cc:359] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.288544 5619 raft_consensus.cc:385] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.288643 5619 raft_consensus.cc:740] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.289633 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_22fb4180565648f68805c7c792bd8f1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:57.290398 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22fb4180565648f68805c7c792bd8f1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:57.288944 5619 consensus_queue.cc:260] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.292702 5619 ts_tablet_manager.cc:1434] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:57.296146 5619 tablet_bootstrap.cc:492] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.298183 5619 tablet_bootstrap.cc:654] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.312069 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 39fa23553c554826ad811ebe2e978ef9 (DEFAULT_TABLE table=default.Table_3242a0694fbc44279128e33f2c62d622 [id=c6c9a8e5e29c4681a4c8823ddcc15869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.312757 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fa23553c554826ad811ebe2e978ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.317747 5077 tablet_service.cc:1511] Processing CreateTablet for tablet d237de6ef27c49c4a330c07cb75c103d (DEFAULT_TABLE table=default.Table_e6d47becef9f4cfd8311c129ebee35bd [id=738dc980eaa54501a3c8f944bb5882f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.318176 6592 tablet.cc:1751] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:57.322067 5619 tablet_bootstrap.cc:492] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.322295 5619 ts_tablet_manager.cc:1403] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.003s
I20260927 13:49:57.323308 5619 raft_consensus.cc:359] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.323468 6493 tablet_replica.cc:333] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:57.323647 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5feae3a28cd44ff9392a1574a444db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.323658 6493 raft_consensus.cc:2243] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.323498 5619 raft_consensus.cc:385] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.323748 5619 raft_consensus.cc:740] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.323815 6493 raft_consensus.cc:2272] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.324046 5619 consensus_queue.cc:260] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.324335 6493 ts_tablet_manager.cc:1916] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.324694 5619 ts_tablet_manager.cc:1434] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:57.324992 5619 tablet_bootstrap.cc:492] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.326587 5619 tablet_bootstrap.cc:654] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.330621 5606 ts_tablet_manager.cc:1929] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.330747 5606 log.cc:1199] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/56b9612ffea543b9b0779c46533d91ab
I20260927 13:49:57.330912 6493 ts_tablet_manager.cc:1929] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.331014 6493 log.cc:1199] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/794da0992403462dbbce644134b8aab3
I20260927 13:49:57.331300 6493 ts_tablet_manager.cc:1950] T 794da0992403462dbbce644134b8aab3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:57.333523 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 794da0992403462dbbce644134b8aab3 (table default.Table_e11854abc7164d67b4195185f22c8295 [id=49a148957d6b4260ab46333b2bc3ef5e]) successfully deleted
I20260927 13:49:57.334893 6493 tablet_replica.cc:333] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:57.335099 6493 raft_consensus.cc:2243] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.335261 6493 raft_consensus.cc:2272] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.335924 6493 ts_tablet_manager.cc:1916] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.338007 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d237de6ef27c49c4a330c07cb75c103d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.342485 5606 ts_tablet_manager.cc:1950] T 56b9612ffea543b9b0779c46533d91ab P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:57.343858 5606 tablet_replica.cc:333] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:57.344107 5606 raft_consensus.cc:2243] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.344130 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 56b9612ffea543b9b0779c46533d91ab (table default.Table_8f56db43a65c4bd5a295fc1966c944a2 [id=a8089fe90d01478dbf155541ed227099]) successfully deleted
I20260927 13:49:57.344296 5606 raft_consensus.cc:2272] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:57.344408 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet c57b60cbc1ca462789fd8e7a235f7119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c57b60cbc1ca462789fd8e7a235f7119 already in progress: creating tablet
I20260927 13:49:57.344822 5606 ts_tablet_manager.cc:1916] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:57.344938 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 7a40f69bb7d842889be30c4629d6786f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a40f69bb7d842889be30c4629d6786f already in progress: creating tablet
I20260927 13:49:57.347200 5619 tablet_bootstrap.cc:492] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.347355 5619 ts_tablet_manager.cc:1403] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20260927 13:49:57.348031 5619 raft_consensus.cc:359] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.348212 5619 raft_consensus.cc:385] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.348294 5619 raft_consensus.cc:740] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.348526 5619 consensus_queue.cc:260] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.349030 5619 ts_tablet_manager.cc:1434] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:57.349318 5619 tablet_bootstrap.cc:492] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.350808 5619 tablet_bootstrap.cc:654] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.354050 6546 raft_consensus.cc:493] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.354251 6546 raft_consensus.cc:515] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.354441 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 4d35148d80b44fca9b39a4625d3e61c1
I20260927 13:49:57.354944 4924 catalog_manager.cc:6934] ReplaceTablet: tablet 4d35148d80b44fca9b39a4625d3e61c1 deleted and replaced by tablet 329fa4c25cec48f9830a8eb19794ea72
I20260927 13:49:57.355005 6546 leader_election.cc:290] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:57.356840 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36181512a94c4702ae0a417665919faa" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:57.358441 5044 leader_election.cc:343] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.360159 6524 raft_consensus.cc:493] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.360376 6524 raft_consensus.cc:515] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.361411 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a97f4df3a84781bfcbdc768d518ef0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:57.361600 5384 raft_consensus.cc:2468] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:57.362082 5185 leader_election.cc:304] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:57.362447 6578 raft_consensus.cc:2804] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:57.362576 6578 raft_consensus.cc:493] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:57.362677 6578 raft_consensus.cc:3060] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.363842 6524 leader_election.cc:290] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.364101 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d35148d80b44fca9b39a4625d3e61c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 329fa4c25cec48f9830a8eb19794ea72) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:57.364406 5184 leader_election.cc:343] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a7a97f4df3a84781bfcbdc768d518ef0
I20260927 13:49:57.365204 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36181512a94c4702ae0a417665919faa" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:57.365724 6493 ts_tablet_manager.cc:1929] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:49:57.365777 5045 leader_election.cc:343] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.365852 6493 log.cc:1199] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/3933c0a2fd6547f28528fae7d443a2c1
I20260927 13:49:57.365888 5045 leader_election.cc:304] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:57.366205 6493 ts_tablet_manager.cc:1950] T 3933c0a2fd6547f28528fae7d443a2c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:57.366240 6546 raft_consensus.cc:2749] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.366674 6145 raft_consensus.cc:493] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.366823 6145 raft_consensus.cc:515] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.366997 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d35148d80b44fca9b39a4625d3e61c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 329fa4c25cec48f9830a8eb19794ea72) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:57.367178 6493 tablet_replica.cc:333] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:57.367385 6493 raft_consensus.cc:2243] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.367367 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 3933c0a2fd6547f28528fae7d443a2c1 (table default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]) successfully deleted
I20260927 13:49:57.367462 6145 leader_election.cc:290] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.367530 6493 raft_consensus.cc:2272] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:57.368487 5319 leader_election.cc:343] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 1245334728994a60ad641c2e90f8d2df
I20260927 13:49:57.366838 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d35148d80b44fca9b39a4625d3e61c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 329fa4c25cec48f9830a8eb19794ea72) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:57.369364 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1245334728994a60ad641c2e90f8d2df" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:57.369598 5247 raft_consensus.cc:2468] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:57.370007 5319 leader_election.cc:304] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:57.369971 4924 catalog_manager.cc:5838] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } }
I20260927 13:49:57.370422 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 931a48792f4c4525bd563a4dd1062e35 (table default.Table_3b7666d87acf47bda3e3e2545c8cfb25 [id=bed97aef149a417bb3807414f58ba52a]). Expected version 2 got 0
I20260927 13:49:57.370467 6145 raft_consensus.cc:2804] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:57.370534 6145 raft_consensus.cc:493] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:57.370595 6145 raft_consensus.cc:3060] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.372078 5606 ts_tablet_manager.cc:1929] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.372221 5606 log.cc:1199] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/059afd48ac4a41569ed1d3556b7974f0
I20260927 13:49:57.372541 5606 ts_tablet_manager.cc:1950] T 059afd48ac4a41569ed1d3556b7974f0 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:57.373409 6145 raft_consensus.cc:515] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.373914 5606 tablet_replica.cc:333] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:57.373947 6145 leader_election.cc:290] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.374445 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 059afd48ac4a41569ed1d3556b7974f0 (table default.Table_020de70ec7bc4e119d5c6a3e22d8d32d [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
W20260927 13:49:57.374714 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 64c7919f5076406186000cd4077aadaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64c7919f5076406186000cd4077aadaf already in progress: creating tablet
W20260927 13:49:57.374945 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet bb980bca9f16480ba050971b58aa46f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb980bca9f16480ba050971b58aa46f3 already in progress: creating tablet
W20260927 13:49:57.375164 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 7e3b98290dc74d88856e13f003a1e4c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e3b98290dc74d88856e13f003a1e4c7 already in progress: creating tablet
I20260927 13:49:57.375560 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1245334728994a60ad641c2e90f8d2df" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:57.376220 6493 ts_tablet_manager.cc:1916] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.378146 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2e768c83fae54619ac849dfedd5ec654
I20260927 13:49:57.381960 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e768c83fae54619ac849dfedd5ec654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:57.382432 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e768c83fae54619ac849dfedd5ec654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:57.375108 5319 leader_election.cc:343] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 1245334728994a60ad641c2e90f8d2df
I20260927 13:49:57.374094 5606 raft_consensus.cc:2243] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.385527 5606 raft_consensus.cc:2272] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.386050 5626 tablet_bootstrap.cc:492] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.386224 5626 ts_tablet_manager.cc:1403] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.224s user 0.011s sys 0.045s
I20260927 13:49:57.382316 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e768c83fae54619ac849dfedd5ec654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:57.386650 5606 ts_tablet_manager.cc:1916] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.387094 5626 raft_consensus.cc:359] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.387272 5626 raft_consensus.cc:385] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.387332 5626 raft_consensus.cc:740] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.388286 5619 tablet_bootstrap.cc:492] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.388316 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 39fa23553c554826ad811ebe2e978ef9 (DEFAULT_TABLE table=default.Table_3242a0694fbc44279128e33f2c62d622 [id=c6c9a8e5e29c4681a4c8823ddcc15869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.388470 5619 ts_tablet_manager.cc:1403] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.002s
I20260927 13:49:57.388800 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fa23553c554826ad811ebe2e978ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.389142 5619 raft_consensus.cc:359] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.389338 5619 raft_consensus.cc:385] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.389412 5619 raft_consensus.cc:740] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.389669 5619 consensus_queue.cc:260] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.390218 5619 ts_tablet_manager.cc:1434] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:57.390532 5619 tablet_bootstrap.cc:492] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.390758 5628 tablet_bootstrap.cc:492] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:57.390887 5628 ts_tablet_manager.cc:1403] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.241s user 0.027s sys 0.032s
I20260927 13:49:57.391563 5628 raft_consensus.cc:359] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.391723 5628 raft_consensus.cc:385] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.391781 5628 raft_consensus.cc:740] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.392037 5619 tablet_bootstrap.cc:654] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.392004 5628 consensus_queue.cc:260] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.392480 5628 ts_tablet_manager.cc:1434] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:57.396075 5628 tablet_bootstrap.cc:492] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:57.396296 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 39fa23553c554826ad811ebe2e978ef9 (DEFAULT_TABLE table=default.Table_3242a0694fbc44279128e33f2c62d622 [id=c6c9a8e5e29c4681a4c8823ddcc15869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.396723 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fa23553c554826ad811ebe2e978ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.397437 5628 tablet_bootstrap.cc:654] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.398322 5247 raft_consensus.cc:3060] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.402293 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 2e768c83fae54619ac849dfedd5ec654 (DEFAULT_TABLE table=default.Table_26e3d3422d594674a8d1c56b2e6e73ab [id=d9d9b43568984624a5c3787937252db5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.402884 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e768c83fae54619ac849dfedd5ec654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.404217 5626 consensus_queue.cc:260] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.405267 5628 tablet_bootstrap.cc:492] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:57.405409 5628 ts_tablet_manager.cc:1403] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s
I20260927 13:49:57.405844 5626 ts_tablet_manager.cc:1434] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.020s user 0.000s sys 0.002s
I20260927 13:49:57.406172 5626 tablet_bootstrap.cc:492] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.406138 5628 raft_consensus.cc:359] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.406302 5628 raft_consensus.cc:385] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.406375 5628 raft_consensus.cc:740] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.406553 5628 consensus_queue.cc:260] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.406994 5628 ts_tablet_manager.cc:1434] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:57.407245 5628 tablet_bootstrap.cc:492] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:57.407574 5626 tablet_bootstrap.cc:654] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.408564 5628 tablet_bootstrap.cc:654] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.411237 5623 tablet_replica.cc:333] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:57.411463 5623 raft_consensus.cc:2243] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.411641 5623 raft_consensus.cc:2272] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.412189 5623 ts_tablet_manager.cc:1916] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.413094 6493 ts_tablet_manager.cc:1929] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.413213 6493 log.cc:1199] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/3700a1f40c0644848da62392cb0c297f
I20260927 13:49:57.417491 5628 tablet_bootstrap.cc:492] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:57.417615 5628 ts_tablet_manager.cc:1403] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260927 13:49:57.418237 5628 raft_consensus.cc:359] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.418395 5628 raft_consensus.cc:385] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.418447 5628 raft_consensus.cc:740] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.418643 5628 consensus_queue.cc:260] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.419085 5628 ts_tablet_manager.cc:1434] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 13:49:57.419360 5628 tablet_bootstrap.cc:492] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:57.420576 5628 tablet_bootstrap.cc:654] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.421288 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3612744880954a2fbd6f1d46583fb14b" } new_table_name: "default.Table_72330b1053c147a48acac2e12df2dcc0" modify_external_catalogs: true
I20260927 13:49:57.413570 6493 ts_tablet_manager.cc:1950] T 3700a1f40c0644848da62392cb0c297f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:57.425071 6493 tablet_replica.cc:333] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:57.425254 6493 raft_consensus.cc:2243] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.425413 6493 raft_consensus.cc:2272] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.425395 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 3700a1f40c0644848da62392cb0c297f (table default.Table_22a8a2d3c05d409480ef5c85b521fa0d [id=9982cd84b23842e89881d5ba772f6b31]) successfully deleted
I20260927 13:49:57.425928 6493 ts_tablet_manager.cc:1916] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.427613 5628 tablet_bootstrap.cc:492] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:57.427732 5628 ts_tablet_manager.cc:1403] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260927 13:49:57.428020 6577 sys_catalog.cc:455] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 802b83f09d3445359cfac825cd87c9de. Latest consensus state: current_term: 3 leader_uuid: "802b83f09d3445359cfac825cd87c9de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:57.428273 6577 sys_catalog.cc:458] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:49:57.428346 5628 raft_consensus.cc:359] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.428493 5628 raft_consensus.cc:385] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.428452 6624 raft_consensus.cc:493] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 802b83f09d3445359cfac825cd87c9de)
I20260927 13:49:57.428544 5628 raft_consensus.cc:740] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.428733 5628 consensus_queue.cc:260] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.428707 6624 raft_consensus.cc:515] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:49:57.429168 5628 ts_tablet_manager.cc:1434] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 13:49:57.429423 5628 tablet_bootstrap.cc:492] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:57.429915 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2d64750141d74d988612304ce050688d
I20260927 13:49:57.430765 5628 tablet_bootstrap.cc:654] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.431434 5619 tablet_bootstrap.cc:492] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.431569 5619 ts_tablet_manager.cc:1403] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260927 13:49:57.432046 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64750141d74d988612304ce050688d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:57.432220 5619 raft_consensus.cc:359] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.432452 5619 raft_consensus.cc:385] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.432509 5619 raft_consensus.cc:740] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.432717 5619 consensus_queue.cc:260] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.432943 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64750141d74d988612304ce050688d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:57.433259 5619 ts_tablet_manager.cc:1434] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:57.433498 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64750141d74d988612304ce050688d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:57.433559 5619 tablet_bootstrap.cc:492] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.435376 5619 tablet_bootstrap.cc:654] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.436049 6624 leader_election.cc:290] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:49:57.443179 5606 ts_tablet_manager.cc:1929] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.443326 5606 log.cc:1199] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/1245334728994a60ad641c2e90f8d2df
I20260927 13:49:57.443509 6591 tablet.cc:1751] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:57.443673 5606 ts_tablet_manager.cc:1950] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:57.447582 5626 tablet_bootstrap.cc:492] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.447711 5626 ts_tablet_manager.cc:1403] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.000s
I20260927 13:49:57.448460 5626 raft_consensus.cc:359] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.448626 5626 raft_consensus.cc:385] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.448690 5626 raft_consensus.cc:740] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.448988 5626 consensus_queue.cc:260] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.450789 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 1245334728994a60ad641c2e90f8d2df (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]) successfully deleted
W20260927 13:49:57.451683 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet d9198ace6a264737a990d6fb573faf2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9198ace6a264737a990d6fb573faf2d already in progress: creating tablet
I20260927 13:49:57.454006 5626 ts_tablet_manager.cc:1434] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260927 13:49:57.454325 5626 tablet_bootstrap.cc:492] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.454711 5606 tablet_replica.cc:333] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:57.454910 5606 raft_consensus.cc:2243] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.455068 5606 raft_consensus.cc:2272] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.455603 5606 ts_tablet_manager.cc:1916] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.455817 5626 tablet_bootstrap.cc:654] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.458000 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 2e768c83fae54619ac849dfedd5ec654 (DEFAULT_TABLE table=default.Table_26e3d3422d594674a8d1c56b2e6e73ab [id=d9d9b43568984624a5c3787937252db5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.458447 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e768c83fae54619ac849dfedd5ec654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.460045 6467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34360 (request call id 0) took 1564 ms. Trace:
I20260927 13:49:57.461084 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_74634e550bd54c0cb0f52004fa14c8af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:57.462211 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74634e550bd54c0cb0f52004fa14c8af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:57.468127 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 2e768c83fae54619ac849dfedd5ec654 (DEFAULT_TABLE table=default.Table_26e3d3422d594674a8d1c56b2e6e73ab [id=d9d9b43568984624a5c3787937252db5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.470477 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb1d6091729498698924e6857ebfd6c (DEFAULT_TABLE table=default.Table_8cda445237a34eac8407eedddae90d1e [id=8f547ebbb90047fabb7ff5a35a56c857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.470908 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb1d6091729498698924e6857ebfd6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.472318 5805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 755 } } ignore_live_leader: false dest_uuid: "13a42ae8b95b495c9bcea85d6732cd77" is_pre_election: true
I20260927 13:49:57.472898 5619 tablet_bootstrap.cc:492] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.473037 5619 ts_tablet_manager.cc:1403] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.000s
I20260927 13:49:57.473750 5619 raft_consensus.cc:359] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.473918 5619 raft_consensus.cc:385] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.473980 5619 raft_consensus.cc:740] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.474574 5626 tablet_bootstrap.cc:492] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.474727 5626 ts_tablet_manager.cc:1403] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260927 13:49:57.475495 5626 raft_consensus.cc:359] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.475673 5626 raft_consensus.cc:385] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.475733 5626 raft_consensus.cc:740] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.480965 6493 ts_tablet_manager.cc:1929] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.481101 6493 log.cc:1199] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/3bbeeadecf3b40c28d0e4f63a22eb4f0
I20260927 13:49:57.481455 6493 ts_tablet_manager.cc:1950] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:57.482263 5626 consensus_queue.cc:260] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.486568 5619 consensus_queue.cc:260] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.487154 5619 ts_tablet_manager.cc:1434] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260927 13:49:57.489997 5626 ts_tablet_manager.cc:1434] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260927 13:49:57.493007 5606 ts_tablet_manager.cc:1929] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.493134 5606 log.cc:1199] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/98ffe83306e74749b5b3f68e6c2c708c
I20260927 13:49:57.493458 5606 ts_tablet_manager.cc:1950] T 98ffe83306e74749b5b3f68e6c2c708c P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:57.496272 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e768c83fae54619ac849dfedd5ec654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.498407 5626 tablet_bootstrap.cc:492] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.500191 5626 tablet_bootstrap.cc:654] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.506832 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 (table default.Table_8e30f259d16146d18136753eb1805e15 [id=ee0789e9d1f34c3791d35794473e2246]) successfully deleted
I20260927 13:49:57.507282 6493 tablet_replica.cc:333] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:57.507586 6493 raft_consensus.cc:2243] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.507849 6493 raft_consensus.cc:2272] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.508533 6493 ts_tablet_manager.cc:1916] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.511027 5626 tablet_bootstrap.cc:492] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.511209 5626 ts_tablet_manager.cc:1403] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260927 13:49:57.513916 5626 raft_consensus.cc:359] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.514154 5626 raft_consensus.cc:385] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.514232 5626 raft_consensus.cc:740] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.514444 5626 consensus_queue.cc:260] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.514629 6145 raft_consensus.cc:493] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.514767 6145 raft_consensus.cc:515] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.515419 6145 leader_election.cc:290] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.516119 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c332b6ec9ca94ce398a71e82e20897d4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:57.516320 5107 raft_consensus.cc:2468] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:57.517168 5319 leader_election.cc:304] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:57.517540 6145 raft_consensus.cc:2804] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:57.517614 6145 raft_consensus.cc:493] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:57.517670 6145 raft_consensus.cc:3060] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.519104 5626 ts_tablet_manager.cc:1434] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260927 13:49:57.520682 6145 raft_consensus.cc:515] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.519400 5626 tablet_bootstrap.cc:492] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.521709 5227 tablet_service.cc:1511] Processing CreateTablet for tablet c99bf2abdfc64f169a3937f3e4499f75 (DEFAULT_TABLE table=default.Table_52cd6f5926494db78b6f05c29b36d509 [id=3f11aa4dd2e5436b942c02b53621b04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.521829 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb1d6091729498698924e6857ebfd6c (DEFAULT_TABLE table=default.Table_8cda445237a34eac8407eedddae90d1e [id=8f547ebbb90047fabb7ff5a35a56c857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.522209 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99bf2abdfc64f169a3937f3e4499f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.523188 5626 tablet_bootstrap.cc:654] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.523468 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c332b6ec9ca94ce398a71e82e20897d4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:57.527513 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb1d6091729498698924e6857ebfd6c (DEFAULT_TABLE table=default.Table_8cda445237a34eac8407eedddae90d1e [id=8f547ebbb90047fabb7ff5a35a56c857]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:57.527714 5319 leader_election.cc:343] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.528015 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb1d6091729498698924e6857ebfd6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.529939 6609 raft_consensus.cc:493] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.530480 6609 raft_consensus.cc:515] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.530571 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c332b6ec9ca94ce398a71e82e20897d4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:57.531204 5319 leader_election.cc:343] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.532686 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec40378eb80c412198d5b66c02e975ef" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:57.533221 5319 leader_election.cc:343] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:57.533437 5319 leader_election.cc:343] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: ec40378eb80c412198d5b66c02e975ef
I20260927 13:49:57.533514 5319 leader_election.cc:304] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:57.533743 6608 raft_consensus.cc:2749] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.534013 6145 leader_election.cc:290] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.534641 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c332b6ec9ca94ce398a71e82e20897d4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:57.534827 5107 raft_consensus.cc:3060] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.538344 5107 raft_consensus.cc:2468] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:57.538899 5319 leader_election.cc:304] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:57.539569 6145 raft_consensus.cc:2804] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:57.539768 6145 raft_consensus.cc:697] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:57.540083 6145 consensus_queue.cc:237] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.531214 6609 leader_election.cc:290] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.542388 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3656ebf9c8b64bff8f00bf1941a3aec4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:57.542981 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3656ebf9c8b64bff8f00bf1941a3aec4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:57.548213 5626 tablet_bootstrap.cc:492] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.548381 5626 ts_tablet_manager.cc:1403] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260927 13:49:57.549171 5626 raft_consensus.cc:359] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.549355 5626 raft_consensus.cc:385] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.549397 5626 raft_consensus.cc:740] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.549621 5626 consensus_queue.cc:260] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.550117 5626 ts_tablet_manager.cc:1434] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:57.551951 4928 master_service.cc:960] ReplaceTablet: received request to replace tablet d9cb99ad45d1445cb2e2854319a3d73d from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:57.553903 5626 tablet_bootstrap.cc:492] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.555708 5619 tablet_bootstrap.cc:492] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.555735 5626 tablet_bootstrap.cc:654] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.557834 5619 tablet_bootstrap.cc:654] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.559286 6546 raft_consensus.cc:493] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.559432 6546 raft_consensus.cc:515] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.560053 6546 leader_election.cc:290] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:57.561224 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb25bb5ee153494d803130f1ad4f7c2e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:57.561797 5045 leader_election.cc:343] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.563212 6609 consensus_queue.cc:1048] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:57.564108 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb25bb5ee153494d803130f1ad4f7c2e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:57.564828 5044 leader_election.cc:343] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.564944 5044 leader_election.cc:304] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:57.565294 6546 raft_consensus.cc:2749] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.574524 5619 tablet_bootstrap.cc:492] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.574765 5619 ts_tablet_manager.cc:1403] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.006s
I20260927 13:49:57.575503 5247 raft_consensus.cc:2468] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:57.575625 5619 raft_consensus.cc:359] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.575798 5619 raft_consensus.cc:385] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.575855 5619 raft_consensus.cc:740] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.576122 5619 consensus_queue.cc:260] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.576212 5319 leader_election.cc:304] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
W20260927 13:49:57.576399 5319 raft_consensus.cc:2686] T 1245334728994a60ad641c2e90f8d2df P bb28c54312c94d7dafb1c2abf7870735: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:49:57.576818 5619 ts_tablet_manager.cc:1434] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:57.577095 5619 tablet_bootstrap.cc:492] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.578168 6578 raft_consensus.cc:515] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.579465 6578 leader_election.cc:290] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.579176 5619 tablet_bootstrap.cc:654] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.583958 5626 tablet_bootstrap.cc:492] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.584124 5626 ts_tablet_manager.cc:1403] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
W20260927 13:49:57.584223 5184 leader_election.cc:343] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a7a97f4df3a84781bfcbdc768d518ef0
I20260927 13:49:57.585203 5626 raft_consensus.cc:359] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.585453 5626 raft_consensus.cc:385] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.585541 5626 raft_consensus.cc:740] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.585889 5626 consensus_queue.cc:260] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.586582 5626 ts_tablet_manager.cc:1434] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:49:57.586942 5626 tablet_bootstrap.cc:492] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.587730 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a97f4df3a84781bfcbdc768d518ef0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:57.587971 5382 raft_consensus.cc:3060] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.590986 5619 tablet_bootstrap.cc:492] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.591126 5619 ts_tablet_manager.cc:1403] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.006s
I20260927 13:49:57.591514 5382 raft_consensus.cc:2468] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:57.594913 5626 tablet_bootstrap.cc:654] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.602572 6455 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" instance_seqno: 1790516980068287) as {username='slave'} at 127.4.163.65:57911; Asking this server to re-register.
I20260927 13:49:57.604913 5157 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:57.591812 5619 raft_consensus.cc:359] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.605418 5619 raft_consensus.cc:385] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.605516 5619 raft_consensus.cc:740] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.605777 5185 leader_election.cc:304] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:57.605794 5619 consensus_queue.cc:260] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.606396 5619 ts_tablet_manager.cc:1434] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260927 13:49:57.606397 6578 raft_consensus.cc:2804] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:57.606698 5619 tablet_bootstrap.cc:492] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.606863 6578 raft_consensus.cc:697] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:57.607105 6578 consensus_queue.cc:237] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.608986 5619 tablet_bootstrap.cc:654] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.609946 6455 ts_manager.cc:194] Registered new tserver with Master: 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.611259 5247 raft_consensus.cc:3060] T a81b44fb2f644dff899d6d4aa435ccee P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.615075 6524 raft_consensus.cc:493] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.615199 6524 raft_consensus.cc:515] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.615868 6524 leader_election.cc:290] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.616237 6608 consensus_queue.cc:1048] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:49:57.617664 5184 leader_election.cc:343] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 321b26c89f1a4c8d88f401c8ece448b0
W20260927 13:49:57.618860 5185 leader_election.cc:343] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 321b26c89f1a4c8d88f401c8ece448b0
I20260927 13:49:57.618948 5185 leader_election.cc:304] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:57.619375 6524 raft_consensus.cc:2749] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.620846 5626 tablet_bootstrap.cc:492] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.621012 5626 ts_tablet_manager.cc:1403] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.002s
I20260927 13:49:57.621060 6493 ts_tablet_manager.cc:1929] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.621156 6493 log.cc:1199] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/bbb4f42522e84964aeb19358ee02dfc2
I20260927 13:49:57.621469 6493 ts_tablet_manager.cc:1950] T bbb4f42522e84964aeb19358ee02dfc2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:57.621752 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 593) took 1110 ms. Trace:
I20260927 13:49:57.621834 6493 rpcz_store.cc:276] 0927 13:49:56.511069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.512101 (+ 1032us) service_pool.cc:224] Handling call
0927 13:49:57.507215 (+995114us) ts_tablet_manager.cc:1151] Deleting tablet bbb4f42522e84964aeb19358ee02dfc2
0927 13:49:57.507229 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:57.617962 (+110733us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:57.621009 (+ 3047us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:57.621736 (+ 727us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":994998}
I20260927 13:49:57.622068 5626 raft_consensus.cc:359] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.622364 5626 raft_consensus.cc:385] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.622445 5626 raft_consensus.cc:740] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.622525 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet bbb4f42522e84964aeb19358ee02dfc2 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]) successfully deleted
I20260927 13:49:57.622777 5626 consensus_queue.cc:260] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.623549 5626 ts_tablet_manager.cc:1434] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:49:57.628597 4925 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_ee7a89c46e4f454fb0922cafbc796e8e [id=112cd821498b427fb3b0d517cd0d55f3] alter complete (version 2)
I20260927 13:49:57.629024 4925 master_service.cc:960] ReplaceTablet: received request to replace tablet bb6073174dbb4ca1933685b7bd3a22e1 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:57.631537 5628 tablet_bootstrap.cc:492] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:57.631675 5628 ts_tablet_manager.cc:1403] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.202s user 0.021s sys 0.022s
I20260927 13:49:57.631748 4940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 755 } } ignore_live_leader: false dest_uuid: "802b83f09d3445359cfac825cd87c9de" is_pre_election: true
I20260927 13:49:57.632412 6429 leader_election.cc:304] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e421351a34d1463e9773dcebdeebae3c; no voters: 13a42ae8b95b495c9bcea85d6732cd77, 802b83f09d3445359cfac825cd87c9de
I20260927 13:49:57.633212 6624 raft_consensus.cc:2749] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260927 13:49:57.633839 5628 raft_consensus.cc:359] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.634001 5628 raft_consensus.cc:385] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.634048 5628 raft_consensus.cc:740] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.634336 5628 consensus_queue.cc:260] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.634893 5628 ts_tablet_manager.cc:1434] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:57.635324 6578 raft_consensus.cc:493] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.635457 6578 raft_consensus.cc:515] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.635812 5628 tablet_bootstrap.cc:492] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:57.636077 6578 leader_election.cc:290] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.636190 6578 raft_consensus.cc:493] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.636296 6578 raft_consensus.cc:515] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.636843 6578 leader_election.cc:290] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:57.638808 5184 leader_election.cc:343] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b8311ff24259477a9523355908ac14f8
I20260927 13:49:57.639312 5619 tablet_bootstrap.cc:492] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.639460 5619 ts_tablet_manager.cc:1403] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.003s
I20260927 13:49:57.639617 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03917a40b5884401a6bc09c7925fd1ae" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:57.639844 5384 raft_consensus.cc:2393] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:49:57.640224 5619 raft_consensus.cc:359] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.640432 5619 raft_consensus.cc:385] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.640486 5619 raft_consensus.cc:740] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.641542 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03917a40b5884401a6bc09c7925fd1ae" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:57.642132 5184 leader_election.cc:304] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:57.642692 6578 raft_consensus.cc:3060] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.644415 5619 consensus_queue.cc:260] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.645650 6578 raft_consensus.cc:2749] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.646445 5619 ts_tablet_manager.cc:1434] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 13:49:57.646744 5619 tablet_bootstrap.cc:492] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.647430 5628 tablet_bootstrap.cc:654] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.635535 5623 ts_tablet_manager.cc:1929] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.648316 5619 tablet_bootstrap.cc:654] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.648348 5623 log.cc:1199] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f70b70eb29cb4361a12ed393eabb82e1
W20260927 13:49:57.648820 5185 leader_election.cc:343] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: b8311ff24259477a9523355908ac14f8
I20260927 13:49:57.651480 5185 leader_election.cc:304] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:57.651919 6578 raft_consensus.cc:2749] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.652524 5623 ts_tablet_manager.cc:1950] T f70b70eb29cb4361a12ed393eabb82e1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:57.653080 6455 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" instance_seqno: 1790516981114403) as {username='slave'} at 127.4.163.67:48295; Asking this server to re-register.
I20260927 13:49:57.653998 6493 tablet_replica.cc:333] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:57.654304 6493 raft_consensus.cc:2243] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.654484 6493 raft_consensus.cc:2272] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.654971 6493 ts_tablet_manager.cc:1916] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.663069 5432 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:57.663396 5357 tablet_service.cc:1511] Processing CreateTablet for tablet c99bf2abdfc64f169a3937f3e4499f75 (DEFAULT_TABLE table=default.Table_52cd6f5926494db78b6f05c29b36d509 [id=3f11aa4dd2e5436b942c02b53621b04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.663887 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99bf2abdfc64f169a3937f3e4499f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.666887 5628 tablet_bootstrap.cc:492] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:57.667022 5628 ts_tablet_manager.cc:1403] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20260927 13:49:57.667711 5628 raft_consensus.cc:359] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.668116 5628 raft_consensus.cc:385] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.668185 5628 raft_consensus.cc:740] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.668466 5628 consensus_queue.cc:260] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.668516 5077 tablet_service.cc:1511] Processing CreateTablet for tablet c99bf2abdfc64f169a3937f3e4499f75 (DEFAULT_TABLE table=default.Table_52cd6f5926494db78b6f05c29b36d509 [id=3f11aa4dd2e5436b942c02b53621b04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.668810 6609 raft_consensus.cc:493] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.668948 6609 raft_consensus.cc:515] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.669167 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99bf2abdfc64f169a3937f3e4499f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.669602 6609 leader_election.cc:290] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.669989 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f9ae430c414cdf9370388d51dd7c63" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:57.670195 5249 raft_consensus.cc:2468] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:57.670648 5319 leader_election.cc:304] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:49:57.671012 5319 leader_election.cc:343] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: d1f9ae430c414cdf9370388d51dd7c63
I20260927 13:49:57.671157 5628 ts_tablet_manager.cc:1434] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:49:57.671372 6609 raft_consensus.cc:2804] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:57.671416 5628 tablet_bootstrap.cc:492] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:57.671453 6609 raft_consensus.cc:493] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:57.671532 6609 raft_consensus.cc:3060] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.672945 5628 tablet_bootstrap.cc:654] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.675679 6609 raft_consensus.cc:515] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.676925 6493 ts_tablet_manager.cc:1929] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.677028 6493 log.cc:1199] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/06c810fde988439c97a8445fc88626b3
I20260927 13:49:57.676980 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f9ae430c414cdf9370388d51dd7c63" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:57.677152 5249 raft_consensus.cc:3060] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.677402 6609 leader_election.cc:290] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:57.677920 5319 leader_election.cc:343] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: d1f9ae430c414cdf9370388d51dd7c63
I20260927 13:49:57.679958 5249 raft_consensus.cc:2468] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:57.680490 5319 leader_election.cc:304] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:57.680967 6609 raft_consensus.cc:2804] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:57.681309 6609 raft_consensus.cc:697] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:57.681692 6609 consensus_queue.cc:237] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.682334 6493 ts_tablet_manager.cc:1950] T 06c810fde988439c97a8445fc88626b3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:57.682636 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 598) took 1170 ms. Trace:
I20260927 13:49:57.682709 6493 rpcz_store.cc:276] 0927 13:49:56.512327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.512373 (+ 46us) service_pool.cc:224] Handling call
0927 13:49:57.653944 (+1141571us) ts_tablet_manager.cc:1151] Deleting tablet 06c810fde988439c97a8445fc88626b3
0927 13:49:57.653955 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:57.674098 (+ 20143us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:57.676884 (+ 2786us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:57.682622 (+ 5738us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1141432}
I20260927 13:49:57.683027 6493 tablet_replica.cc:333] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:57.683215 6493 raft_consensus.cc:2243] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.683370 6493 raft_consensus.cc:2272] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.683873 6493 ts_tablet_manager.cc:1916] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.686693 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 06c810fde988439c97a8445fc88626b3 (table default.Table_2bf1c8729308443bba92997d06f84e9e [id=861ae0d96dd54f1dac15e3cce0ed657a]) successfully deleted
I20260927 13:49:57.687793 5628 tablet_bootstrap.cc:492] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:57.687924 5628 ts_tablet_manager.cc:1403] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.001s
I20260927 13:49:57.688639 5628 raft_consensus.cc:359] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.688793 5628 raft_consensus.cc:385] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.688848 5628 raft_consensus.cc:740] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.689052 5628 consensus_queue.cc:260] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.689553 5628 ts_tablet_manager.cc:1434] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:57.689815 5628 tablet_bootstrap.cc:492] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:57.691416 5628 tablet_bootstrap.cc:654] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.693750 6454 ts_manager.cc:194] Registered new tserver with Master: bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:57.710090 6493 ts_tablet_manager.cc:1929] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.710254 6493 log.cc:1199] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/8e8bf79954c2429f886ac7afc9a8455f
I20260927 13:49:57.710542 6493 ts_tablet_manager.cc:1950] T 8e8bf79954c2429f886ac7afc9a8455f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:57.710840 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 589) took 1203 ms. Trace:
I20260927 13:49:57.710911 6493 rpcz_store.cc:276] 0927 13:49:56.507485 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.513071 (+ 5586us) service_pool.cc:224] Handling call
0927 13:49:57.682984 (+1169913us) ts_tablet_manager.cc:1151] Deleting tablet 8e8bf79954c2429f886ac7afc9a8455f
0927 13:49:57.682993 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:57.705665 (+ 22672us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:57.710031 (+ 4366us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:57.710824 (+ 793us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1169784}
I20260927 13:49:57.711226 6493 tablet_replica.cc:333] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:57.711429 6493 raft_consensus.cc:2243] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.711401 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 8e8bf79954c2429f886ac7afc9a8455f (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]) successfully deleted
I20260927 13:49:57.711567 6493 raft_consensus.cc:2272] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.711740 6578 raft_consensus.cc:493] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.711882 6578 raft_consensus.cc:515] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.712069 6493 ts_tablet_manager.cc:1916] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.712494 6578 leader_election.cc:290] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:57.713486 5184 leader_election.cc:343] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 31ee75d0a39c42b09f2f46a1774f925c
I20260927 13:49:57.717327 5626 tablet_bootstrap.cc:492] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.719591 5626 tablet_bootstrap.cc:654] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.722165 5606 tablet_replica.cc:333] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:57.722334 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 98ffe83306e74749b5b3f68e6c2c708c (table default.Table_0956a69da22a495691888f08a70b62dc [id=126aea719ed34308a0742ed1fe5d6970]) successfully deleted
I20260927 13:49:57.722416 5606 raft_consensus.cc:2243] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:57.722802 5606 raft_consensus.cc:2272] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.723276 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb1d6091729498698924e6857ebfd6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:57.723832 5185 leader_election.cc:343] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 31ee75d0a39c42b09f2f46a1774f925c
I20260927 13:49:57.723939 5185 leader_election.cc:304] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:57.724264 6578 raft_consensus.cc:2749] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.726552 5606 ts_tablet_manager.cc:1916] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.728185 5623 tablet_replica.cc:333] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:57.728451 5623 raft_consensus.cc:2243] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:57.728686 5623 pending_rounds.cc:70] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:57.728729 5623 pending_rounds.cc:77] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957619603410944 op_type: NO_OP noop_request { }
I20260927 13:49:57.728832 5623 raft_consensus.cc:2889] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:57.728914 5623 raft_consensus.cc:2272] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.729668 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f70b70eb29cb4361a12ed393eabb82e1 (table default.Table_55aa0cde9170428d848330642e3b171e [id=18b81e3d511942b38a609e5f9552b4d8]) successfully deleted
I20260927 13:49:57.729727 5623 ts_tablet_manager.cc:1916] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:57.729980 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 64c7919f5076406186000cd4077aadaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64c7919f5076406186000cd4077aadaf already in progress: creating tablet
W20260927 13:49:57.730228 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 7a40f69bb7d842889be30c4629d6786f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a40f69bb7d842889be30c4629d6786f already in progress: creating tablet
W20260927 13:49:57.730425 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet bb980bca9f16480ba050971b58aa46f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb980bca9f16480ba050971b58aa46f3 already in progress: creating tablet
W20260927 13:49:57.730594 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 7e3b98290dc74d88856e13f003a1e4c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e3b98290dc74d88856e13f003a1e4c7 already in progress: creating tablet
I20260927 13:49:57.732743 5606 ts_tablet_manager.cc:1929] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:57.732872 5606 log.cc:1199] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/a443f65eba384b998fdc57ec57e37d87
I20260927 13:49:57.733207 5606 ts_tablet_manager.cc:1950] T a443f65eba384b998fdc57ec57e37d87 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:57.733677 6455 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" instance_seqno: 1790516980574773) as {username='slave'} at 127.4.163.66:54649; Asking this server to re-register.
I20260927 13:49:57.734513 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet a443f65eba384b998fdc57ec57e37d87 (table default.Table_43b89b55155b4b51ab4b271a93f30d59 [id=f7a31bf57f1245cab85dd2c38d85c79f]) successfully deleted
I20260927 13:49:57.736339 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 1a50f61eec39438f9d2b652f0346a0e5 (DEFAULT_TABLE table=default.Table_a226c3e5ff3042b98cc46517327d4610 [id=be2c884ad9fa4d94ab913821d5f20fbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.736764 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a50f61eec39438f9d2b652f0346a0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.737433 5623 ts_tablet_manager.cc:1929] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:57.737591 5623 log.cc:1199] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/059afd48ac4a41569ed1d3556b7974f0
I20260927 13:49:57.737977 5623 ts_tablet_manager.cc:1950] T 059afd48ac4a41569ed1d3556b7974f0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
W20260927 13:49:57.738505 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 03a1f13b31934baa8ce18fc499e94806 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03a1f13b31934baa8ce18fc499e94806 already in progress: creating tablet
I20260927 13:49:57.738909 5606 tablet_replica.cc:333] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:57.738962 5623 tablet_replica.cc:333] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:57.739120 5606 raft_consensus.cc:2243] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.739121 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 059afd48ac4a41569ed1d3556b7974f0 (table default.Table_020de70ec7bc4e119d5c6a3e22d8d32d [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
I20260927 13:49:57.739310 5606 raft_consensus.cc:2272] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.739355 5623 raft_consensus.cc:2243] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.739588 5623 raft_consensus.cc:2272] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.739835 5606 ts_tablet_manager.cc:1916] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.740113 5623 ts_tablet_manager.cc:1916] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.742941 5626 tablet_bootstrap.cc:492] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.743093 5626 ts_tablet_manager.cc:1403] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.000s
I20260927 13:49:57.743870 5626 raft_consensus.cc:359] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.744031 5626 raft_consensus.cc:385] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.744082 5626 raft_consensus.cc:740] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.744334 5626 consensus_queue.cc:260] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:57.744918 5626 ts_tablet_manager.cc:1434] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:57.746009 5626 tablet_bootstrap.cc:492] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.746685 6578 raft_consensus.cc:493] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.746794 6578 raft_consensus.cc:515] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.747326 6578 leader_election.cc:290] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:57.748641 5184 leader_election.cc:343] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 98ffe83306e74749b5b3f68e6c2c708c
W20260927 13:49:57.749238 5185 leader_election.cc:343] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 98ffe83306e74749b5b3f68e6c2c708c
I20260927 13:49:57.749342 5185 leader_election.cc:304] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:57.749675 6578 raft_consensus.cc:2749] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.751169 5626 tablet_bootstrap.cc:654] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.752749 6493 ts_tablet_manager.cc:1929] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.752483 6578 raft_consensus.cc:493] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.752931 6578 raft_consensus.cc:515] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.753453 6578 leader_election.cc:290] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:57.754756 5184 leader_election.cc:343] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 9f080b4ca9894eae8305d1548010a6cb
I20260927 13:49:57.755025 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f080b4ca9894eae8305d1548010a6cb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:57.755234 5382 raft_consensus.cc:2468] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:57.755666 6493 log.cc:1199] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/0361e3b244a1437b8e402dd8602528fe
I20260927 13:49:57.755635 5185 leader_election.cc:304] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:57.756107 6578 raft_consensus.cc:2804] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:57.756176 6578 raft_consensus.cc:493] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:57.756233 6578 raft_consensus.cc:3060] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.756618 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 1a50f61eec39438f9d2b652f0346a0e5 (DEFAULT_TABLE table=default.Table_a226c3e5ff3042b98cc46517327d4610 [id=be2c884ad9fa4d94ab913821d5f20fbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.756989 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a50f61eec39438f9d2b652f0346a0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.755997 6493 ts_tablet_manager.cc:1950] T 0361e3b244a1437b8e402dd8602528fe P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:57.758464 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 597) took 1247 ms. Trace:
I20260927 13:49:57.758535 6493 rpcz_store.cc:276] 0927 13:49:56.511444 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.513605 (+ 2161us) service_pool.cc:224] Handling call
0927 13:49:57.711180 (+1197575us) ts_tablet_manager.cc:1151] Deleting tablet 0361e3b244a1437b8e402dd8602528fe
0927 13:49:57.711192 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:57.728890 (+ 17698us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:57.752692 (+ 23802us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:57.758447 (+ 5755us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1197396}
I20260927 13:49:57.759063 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 0361e3b244a1437b8e402dd8602528fe (table default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82]) successfully deleted
I20260927 13:49:57.759094 6578 raft_consensus.cc:515] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.759927 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f080b4ca9894eae8305d1548010a6cb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:57.760078 5384 raft_consensus.cc:3060] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.761984 6493 tablet_replica.cc:333] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:57.762185 6493 raft_consensus.cc:2243] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.762759 5623 ts_tablet_manager.cc:1929] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.762849 5623 log.cc:1199] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/63a1fca938c34718ae541f0038b56025
I20260927 13:49:57.762867 5384 raft_consensus.cc:2468] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:57.762760 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d97c60c7dbc6419b8009c1559ca7a49a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:57.763443 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d97c60c7dbc6419b8009c1559ca7a49a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:57.763474 5185 leader_election.cc:304] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:57.763717 6524 raft_consensus.cc:2804] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:57.763880 5606 ts_tablet_manager.cc:1929] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:57.763993 5606 log.cc:1199] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/4d35148d80b44fca9b39a4625d3e61c1
I20260927 13:49:57.764382 5606 ts_tablet_manager.cc:1950] T 4d35148d80b44fca9b39a4625d3e61c1 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:57.765580 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 4d35148d80b44fca9b39a4625d3e61c1 (table default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]) successfully deleted
W20260927 13:49:57.766024 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2e768c83fae54619ac849dfedd5ec654 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e768c83fae54619ac849dfedd5ec654 already in progress: creating tablet
W20260927 13:49:57.766146 5184 leader_election.cc:343] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 9f080b4ca9894eae8305d1548010a6cb
W20260927 13:49:57.766278 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2d64750141d74d988612304ce050688d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d64750141d74d988612304ce050688d already in progress: creating tablet
I20260927 13:49:57.766316 6524 raft_consensus.cc:697] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:57.766639 6524 consensus_queue.cc:237] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.767874 6578 leader_election.cc:290] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.769697 5623 ts_tablet_manager.cc:1950] T 63a1fca938c34718ae541f0038b56025 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:57.771035 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 63a1fca938c34718ae541f0038b56025 (table default.Table_69a87aa5933f49eaaa3085e0b505f5ca [id=97c4d9da0cc54c3d842a2001313e9a8a]) successfully deleted
I20260927 13:49:57.772154 5623 tablet_replica.cc:333] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:57.772554 5623 raft_consensus.cc:2243] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:57.773018 5623 pending_rounds.cc:70] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:57.773324 5623 pending_rounds.cc:77] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957622201843712 op_type: NO_OP noop_request { }
I20260927 13:49:57.773573 5623 raft_consensus.cc:2889] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:57.773773 5623 raft_consensus.cc:2272] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.774842 5623 ts_tablet_manager.cc:1916] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.782013 5623 ts_tablet_manager.cc:1929] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:57.787708 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 1a50f61eec39438f9d2b652f0346a0e5 (DEFAULT_TABLE table=default.Table_a226c3e5ff3042b98cc46517327d4610 [id=be2c884ad9fa4d94ab913821d5f20fbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.788133 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a50f61eec39438f9d2b652f0346a0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.788306 5347 tablet_service.cc:1511] Processing CreateTablet for tablet ab12ebc5fdcb44948ec5f53f26c18f20 (DEFAULT_TABLE table=default.Table_42796c54044b413f89d5ebc6ec7a1c42 [id=ff3a9590f545444884afaa56b305080d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.788673 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab12ebc5fdcb44948ec5f53f26c18f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.791798 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 6c82fd138de14f218b4ec2c7d44723bf (DEFAULT_TABLE table=default.Table_60e4fad358b94bf5a7dcf5632fabd19d [id=64bcf428240942d59593eb02e4843760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.792138 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c82fd138de14f218b4ec2c7d44723bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.794389 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 8c14a6b95c1e460a8e7a299340f09498 (DEFAULT_TABLE table=default.Table_65ed372bfab14cbd8ea34e25afdf59d7 [id=064c3328625f4e1faed6cd36616c9af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.794445 5358 tablet_service.cc:1511] Processing CreateTablet for tablet d51c3fa3624340059f6508ced1a2220e (DEFAULT_TABLE table=default.Table_2c133084fc48484bbe4dd43a4ee2eb1d [id=1bb04c0987eb40f88077bb2a6192f443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.794781 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c14a6b95c1e460a8e7a299340f09498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.795006 6546 raft_consensus.cc:493] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.795120 6546 raft_consensus.cc:515] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.795740 6546 leader_election.cc:290] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:57.796240 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7919f5076406186000cd4077aadaf" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:57.798695 5045 leader_election.cc:343] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.799535 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6dcaf176a0984afab14290b72962bdf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:57.799677 5076 tablet_service.cc:1511] Processing CreateTablet for tablet ab12ebc5fdcb44948ec5f53f26c18f20 (DEFAULT_TABLE table=default.Table_42796c54044b413f89d5ebc6ec7a1c42 [id=ff3a9590f545444884afaa56b305080d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.800011 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab12ebc5fdcb44948ec5f53f26c18f20. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:57.800146 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6dcaf176a0984afab14290b72962bdf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:57.802376 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 8c14a6b95c1e460a8e7a299340f09498 (DEFAULT_TABLE table=default.Table_65ed372bfab14cbd8ea34e25afdf59d7 [id=064c3328625f4e1faed6cd36616c9af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.802712 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c14a6b95c1e460a8e7a299340f09498. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:57.806476 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c332b6ec9ca94ce398a71e82e20897d4 consensus state has no leader
I20260927 13:49:57.806423 5079 tablet_service.cc:1511] Processing CreateTablet for tablet d51c3fa3624340059f6508ced1a2220e (DEFAULT_TABLE table=default.Table_2c133084fc48484bbe4dd43a4ee2eb1d [id=1bb04c0987eb40f88077bb2a6192f443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.806763 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51c3fa3624340059f6508ced1a2220e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.810714 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51c3fa3624340059f6508ced1a2220e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.830269 6546 consensus_queue.cc:1048] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:57.834833 6493 raft_consensus.cc:2272] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:57.835444 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a09e5155fa1148ef88003c6c1afedce5" } new_table_name: "default.Table_f9afa72c04394383a22302115766399d" modify_external_catalogs: true
I20260927 13:49:57.835526 6493 ts_tablet_manager.cc:1916] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.841539 6493 ts_tablet_manager.cc:1929] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:57.841661 6493 log.cc:1199] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b57886cc11a2423983c2b7bac79150a0
I20260927 13:49:57.841962 6493 ts_tablet_manager.cc:1950] T b57886cc11a2423983c2b7bac79150a0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:57.843888 4925 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:49:57.844195 4925 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]). Expected version 1 got 0
I20260927 13:49:57.849296 4922 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:49:57.851166 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 599) took 1319 ms. Trace:
I20260927 13:49:57.851274 6493 rpcz_store.cc:276] 0927 13:49:56.531823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.531878 (+ 55us) service_pool.cc:224] Handling call
0927 13:49:57.761935 (+1230057us) ts_tablet_manager.cc:1151] Deleting tablet b57886cc11a2423983c2b7bac79150a0
0927 13:49:57.761945 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:57.838611 (+ 76666us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:57.841476 (+ 2865us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:57.851144 (+ 9668us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72456,"tablet-delete.queue_time_us":1229870}
I20260927 13:49:57.851742 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b57886cc11a2423983c2b7bac79150a0 (table default.Table_020de70ec7bc4e119d5c6a3e22d8d32d [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
I20260927 13:49:57.853081 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 601) took 1287 ms. Trace:
I20260927 13:49:57.853482 6493 rpcz_store.cc:276] 0927 13:49:56.565765 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.566864 (+ 1099us) service_pool.cc:224] Handling call
0927 13:49:57.852954 (+1286090us) ts_tablet_manager.cc:1151] Deleting tablet c57b60cbc1ca462789fd8e7a235f7119
0927 13:49:57.852964 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:57.853064 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1285908}
W20260927 13:49:57.854149 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet c57b60cbc1ca462789fd8e7a235f7119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c57b60cbc1ca462789fd8e7a235f7119 already in progress: creating tablet
I20260927 13:49:57.854576 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 603) took 1233 ms. Trace:
I20260927 13:49:57.854918 6493 rpcz_store.cc:276] 0927 13:49:56.620703 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.620764 (+ 61us) service_pool.cc:224] Handling call
0927 13:49:57.854474 (+1233710us) ts_tablet_manager.cc:1151] Deleting tablet 7a40f69bb7d842889be30c4629d6786f
0927 13:49:57.854483 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:57.854561 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1233504}
W20260927 13:49:57.855489 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7a40f69bb7d842889be30c4629d6786f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a40f69bb7d842889be30c4629d6786f already in progress: creating tablet
I20260927 13:49:57.855808 6493 tablet_replica.cc:333] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:57.856154 6493 raft_consensus.cc:2243] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:57.796515 5296 heartbeater.cc:461] Registering TS with master...
I20260927 13:49:57.797804 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 8c14a6b95c1e460a8e7a299340f09498 (DEFAULT_TABLE table=default.Table_65ed372bfab14cbd8ea34e25afdf59d7 [id=064c3328625f4e1faed6cd36616c9af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.858500 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c14a6b95c1e460a8e7a299340f09498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.798170 5221 tablet_service.cc:1511] Processing CreateTablet for tablet d51c3fa3624340059f6508ced1a2220e (DEFAULT_TABLE table=default.Table_2c133084fc48484bbe4dd43a4ee2eb1d [id=1bb04c0987eb40f88077bb2a6192f443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.861765 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51c3fa3624340059f6508ced1a2220e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.865456 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ed086ec90f0241b2b7b8aa29b27693c4" } modify_external_catalogs: true
I20260927 13:49:57.865559 5626 tablet_bootstrap.cc:492] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:57.865617 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ed086ec90f0241b2b7b8aa29b27693c4" } modify_external_catalogs: true
I20260927 13:49:57.865677 5626 ts_tablet_manager.cc:1403] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.120s user 0.007s sys 0.007s
I20260927 13:49:57.798484 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 6c82fd138de14f218b4ec2c7d44723bf (DEFAULT_TABLE table=default.Table_60e4fad358b94bf5a7dcf5632fabd19d [id=64bcf428240942d59593eb02e4843760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.866369 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c82fd138de14f218b4ec2c7d44723bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.866437 5626 raft_consensus.cc:359] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.866590 5626 raft_consensus.cc:385] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.866641 5626 raft_consensus.cc:740] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.866843 5626 consensus_queue.cc:260] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.814590 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7919f5076406186000cd4077aadaf" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:57.871783 6578 raft_consensus.cc:493] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.871907 6578 raft_consensus.cc:515] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.872511 6578 leader_election.cc:290] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.873366 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec40378eb80c412198d5b66c02e975ef" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:57.873556 5382 raft_consensus.cc:2468] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
W20260927 13:49:57.874291 5184 leader_election.cc:343] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: ec40378eb80c412198d5b66c02e975ef
I20260927 13:49:57.874739 5185 leader_election.cc:304] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:57.875279 6667 raft_consensus.cc:2804] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:57.875356 6667 raft_consensus.cc:493] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:57.875422 6667 raft_consensus.cc:3060] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.878149 6667 raft_consensus.cc:515] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.878338 5227 tablet_service.cc:1511] Processing CreateTablet for tablet a003afa0fbb74d548cfaba51ea6cef58 (DEFAULT_TABLE table=default.Table_440adeb28a1147c9ae74c2fb6a476219 [id=7afcf03e74464b20928909363e8640e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.878669 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a003afa0fbb74d548cfaba51ea6cef58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.878710 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 2753a2efb2094219bcb02825e9568d7e (DEFAULT_TABLE table=default.Table_e512f6e2722c488da1df36462f461d3d [id=334c5498104b4128918d0830e469dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.879037 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2753a2efb2094219bcb02825e9568d7e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:57.880052 5184 leader_election.cc:343] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: ec40378eb80c412198d5b66c02e975ef
I20260927 13:49:57.880448 6667 leader_election.cc:290] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.880710 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec40378eb80c412198d5b66c02e975ef" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:57.880884 5382 raft_consensus.cc:3060] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.882241 6609 raft_consensus.cc:493] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.882365 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 0021dbaf7e8440479bcf24cce693b158 (DEFAULT_TABLE table=default.Table_1b68a2cb5f1745e3833886667aa5314a [id=72fccb6fab244902b82b30724a723d45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.882675 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0021dbaf7e8440479bcf24cce693b158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.883757 5382 raft_consensus.cc:2468] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:57.884140 5185 leader_election.cc:304] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:57.884670 6667 raft_consensus.cc:2804] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:57.884780 6667 raft_consensus.cc:697] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:57.885003 6667 consensus_queue.cc:237] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.882354 6609 raft_consensus.cc:515] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.886627 6609 leader_election.cc:290] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.887499 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb505472de024c2e9b3861f3225b7e40" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:57.887885 5319 leader_election.cc:343] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bb505472de024c2e9b3861f3225b7e40
W20260927 13:49:57.888150 5319 leader_election.cc:343] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.888222 5319 leader_election.cc:304] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:57.888440 6609 raft_consensus.cc:2749] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.844909 5229 tablet_service.cc:1511] Processing CreateTablet for tablet ab12ebc5fdcb44948ec5f53f26c18f20 (DEFAULT_TABLE table=default.Table_42796c54044b413f89d5ebc6ec7a1c42 [id=ff3a9590f545444884afaa56b305080d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.890923 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab12ebc5fdcb44948ec5f53f26c18f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.894697 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5f7db155b7014eeb9796b1896fa0319b" } new_table_name: "default.Table_204222be214241ed9c6f216ad0d30cc9" modify_external_catalogs: true
I20260927 13:49:57.895190 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 0021dbaf7e8440479bcf24cce693b158 (DEFAULT_TABLE table=default.Table_1b68a2cb5f1745e3833886667aa5314a [id=72fccb6fab244902b82b30724a723d45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.895640 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0021dbaf7e8440479bcf24cce693b158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.897548 5619 tablet_bootstrap.cc:492] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.897682 5619 ts_tablet_manager.cc:1403] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.251s user 0.019s sys 0.042s
I20260927 13:49:57.898352 5619 raft_consensus.cc:359] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.898527 5619 raft_consensus.cc:385] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.898577 5619 raft_consensus.cc:740] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.900588 5626 ts_tablet_manager.cc:1434] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20260927 13:49:57.900873 5626 tablet_bootstrap.cc:492] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:57.901026 4921 master_service.cc:960] ReplaceTablet: received request to replace tablet 5a3f40a2da8649e0898c0e09b6e14a61 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:57.902454 5626 tablet_bootstrap.cc:654] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.906476 5619 consensus_queue.cc:260] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.907109 5619 ts_tablet_manager.cc:1434] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260927 13:49:57.909575 5619 tablet_bootstrap.cc:492] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.922185 6609 raft_consensus.cc:493] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.922341 6609 raft_consensus.cc:515] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.922955 6609 leader_election.cc:290] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.924356 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564f5c92bf144fa1bfc2e1e07132dd69" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:57.924476 5619 tablet_bootstrap.cc:654] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.924527 5249 raft_consensus.cc:2468] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:57.924979 5319 leader_election.cc:304] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:57.925534 6609 raft_consensus.cc:2804] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:57.925603 6609 raft_consensus.cc:493] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:57.925657 6609 raft_consensus.cc:3060] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.928385 6609 raft_consensus.cc:515] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.929909 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564f5c92bf144fa1bfc2e1e07132dd69" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:57.932034 5249 raft_consensus.cc:3060] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:57.933271 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 8437f48a0c4645fbbc205aca8def77b5 (DEFAULT_TABLE table=default.Table_75865dd4349e418896b4469e10a62252 [id=eaf034197b00472287e8218a4ecd41bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.933609 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8437f48a0c4645fbbc205aca8def77b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.936015 6455 ts_manager.cc:194] Registered new tserver with Master: 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:57.938102 5249 raft_consensus.cc:2468] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:57.938676 5319 leader_election.cc:304] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:57.938951 6608 raft_consensus.cc:2804] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:57.939070 6608 raft_consensus.cc:697] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:57.939415 6608 consensus_queue.cc:237] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.939976 5358 tablet_service.cc:1511] Processing CreateTablet for tablet a003afa0fbb74d548cfaba51ea6cef58 (DEFAULT_TABLE table=default.Table_440adeb28a1147c9ae74c2fb6a476219 [id=7afcf03e74464b20928909363e8640e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.940340 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a003afa0fbb74d548cfaba51ea6cef58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.460177 6467 rpcz_store.cc:276] 0927 13:49:55.895739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:55.895806 (+ 67us) service_pool.cc:224] Handling call
0927 13:49:56.728002 (+832196us) raft_consensus.cc:1471] Updating replica for 393 ops
0927 13:49:56.758038 (+ 30036us) raft_consensus.cc:1534] Early marking committed up to index 0
0927 13:49:56.758048 (+ 10us) raft_consensus.cc:1539] Triggering prepare for 393 ops
0927 13:49:56.759031 (+ 983us) write_op.cc:270] Start()
0927 13:49:56.759113 (+ 82us) write_op.cc:276] Timestamp: P: 1790516989106264 usec, L: 0
0927 13:49:56.772772 (+ 13659us) write_op.cc:270] Start()
0927 13:49:56.772806 (+ 34us) write_op.cc:276] Timestamp: P: 1790516989143400 usec, L: 0
0927 13:49:56.773048 (+ 242us) write_op.cc:270] Start()
0927 13:49:56.773082 (+ 34us) write_op.cc:276] Timestamp: P: 1790516989143945 usec, L: 0
0927 13:49:56.773293 (+ 211us) write_op.cc:270] Start()
0927 13:49:56.773321 (+ 28us) write_op.cc:276] Timestamp: P: 1790516989144454 usec, L: 0
0927 13:49:56.773533 (+ 212us) write_op.cc:270] Start()
0927 13:49:56.773555 (+ 22us) write_op.cc:276] Timestamp: P: 1790516989290569 usec, L: 0
0927 13:49:56.773695 (+ 140us) write_op.cc:270] Start()
0927 13:49:56.773715 (+ 20us) write_op.cc:276] Timestamp: P: 1790516989305254 usec, L: 0
0927 13:49:56.773848 (+ 133us) write_op.cc:270] Start()
0927 13:49:56.773892 (+ 44us) write_op.cc:276] Timestamp: P: 1790516989320531 usec, L: 0
0927 13:49:56.774031 (+ 139us) write_op.cc:270] Start()
0927 13:49:56.774051 (+ 20us) write_op.cc:276] Timestamp: P: 1790516989321537 usec, L: 0
0927 13:49:56.774231 (+ 180us) write_op.cc:270] Start()
0927 13:49:56.774251 (+ 20us) write_op.cc:276] Timestamp: P: 1790516989322981 usec, L: 0
0927 13:49:56.778227 (+ 3976us) write_op.cc:270] Start()
0927 13:49:56.778363 (+ 136us) write_op.cc:276] Timestamp: P: 1790516989323487 usec, L: 0
0927 13:49:56.778593 (+ 230us) write_op.cc:270] Start()
0927 13:49:56.778618 (+ 25us) write_op.cc:276] Timestamp: P: 1790516989344467 usec, L: 0
0927 13:49:56.778776 (+ 158us) write_op.cc:270] Start()
0927 13:49:56.778799 (+ 23us) write_op.cc:276] Timestamp: P: 1790516989350916 usec, L: 0
0927 13:49:56.778937 (+ 138us) write_op.cc:270] Start()
0927 13:49:56.778957 (+ 20us) write_op.cc:276] Timestamp: P: 1790516989373519 usec, L: 0
0927 13:49:56.779098 (+ 141us) write_op.cc:270] Start()
0927 13:49:56.779119 (+ 21us) write_op.cc:276] Timestamp: P: 1790516989417158 usec, L: 0
0927 13:49:56.779293 (+ 174us) write_op.cc:270] Start()
0927 13:49:56.779312 (+ 19us) write_op.cc:276] Timestamp: P: 1790516989443859 usec, L: 0
0927 13:49:56.779458 (+ 146us) write_op.cc:270] Start()
0927 13:49:56.779479 (+ 21us) write_op.cc:276] Timestamp: P: 1790516989455425 usec, L: 0
0927 13:49:56.779612 (+ 133us) write_op.cc:270] Start()
0927 13:49:56.779640 (+ 28us) write_op.cc:276] Timestamp: P: 1790516989472598 usec, L: 0
0927 13:49:56.779765 (+ 125us) write_op.cc:270] Start()
0927 13:49:56.779792 (+ 27us) write_op.cc:276] Timestamp: P: 1790516989490353 usec, L: 0
0927 13:49:56.779934 (+ 142us) write_op.cc:270] Start()
0927 13:49:56.779958 (+ 24us) write_op.cc:276] Timestamp: P: 1790516989534976 usec, L: 0
0927 13:49:56.780103 (+ 145us) write_op.cc:270] Start()
0927 13:49:56.780123 (+ 20us) write_op.cc:276] Timestamp: P: 1790516989546086 usec, L: 0
0927 13:49:56.780244 (+ 121us) write_op.cc:270] Start()
0927 13:49:56.780260 (+ 16us) write_op.cc:276] Timestamp: P: 1790516989560229 usec, L: 0
0927 13:49:56.780417 (+ 157us) write_op.cc:270] Start()
0927 13:49:56.780456 (+ 39us) write_op.cc:276] Timestamp: P: 1790516989576864 usec, L: 0
0927 13:49:56.780603 (+ 147us) write_op.cc:270] Start()
0927 13:49:56.780624 (+ 21us) write_op.cc:276] Timestamp: P: 1790516989588909 usec, L: 0
0927 13:49:56.780735 (+ 111us) write_op.cc:270] Start()
0927 13:49:56.780765 (+ 30us) write_op.cc:276] Timestamp: P: 1790516989600795 usec, L: 0
0927 13:49:56.780947 (+ 182us) write_op.cc:270] Start()
0927 13:49:56.780971 (+ 24us) write_op.cc:276] Timestamp: P: 1790516989615205 usec, L: 0
0927 13:49:56.781121 (+ 150us) write_op.cc:270] Start()
0927 13:49:56.781142 (+ 21us) write_op.cc:276] Timestamp: P: 1790516989677254 usec, L: 0
0927 13:49:56.781302 (+ 160us) write_op.cc:270] Start()
0927 13:49:56.781322 (+ 20us) write_op.cc:276] Timestamp: P: 1790516989686293 usec, L: 0
0927 13:49:56.781473 (+ 151us) write_op.cc:270] Start()
0927 13:49:56.781495 (+ 22us) write_op.cc:276] Timestamp: P: 1790516989704878 usec, L: 0
0927 13:49:56.781658 (+ 163us) write_op.cc:270] Start()
0927 13:49:56.781680 (+ 22us) write_op.cc:276] Timestamp: P: 1790516989723357 usec, L: 0
0927 13:49:56.781822 (+ 142us) write_op.cc:270] Start()
0927 13:49:56.781851 (+ 29us) write_op.cc:276] Timestamp: P: 1790516989736989 usec, L: 0
0927 13:49:56.782038 (+ 187us) write_op.cc:270] Start()
0927 13:49:56.782068 (+ 30us) write_op.cc:276] Timestamp: P: 1790516989751852 usec, L: 0
0927 13:49:56.782246 (+ 178us) write_op.cc:270] Start()
0927 13:49:56.782271 (+ 25us) write_op.cc:276] Timestamp: P: 1790516989764986 usec, L: 0
0927 13:49:56.782494 (+ 223us) write_op.cc:270] Start()
0927 13:49:56.782519 (+ 25us) write_op.cc:276] Timestamp: P: 1790516989784520 usec, L: 0
0927 13:49:56.782680 (+ 161us) write_op.cc:270] Start()
0927 13:49:56.782705 (+ 25us) write_op.cc:276] Timestamp: P: 1790516989807320 usec, L: 0
0927 13:49:56.782867 (+ 162us) write_op.cc:270] Start()
0927 13:49:56.782891 (+ 24us) write_op.cc:276] Timestamp: P: 1790516989829930 usec, L: 0
0927 13:49:56.783049 (+ 158us) write_op.cc:270] Start()
0927 13:49:56.783090 (+ 41us) write_op.cc:276] Timestamp: P: 1790516989839381 usec, L: 0
0927 13:49:56.783243 (+ 153us) write_op.cc:270] Start()
0927 13:49:56.783288 (+ 45us) write_op.cc:276] Timestamp: P: 1790516989848532 usec, L: 0
0927 13:49:56.783457 (+ 169us) write_op.cc:270] Start()
0927 13:49:56.783481 (+ 24us) write_op.cc:276] Timestamp: P: 1790516989858878 usec, L: 0
0927 13:49:56.783634 (+ 153us) write_op.cc:270] Start()
0927 13:49:56.783657 (+ 23us) write_op.cc:276] Timestamp: P: 1790516989868638 usec, L: 0
0927 13:49:56.783810 (+ 153us) write_op.cc:270] Start()
0927 13:49:56.783833 (+ 23us) write_op.cc:276] Timestamp: P: 1790516989893072 usec, L: 0
0927 13:49:56.784029 (+ 196us) write_op.cc:270] Start()
0927 13:49:56.784051 (+ 22us) write_op.cc:276] Timestamp: P: 1790516989920804 usec, L: 0
0927 13:49:56.784202 (+ 151us) write_op.cc:270] Start()
0927 13:49:56.784230 (+ 28us) write_op.cc:276] Timestamp: P: 1790516989951884 usec, L: 0
0927 13:49:56.784412 (+ 182us) write_op.cc:270] Start()
0927 13:49:56.784453 (+ 41us) write_op.cc:276] Timestamp: P: 1790516989966921 usec, L: 0
0927 13:49:56.784616 (+ 163us) write_op.cc:270] Start()
0927 13:49:56.784639 (+ 23us) write_op.cc:276] Timestamp: P: 1790516989980661 usec, L: 0
0927 13:49:56.784799 (+ 160us) write_op.cc:270] Start()
0927 13:49:56.784821 (+ 22us) write_op.cc:276] Timestamp: P: 1790516990001886 usec, L: 0
0927 13:49:56.784961 (+ 140us) write_op.cc:270] Start()
0927 13:49:56.784985 (+ 24us) write_op.cc:276] Timestamp: P: 1790516990019237 usec, L: 0
0927 13:49:56.785175 (+ 190us) write_op.cc:270] Start()
0927 13:49:56.785199 (+ 24us) write_op.cc:276] Timestamp: P: 1790516990048093 usec, L: 0
0927 13:49:56.801225 (+ 16026us) write_op.cc:270] Start()
0927 13:49:56.801267 (+ 42us) write_op.cc:276] Timestamp: P: 1790516990066457 usec, L: 0
0927 13:49:56.801481 (+ 214us) write_op.cc:270] Start()
0927 13:49:56.801502 (+ 21us) write_op.cc:276] Timestamp: P: 1790516990074008 usec, L: 0
0927 13:49:56.801698 (+ 196us) write_op.cc:270] Start()
0927 13:49:56.801720 (+ 22us) write_op.cc:276] Timestamp: P: 1790516990115710 usec, L: 0
0927 13:49:56.801976 (+ 256us) write_op.cc:270] Start()
0927 13:49:56.801998 (+ 22us) write_op.cc:276] Timestamp: P: 1790516990158241 usec, L: 0
0927 13:49:56.802173 (+ 175us) write_op.cc:270] Start()
0927 13:49:56.802195 (+ 22us) write_op.cc:276] Timestamp: P: 1790516990160838 usec, L: 0
0927 13:49:56.802332 (+ 137us) write_op.cc:270] Start()
0927 13:49:56.802354 (+ 22us) write_op.cc:276] Timestamp: P: 1790516990162709 usec, L: 0
0927 13:49:56.802504 (+ 150us) write_op.cc:270] Start()
0927 13:49:56.802549 (+ 45us) write_op.cc:276] Timestamp: P: 1790516990164182 usec, L: 0
0927 13:49:56.802682 (+ 133us) write_op.cc:270] Start()
0927 13:49:56.802702 (+ 20us) write_op.cc:276] Timestamp: P: 1790516990165395 usec, L: 0
0927 13:49:56.802827 (+ 125us) write_op.cc:270] Start()
0927 13:49:56.802846 (+ 19us) write_op.cc:276] Timestamp: P: 1790516990187800 usec, L: 0
0927 13:49:56.803008 (+ 162us) write_op.cc:270] Start()
0927 13:49:56.803028 (+ 20us) write_op.cc:276] Timestamp: P: 1790516990192494 usec, L: 0
0927 13:49:56.803167 (+ 139us) write_op.cc:270] Start()
0927 13:49:56.803186 (+ 19us) write_op.cc:276] Timestamp: P: 1790516990193475 usec, L: 0
0927 13:49:56.803322 (+ 136us) write_op.cc:270] Start()
0927 13:49:56.803344 (+ 22us) write_op.cc:276] Timestamp: P: 1790516990195298 usec, L: 0
0927 13:49:56.803503 (+ 159us) write_op.cc:270] Start()
0927 13:49:56.803542 (+ 39us) write_op.cc:276] Timestamp: P: 1790516990196197 usec, L: 0
0927 13:49:56.803679 (+ 137us) write_op.cc:270] Start()
0927 13:49:56.803701 (+ 22us) write_op.cc:276] Timestamp: P: 1790516990197125 usec, L: 0
0927 13:49:56.803862 (+ 161us) write_op.cc:270] Start()
0927 13:49:56.803883 (+ 21us) write_op.cc:276] Timestamp: P: 1790516990198231 usec, L: 0
0927 13:49:56.804130 (+ 247us) write_op.cc:270] Start()
0927 13:49:56.804153 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990278252 usec, L: 0
0927 13:49:56.804291 (+ 138us) write_op.cc:270] Start()
0927 13:49:56.804310 (+ 19us) write_op.cc:276] Timestamp: P: 1790516990304939 usec, L: 0
0927 13:49:56.804487 (+ 177us) write_op.cc:270] Start()
0927 13:49:56.804508 (+ 21us) write_op.cc:276] Timestamp: P: 1790516990313479 usec, L: 0
0927 13:49:56.804704 (+ 196us) write_op.cc:270] Start()
0927 13:49:56.804726 (+ 22us) write_op.cc:276] Timestamp: P: 1790516990314735 usec, L: 0
0927 13:49:56.804870 (+ 144us) write_op.cc:270] Start()
0927 13:49:56.804890 (+ 20us) write_op.cc:276] Timestamp: P: 1790516990338558 usec, L: 0
0927 13:49:56.805220 (+ 330us) write_op.cc:270] Start()
0927 13:49:56.805243 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990351400 usec, L: 0
0927 13:49:56.805390 (+ 147us) write_op.cc:270] Start()
0927 13:49:56.805415 (+ 25us) write_op.cc:276] Timestamp: P: 1790516990356894 usec, L: 0
0927 13:49:56.805569 (+ 154us) write_op.cc:270] Start()
0927 13:49:56.805591 (+ 22us) write_op.cc:276] Timestamp: P: 1790516990365877 usec, L: 0
0927 13:49:56.806167 (+ 576us) write_op.cc:270] Start()
0927 13:49:56.806191 (+ 24us) write_op.cc:276] Timestamp: P: 1790516990366911 usec, L: 0
0927 13:49:56.806348 (+ 157us) write_op.cc:270] Start()
0927 13:49:56.806371 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990367514 usec, L: 0
0927 13:49:56.806549 (+ 178us) write_op.cc:270] Start()
0927 13:49:56.806572 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990387306 usec, L: 0
0927 13:49:56.806738 (+ 166us) write_op.cc:270] Start()
0927 13:49:56.806763 (+ 25us) write_op.cc:276] Timestamp: P: 1790516990393954 usec, L: 0
0927 13:49:56.806906 (+ 143us) write_op.cc:270] Start()
0927 13:49:56.806925 (+ 19us) write_op.cc:276] Timestamp: P: 1790516990435840 usec, L: 0
0927 13:49:56.807105 (+ 180us) write_op.cc:270] Start()
0927 13:49:56.807129 (+ 24us) write_op.cc:276] Timestamp: P: 1790516990456055 usec, L: 0
0927 13:49:56.807846 (+ 717us) write_op.cc:270] Start()
0927 13:49:56.807876 (+ 30us) write_op.cc:276] Timestamp: P: 1790516990456937 usec, L: 0
0927 13:49:56.808068 (+ 192us) write_op.cc:270] Start()
0927 13:49:56.808095 (+ 27us) write_op.cc:276] Timestamp: P: 1790516990457488 usec, L: 0
0927 13:49:56.808250 (+ 155us) write_op.cc:270] Start()
0927 13:49:56.808297 (+ 47us) write_op.cc:276] Timestamp: P: 1790516990487531 usec, L: 0
0927 13:49:56.808484 (+ 187us) write_op.cc:270] Start()
0927 13:49:56.808507 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990498570 usec, L: 0
0927 13:49:56.808670 (+ 163us) write_op.cc:270] Start()
0927 13:49:56.808693 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990499544 usec, L: 0
0927 13:49:56.808837 (+ 144us) write_op.cc:270] Start()
0927 13:49:56.808858 (+ 21us) write_op.cc:276] Timestamp: P: 1790516990502367 usec, L: 0
0927 13:49:56.808999 (+ 141us) write_op.cc:270] Start()
0927 13:49:56.809022 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990511895 usec, L: 0
0927 13:49:56.809163 (+ 141us) write_op.cc:270] Start()
0927 13:49:56.809186 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990512867 usec, L: 0
0927 13:49:56.809330 (+ 144us) write_op.cc:270] Start()
0927 13:49:56.809534 (+ 204us) write_op.cc:276] Timestamp: P: 1790516990514108 usec, L: 0
0927 13:49:56.809742 (+ 208us) write_op.cc:270] Start()
0927 13:49:56.809839 (+ 97us) write_op.cc:276] Timestamp: P: 1790516990514989 usec, L: 0
0927 13:49:56.810032 (+ 193us) write_op.cc:270] Start()
0927 13:49:56.810058 (+ 26us) write_op.cc:276] Timestamp: P: 1790516990528120 usec, L: 0
0927 13:49:56.810239 (+ 181us) write_op.cc:270] Start()
0927 13:49:56.810262 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990566595 usec, L: 0
0927 13:49:56.810508 (+ 246us) write_op.cc:270] Start()
0927 13:49:56.810534 (+ 26us) write_op.cc:276] Timestamp: P: 1790516990592478 usec, L: 0
0927 13:49:56.810692 (+ 158us) write_op.cc:270] Start()
0927 13:49:56.810716 (+ 24us) write_op.cc:276] Timestamp: P: 1790516990594903 usec, L: 0
0927 13:49:56.810869 (+ 153us) write_op.cc:270] Start()
0927 13:49:56.810891 (+ 22us) write_op.cc:276] Timestamp: P: 1790516990596478 usec, L: 0
0927 13:49:56.811050 (+ 159us) write_op.cc:270] Start()
0927 13:49:56.811073 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990597782 usec, L: 0
0927 13:49:56.811216 (+ 143us) write_op.cc:270] Start()
0927 13:49:56.811239 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990603197 usec, L: 0
0927 13:49:56.811789 (+ 550us) write_op.cc:270] Start()
0927 13:49:56.811818 (+ 29us) write_op.cc:276] Timestamp: P: 1790516990606151 usec, L: 0
0927 13:49:56.811974 (+ 156us) write_op.cc:270] Start()
0927 13:49:56.811997 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990683590 usec, L: 0
0927 13:49:56.812175 (+ 178us) write_op.cc:270] Start()
0927 13:49:56.812197 (+ 22us) write_op.cc:276] Timestamp: P: 1790516990687505 usec, L: 0
0927 13:49:56.812385 (+ 188us) write_op.cc:270] Start()
0927 13:49:56.812408 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990735462 usec, L: 0
0927 13:49:56.812568 (+ 160us) write_op.cc:270] Start()
0927 13:49:56.812592 (+ 24us) write_op.cc:276] Timestamp: P: 1790516990765876 usec, L: 0
0927 13:49:56.812731 (+ 139us) write_op.cc:270] Start()
0927 13:49:56.812746 (+ 15us) write_op.cc:276] Timestamp: P: 1790516990781535 usec, L: 0
0927 13:49:56.812873 (+ 127us) write_op.cc:270] Start()
0927 13:49:56.812896 (+ 23us) write_op.cc:276] Timestamp: P: 1790516990782206 usec, L: 0
0927 13:49:56.814042 (+ 1146us) write_op.cc:270] Start()
0927 13:49:56.814066 (+ 24us) write_op.cc:276] Timestamp: P: 1790516990782792 usec, L: 0
0927 13:49:56.814207 (+ 141us) write_op.cc:270] Start()
0927 13:49:56.814225 (+ 18us) write_op.cc:276] Timestamp: P: 1790516990783329 usec, L: 0
0927 13:49:56.814342 (+ 117us) write_op.cc:270] Start()
0927 13:49:56.814357 (+ 15us) write_op.cc:276] Timestamp: P: 1790516990786323 usec, L: 0
0927 13:49:56.814468 (+ 111us) write_op.cc:270] Start()
0927 13:49:56.814483 (+ 15us) write_op.cc:276] Timestamp: P: 1790516990797586 usec, L: 0
0927 13:49:56.814588 (+ 105us) write_op.cc:270] Start()
0927 13:49:56.814603 (+ 15us) write_op.cc:276] Timestamp: P: 1790516990803656 usec, L: 0
0927 13:49:56.814715 (+ 112us) write_op.cc:270] Start()
0927 13:49:56.814730 (+ 15us) write_op.cc:276] Timestamp: P: 1790516990825333 usec, L: 0
0927 13:49:56.816297 (+ 1567us) write_op.cc:270] Start()
0927 13:49:56.816321 (+ 24us) write_op.cc:276] Timestamp: P: 1790516990879823 usec, L: 0
0927 13:49:56.816489 (+ 168us) write_op.cc:270] Start()
0927 13:49:56.816507 (+ 18us) write_op.cc:276] Timestamp: P: 1790516990880691 usec, L: 0
0927 13:49:56.816631 (+ 124us) write_op.cc:270] Start()
0927 13:49:56.816647 (+ 16us) write_op.cc:276] Timestamp: P: 1790516990886609 usec, L: 0
0927 13:49:56.816754 (+ 107us) write_op.cc:270] Start()
0927 13:49:56.816769 (+ 15us) write_op.cc:276] Timestamp: P: 1790516990887216 usec, L: 0
0927 13:49:56.816871 (+ 102us) write_op.cc:270] Start()
0927 13:49:56.816886 (+ 15us) write_op.cc:276] Timestamp: P: 1790516990889202 usec, L: 0
0927 13:49:56.816993 (+ 107us) write_op.cc:270] Start()
0927 13:49:56.817013 (+ 20us) write_op.cc:276] Timestamp: P: 1790516990892631 usec, L: 0
0927 13:49:56.817128 (+ 115us) write_op.cc:270] Start()
0927 13:49:56.817143 (+ 15us) write_op.cc:276] Timestamp: P: 1790516990894563 usec, L: 0
0927 13:49:56.817276 (+ 133us) write_op.cc:270] Start()
0927 13:49:56.817291 (+ 15us) write_op.cc:276] Timestamp: P: 1790516990896046 usec, L: 0
0927 13:49:56.817388 (+ 97us) write_op.cc:270] Start()
0927 13:49:56.817408 (+ 20us) write_op.cc:276] Timestamp: P: 1790516990943122 usec, L: 0
0927 13:49:56.817536 (+ 128us) write_op.cc:270] Start()
0927 13:49:56.817552 (+ 16us) write_op.cc:276] Timestamp: P: 1790516991021954 usec, L: 0
0927 13:49:56.817667 (+ 115us) write_op.cc:270] Start()
0927 13:49:56.817683 (+ 16us) write_op.cc:276] Timestamp: P: 1790516991022579 usec, L: 0
0927 13:49:56.817788 (+ 105us) write_op.cc:270] Start()
0927 13:49:56.821001 (+ 3213us) write_op.cc:276] Timestamp: P: 1790516991023142 usec, L: 0
0927 13:49:56.821224 (+ 223us) write_op.cc:270] Start()
0927 13:49:56.821254 (+ 30us) write_op.cc:276] Timestamp: P: 1790516991023674 usec, L: 0
0927 13:49:56.821413 (+ 159us) write_op.cc:270] Start()
0927 13:49:56.821450 (+ 37us) write_op.cc:276] Timestamp: P: 1790516991042594 usec, L: 0
0927 13:49:56.821606 (+ 156us) write_op.cc:270] Start()
0927 13:49:56.821629 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991043240 usec, L: 0
0927 13:49:56.821775 (+ 146us) write_op.cc:270] Start()
0927 13:49:56.821797 (+ 22us) write_op.cc:276] Timestamp: P: 1790516991044268 usec, L: 0
0927 13:49:56.821929 (+ 132us) write_op.cc:270] Start()
0927 13:49:56.821952 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991045088 usec, L: 0
0927 13:49:56.822190 (+ 238us) write_op.cc:270] Start()
0927 13:49:56.822215 (+ 25us) write_op.cc:276] Timestamp: P: 1790516991045676 usec, L: 0
0927 13:49:56.822377 (+ 162us) write_op.cc:270] Start()
0927 13:49:56.822400 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991082488 usec, L: 0
0927 13:49:56.822593 (+ 193us) write_op.cc:270] Start()
0927 13:49:56.822616 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991083773 usec, L: 0
0927 13:49:56.822785 (+ 169us) write_op.cc:270] Start()
0927 13:49:56.822815 (+ 30us) write_op.cc:276] Timestamp: P: 1790516991084488 usec, L: 0
0927 13:49:56.822951 (+ 136us) write_op.cc:270] Start()
0927 13:49:56.822974 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991107357 usec, L: 0
0927 13:49:56.823176 (+ 202us) write_op.cc:270] Start()
0927 13:49:56.823199 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991121873 usec, L: 0
0927 13:49:56.823345 (+ 146us) write_op.cc:270] Start()
0927 13:49:56.823367 (+ 22us) write_op.cc:276] Timestamp: P: 1790516991182659 usec, L: 0
0927 13:49:56.823528 (+ 161us) write_op.cc:270] Start()
0927 13:49:56.823576 (+ 48us) write_op.cc:276] Timestamp: P: 1790516991391932 usec, L: 0
0927 13:49:56.823719 (+ 143us) write_op.cc:270] Start()
0927 13:49:56.823741 (+ 22us) write_op.cc:276] Timestamp: P: 1790516991399539 usec, L: 0
0927 13:49:56.823888 (+ 147us) write_op.cc:270] Start()
0927 13:49:56.823910 (+ 22us) write_op.cc:276] Timestamp: P: 1790516991405347 usec, L: 0
0927 13:49:56.824045 (+ 135us) write_op.cc:270] Start()
0927 13:49:56.824066 (+ 21us) write_op.cc:276] Timestamp: P: 1790516991413161 usec, L: 0
0927 13:49:56.824207 (+ 141us) write_op.cc:270] Start()
0927 13:49:56.824229 (+ 22us) write_op.cc:276] Timestamp: P: 1790516991435316 usec, L: 0
0927 13:49:56.824379 (+ 150us) write_op.cc:270] Start()
0927 13:49:56.824402 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991450187 usec, L: 0
0927 13:49:56.824569 (+ 167us) write_op.cc:270] Start()
0927 13:49:56.824592 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991451479 usec, L: 0
0927 13:49:56.824761 (+ 169us) write_op.cc:270] Start()
0927 13:49:56.824784 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991452142 usec, L: 0
0927 13:49:56.824921 (+ 137us) write_op.cc:270] Start()
0927 13:49:56.824952 (+ 31us) write_op.cc:276] Timestamp: P: 1790516991452653 usec, L: 0
0927 13:49:56.825101 (+ 149us) write_op.cc:270] Start()
0927 13:49:56.825124 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991459147 usec, L: 0
0927 13:49:56.825266 (+ 142us) write_op.cc:270] Start()
0927 13:49:56.825290 (+ 24us) write_op.cc:276] Timestamp: P: 1790516991485111 usec, L: 0
0927 13:49:56.825454 (+ 164us) write_op.cc:270] Start()
0927 13:49:56.825478 (+ 24us) write_op.cc:276] Timestamp: P: 1790516991489493 usec, L: 0
0927 13:49:56.825648 (+ 170us) write_op.cc:270] Start()
0927 13:49:56.825672 (+ 24us) write_op.cc:276] Timestamp: P: 1790516991490131 usec, L: 0
0927 13:49:56.825809 (+ 137us) write_op.cc:270] Start()
0927 13:49:56.825830 (+ 21us) write_op.cc:276] Timestamp: P: 1790516991497734 usec, L: 0
0927 13:49:56.825996 (+ 166us) write_op.cc:270] Start()
0927 13:49:56.826022 (+ 26us) write_op.cc:276] Timestamp: P: 1790516991502319 usec, L: 0
0927 13:49:56.826216 (+ 194us) write_op.cc:270] Start()
0927 13:49:56.826241 (+ 25us) write_op.cc:276] Timestamp: P: 1790516991510701 usec, L: 0
0927 13:49:56.826395 (+ 154us) write_op.cc:270] Start()
0927 13:49:56.826502 (+ 107us) write_op.cc:276] Timestamp: P: 1790516991519606 usec, L: 0
0927 13:49:56.826686 (+ 184us) write_op.cc:270] Start()
0927 13:49:56.826714 (+ 28us) write_op.cc:276] Timestamp: P: 1790516991525109 usec, L: 0
0927 13:49:56.826857 (+ 143us) write_op.cc:270] Start()
0927 13:49:56.826881 (+ 24us) write_op.cc:276] Timestamp: P: 1790516991528781 usec, L: 0
0927 13:49:56.827045 (+ 164us) write_op.cc:270] Start()
0927 13:49:56.827068 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991531847 usec, L: 0
0927 13:49:56.827223 (+ 155us) write_op.cc:270] Start()
0927 13:49:56.827246 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991544541 usec, L: 0
0927 13:49:56.827431 (+ 185us) write_op.cc:270] Start()
0927 13:49:56.827455 (+ 24us) write_op.cc:276] Timestamp: P: 1790516991547803 usec, L: 0
0927 13:49:56.828103 (+ 648us) write_op.cc:270] Start()
0927 13:49:56.828135 (+ 32us) write_op.cc:276] Timestamp: P: 1790516991552763 usec, L: 0
0927 13:49:56.828306 (+ 171us) write_op.cc:270] Start()
0927 13:49:56.828330 (+ 24us) write_op.cc:276] Timestamp: P: 1790516991560105 usec, L: 0
0927 13:49:56.828502 (+ 172us) write_op.cc:270] Start()
0927 13:49:56.828526 (+ 24us) write_op.cc:276] Timestamp: P: 1790516991563517 usec, L: 0
0927 13:49:56.828678 (+ 152us) write_op.cc:270] Start()
0927 13:49:56.828702 (+ 24us) write_op.cc:276] Timestamp: P: 1790516991610599 usec, L: 0
0927 13:49:56.828927 (+ 225us) write_op.cc:270] Start()
0927 13:49:56.828954 (+ 27us) write_op.cc:276] Timestamp: P: 1790516991632131 usec, L: 0
0927 13:49:56.829301 (+ 347us) write_op.cc:270] Start()
0927 13:49:56.829328 (+ 27us) write_op.cc:276] Timestamp: P: 1790516991732787 usec, L: 0
0927 13:49:56.829492 (+ 164us) write_op.cc:270] Start()
0927 13:49:56.829517 (+ 25us) write_op.cc:276] Timestamp: P: 1790516991817288 usec, L: 0
0927 13:49:56.829672 (+ 155us) write_op.cc:270] Start()
0927 13:49:56.829695 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991818007 usec, L: 0
0927 13:49:56.829843 (+ 148us) write_op.cc:270] Start()
0927 13:49:56.829864 (+ 21us) write_op.cc:276] Timestamp: P: 1790516991821929 usec, L: 0
0927 13:49:56.830010 (+ 146us) write_op.cc:270] Start()
0927 13:49:56.830033 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991836074 usec, L: 0
0927 13:49:56.830206 (+ 173us) write_op.cc:270] Start()
0927 13:49:56.830231 (+ 25us) write_op.cc:276] Timestamp: P: 1790516991892042 usec, L: 0
0927 13:49:56.830380 (+ 149us) write_op.cc:270] Start()
0927 13:49:56.830402 (+ 22us) write_op.cc:276] Timestamp: P: 1790516991916463 usec, L: 0
0927 13:49:56.830568 (+ 166us) write_op.cc:270] Start()
0927 13:49:56.830591 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991918195 usec, L: 0
0927 13:49:56.830734 (+ 143us) write_op.cc:270] Start()
0927 13:49:56.830758 (+ 24us) write_op.cc:276] Timestamp: P: 1790516991918755 usec, L: 0
0927 13:49:56.830925 (+ 167us) write_op.cc:270] Start()
0927 13:49:56.830994 (+ 69us) write_op.cc:276] Timestamp: P: 1790516991919330 usec, L: 0
0927 13:49:56.831240 (+ 246us) write_op.cc:270] Start()
0927 13:49:56.831267 (+ 27us) write_op.cc:276] Timestamp: P: 1790516991971975 usec, L: 0
0927 13:49:56.831441 (+ 174us) write_op.cc:270] Start()
0927 13:49:56.831464 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991972967 usec, L: 0
0927 13:49:56.831617 (+ 153us) write_op.cc:270] Start()
0927 13:49:56.831639 (+ 22us) write_op.cc:276] Timestamp: P: 1790516991973743 usec, L: 0
0927 13:49:56.831783 (+ 144us) write_op.cc:270] Start()
0927 13:49:56.831805 (+ 22us) write_op.cc:276] Timestamp: P: 1790516991974389 usec, L: 0
0927 13:49:56.831921 (+ 116us) write_op.cc:270] Start()
0927 13:49:56.831942 (+ 21us) write_op.cc:276] Timestamp: P: 1790516991974984 usec, L: 0
0927 13:49:56.832080 (+ 138us) write_op.cc:270] Start()
0927 13:49:56.832100 (+ 20us) write_op.cc:276] Timestamp: P: 1790516991976922 usec, L: 0
0927 13:49:56.832249 (+ 149us) write_op.cc:270] Start()
0927 13:49:56.832272 (+ 23us) write_op.cc:276] Timestamp: P: 1790516991977473 usec, L: 0
0927 13:49:56.832449 (+ 177us) write_op.cc:270] Start()
0927 13:49:56.832471 (+ 22us) write_op.cc:276] Timestamp: P: 1790516991997183 usec, L: 0
0927 13:49:56.832612 (+ 141us) write_op.cc:270] Start()
0927 13:49:56.832633 (+ 21us) write_op.cc:276] Timestamp: P: 1790516992007714 usec, L: 0
0927 13:49:56.832764 (+ 131us) write_op.cc:270] Start()
0927 13:49:56.832785 (+ 21us) write_op.cc:276] Timestamp: P: 1790516992010462 usec, L: 0
0927 13:49:56.832971 (+ 186us) write_op.cc:270] Start()
0927 13:49:56.832999 (+ 28us) write_op.cc:276] Timestamp: P: 1790516992011280 usec, L: 0
0927 13:49:56.833168 (+ 169us) write_op.cc:270] Start()
0927 13:49:56.833191 (+ 23us) write_op.cc:276] Timestamp: P: 1790516992016064 usec, L: 0
0927 13:49:56.833329 (+ 138us) write_op.cc:270] Start()
0927 13:49:56.833351 (+ 22us) write_op.cc:276] Timestamp: P: 1790516992042715 usec, L: 0
0927 13:49:56.833509 (+ 158us) write_op.cc:270] Start()
0927 13:49:56.833532 (+ 23us) write_op.cc:276] Timestamp: P: 1790516992060339 usec, L: 0
0927 13:49:56.833709 (+ 177us) write_op.cc:270] Start()
0927 13:49:56.833732 (+ 23us) write_op.cc:276] Timestamp: P: 1790516992072955 usec, L: 0
0927 13:49:56.833875 (+ 143us) write_op.cc:270] Start()
0927 13:49:56.833898 (+ 23us) write_op.cc:276] Timestamp: P: 1790516992081163 usec, L: 0
0927 13:49:56.834059 (+ 161us) write_op.cc:270] Start()
0927 13:49:56.834083 (+ 24us) write_op.cc:276] Timestamp: P: 1790516992086183 usec, L: 0
0927 13:49:56.834247 (+ 164us) write_op.cc:270] Start()
0927 13:49:56.834270 (+ 23us) write_op.cc:276] Timestamp: P: 1790516992113136 usec, L: 0
0927 13:49:56.834427 (+ 157us) write_op.cc:270] Start()
0927 13:49:56.834450 (+ 23us) write_op.cc:276] Timestamp: P: 1790516992125515 usec, L: 0
0927 13:49:56.834602 (+ 152us) write_op.cc:270] Start()
0927 13:49:56.834625 (+ 23us) write_op.cc:276] Timestamp: P: 1790516992157129 usec, L: 0
0927 13:49:56.834767 (+ 142us) write_op.cc:270] Start()
0927 13:49:56.834788 (+ 21us) write_op.cc:276] Timestamp: P: 1790516992181981 usec, L: 0
0927 13:49:56.834937 (+ 149us) write_op.cc:270] Start()
0927 13:49:56.834961 (+ 24us) write_op.cc:276] Timestamp: P: 1790516992189780 usec, L: 0
0927 13:49:56.835163 (+ 202us) write_op.cc:270] Start()
0927 13:49:56.835190 (+ 27us) write_op.cc:276] Timestamp: P: 1790516992205094 usec, L: 0
0927 13:49:56.835344 (+ 154us) write_op.cc:270] Start()
0927 13:49:56.835367 (+ 23us) write_op.cc:276] Timestamp: P: 1790516992229858 usec, L: 0
0927 13:49:56.835541 (+ 174us) write_op.cc:270] Start()
0927 13:49:56.835564 (+ 23us) write_op.cc:276] Timestamp: P: 1790516992243194 usec, L: 0
0927 13:49:56.835701 (+ 137us) write_op.cc:270] Start()
0927 13:49:56.835722 (+ 21us) write_op.cc:276] Timestamp: P: 1790516992254343 usec, L: 0
0927 13:49:56.835896 (+ 174us) write_op.cc:270] Start()
0927 13:49:56.835918 (+ 22us) write_op.cc:276] Timestamp: P: 1790516992266653 usec, L: 0
0927 13:49:56.836070 (+ 152us) write_op.cc:270] Start()
0927 13:49:56.836092 (+ 22us) write_op.cc:276] Timestamp: P: 1790516992283452 usec, L: 0
0927 13:49:56.836237 (+ 145us) write_op.cc:270] Start()
0927 13:49:56.836259 (+ 22us) write_op.cc:276] Timestamp: P: 1790516992297057 usec, L: 0
0927 13:49:56.836414 (+ 155us) write_op.cc:270] Start()
0927 13:49:56.836446 (+ 32us) write_op.cc:276] Timestamp: P: 17905169
I20260927 13:49:57.942618 6609 leader_election.cc:290] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:57.956125 5619 tablet_bootstrap.cc:492] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:57.944051 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 8437f48a0c4645fbbc205aca8def77b5 (DEFAULT_TABLE table=default.Table_75865dd4349e418896b4469e10a62252 [id=eaf034197b00472287e8218a4ecd41bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.948369 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet d9cb99ad45d1445cb2e2854319a3d73d
I20260927 13:49:57.959523 5619 ts_tablet_manager.cc:1403] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.004s
I20260927 13:49:57.948879 4927 master_service.cc:960] ReplaceTablet: received request to replace tablet 0880140d99004eb1803d6b5dcf41af13 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:57.960227 5619 raft_consensus.cc:359] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.960407 5619 raft_consensus.cc:385] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:57.960472 5619 raft_consensus.cc:740] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:57.960526 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet d9cb99ad45d1445cb2e2854319a3d73d with delete_type TABLET_DATA_DELETED (replaced by tablet c16673cfe45f4c81806f4dda3246d476) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:57.961261 5619 consensus_queue.cc:260] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.961414 4928 catalog_manager.cc:6934] ReplaceTablet: tablet d9cb99ad45d1445cb2e2854319a3d73d deleted and replaced by tablet c16673cfe45f4c81806f4dda3246d476
W20260927 13:49:57.961493 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet d9cb99ad45d1445cb2e2854319a3d73d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9cb99ad45d1445cb2e2854319a3d73d already in progress: creating tablet
I20260927 13:49:57.961787 5619 ts_tablet_manager.cc:1434] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:49:57.962039 5619 tablet_bootstrap.cc:492] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.963466 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8437f48a0c4645fbbc205aca8def77b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.963706 5619 tablet_bootstrap.cc:654] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:57.963949 5227 tablet_service.cc:1511] Processing CreateTablet for tablet cf7966f71a814eab918b0da2ddfc16c9 (DEFAULT_TABLE table=default.Table_b81799f423864c5faf4b54c86e95aebc [id=e2566dade29042a897d2e1c91672787c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.964301 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7966f71a814eab918b0da2ddfc16c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.965044 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet d9cb99ad45d1445cb2e2854319a3d73d with delete_type TABLET_DATA_DELETED (replaced by tablet c16673cfe45f4c81806f4dda3246d476) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:57.973963 5349 tablet_service.cc:1511] Processing CreateTablet for tablet cf7966f71a814eab918b0da2ddfc16c9 (DEFAULT_TABLE table=default.Table_b81799f423864c5faf4b54c86e95aebc [id=e2566dade29042a897d2e1c91672787c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.976161 6185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "802b83f09d3445359cfac825cd87c9de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:49:57.976418 6185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de [sys.catalog]: This master's current role is: LEADER
I20260927 13:49:57.978950 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_58f9b708528b4ba980888bbb033af8be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:57.979662 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58f9b708528b4ba980888bbb033af8be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:57.981570 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_0dc6b57a88cc433c8130f52ee6622be2" } new_table_name: "default.Table_81d446c6cfde4dd8b7cba22c219df25c" modify_external_catalogs: true
I20260927 13:49:57.982352 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7966f71a814eab918b0da2ddfc16c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.985050 6609 consensus_queue.cc:1048] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:57.947041 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 2753a2efb2094219bcb02825e9568d7e (DEFAULT_TABLE table=default.Table_e512f6e2722c488da1df36462f461d3d [id=334c5498104b4128918d0830e469dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.986425 6608 raft_consensus.cc:493] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:57.986621 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2753a2efb2094219bcb02825e9568d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.986603 6608 raft_consensus.cc:515] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:57.987273 6608 leader_election.cc:290] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:57.988159 5319 leader_election.cc:343] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: fa9d09ca7952499ba135e15cecb1143e
I20260927 13:49:57.989712 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9d09ca7952499ba135e15cecb1143e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:57.990258 5319 leader_election.cc:343] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.990355 5319 leader_election.cc:304] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:57.990695 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 0fe47041b75d492bbce62c95d90de021 (DEFAULT_TABLE table=default.Table_f2000b1332564779b99fef20acf75a9a [id=a6d3f0f894904a738cc54fe5d8631f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.991214 6608 raft_consensus.cc:2749] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:57.991487 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fe47041b75d492bbce62c95d90de021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:57.997874 6667 raft_consensus.cc:493] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.003510 6667 raft_consensus.cc:515] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.004253 6667 leader_election.cc:290] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:58.006001 5184 leader_election.cc:343] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 56b9612ffea543b9b0779c46533d91ab
W20260927 13:49:58.006369 5185 leader_election.cc:343] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 56b9612ffea543b9b0779c46533d91ab
I20260927 13:49:58.006532 5185 leader_election.cc:304] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.006922 6667 raft_consensus.cc:2749] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:58.017869 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9fdef4f56d9647118afe83ac3cd364fd consensus state has no leader
I20260927 13:49:58.022383 5249 raft_consensus.cc:3060] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.023187 6644 catalog_manager.cc:1308] Loaded cluster ID: 020f38d03ca7495283eb7628b4a1a71b
I20260927 13:49:58.023278 6644 catalog_manager.cc:1601] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: loading cluster ID for follower catalog manager: success
I20260927 13:49:58.026261 6609 consensus_queue.cc:1048] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:58.042470 6493 raft_consensus.cc:2272] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.043059 6493 ts_tablet_manager.cc:1916] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:57.871542 6546 consensus_queue.cc:1048] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:57.876335 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 0021dbaf7e8440479bcf24cce693b158 (DEFAULT_TABLE table=default.Table_1b68a2cb5f1745e3833886667aa5314a [id=72fccb6fab244902b82b30724a723d45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.043614 5623 log.cc:1199] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/a7a97f4df3a84781bfcbdc768d518ef0
I20260927 13:49:57.877427 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 2753a2efb2094219bcb02825e9568d7e (DEFAULT_TABLE table=default.Table_e512f6e2722c488da1df36462f461d3d [id=334c5498104b4128918d0830e469dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.888131 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 6c82fd138de14f218b4ec2c7d44723bf (DEFAULT_TABLE table=default.Table_60e4fad358b94bf5a7dcf5632fabd19d [id=64bcf428240942d59593eb02e4843760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.045224 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_658c8fe0fb60498296e1a93815016286"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.045884 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_658c8fe0fb60498296e1a93815016286 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:57.923684 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564f5c92bf144fa1bfc2e1e07132dd69" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:58.046231 5107 raft_consensus.cc:2468] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:57.934896 5076 tablet_service.cc:1511] Processing CreateTablet for tablet a003afa0fbb74d548cfaba51ea6cef58 (DEFAULT_TABLE table=default.Table_440adeb28a1147c9ae74c2fb6a476219 [id=7afcf03e74464b20928909363e8640e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.938246 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 8437f48a0c4645fbbc205aca8def77b5 (DEFAULT_TABLE table=default.Table_75865dd4349e418896b4469e10a62252 [id=eaf034197b00472287e8218a4ecd41bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.942548 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564f5c92bf144fa1bfc2e1e07132dd69" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:57.962541 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet d9cb99ad45d1445cb2e2854319a3d73d with delete_type TABLET_DATA_DELETED (replaced by tablet c16673cfe45f4c81806f4dda3246d476) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.047341 5105 raft_consensus.cc:3060] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.047683 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 0fe47041b75d492bbce62c95d90de021 (DEFAULT_TABLE table=default.Table_f2000b1332564779b99fef20acf75a9a [id=a6d3f0f894904a738cc54fe5d8631f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:57.982048 6682 raft_consensus.cc:493] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.048398 6682 raft_consensus.cc:515] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.048790 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 5230aab9688e45b79bd0064716378152 (DEFAULT_TABLE table=default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.049063 6682 leader_election.cc:290] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.049149 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5230aab9688e45b79bd0064716378152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.049599 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860aa52d44ad494594c73707e6ef98e2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.050010 5105 raft_consensus.cc:2468] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:49:58.050154 5045 leader_election.cc:343] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:57.988770 5086 tablet_service.cc:1511] Processing CreateTablet for tablet cf7966f71a814eab918b0da2ddfc16c9 (DEFAULT_TABLE table=default.Table_b81799f423864c5faf4b54c86e95aebc [id=e2566dade29042a897d2e1c91672787c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.050674 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 0fe47041b75d492bbce62c95d90de021 (DEFAULT_TABLE table=default.Table_f2000b1332564779b99fef20acf75a9a [id=a6d3f0f894904a738cc54fe5d8631f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.050973 5623 ts_tablet_manager.cc:1950] T a7a97f4df3a84781bfcbdc768d518ef0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.051030 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fe47041b75d492bbce62c95d90de021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.051764 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 601) took 1263 ms. Trace:
I20260927 13:49:58.051841 5623 rpcz_store.cc:276] 0927 13:49:56.788652 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.788707 (+ 55us) service_pool.cc:224] Handling call
0927 13:49:57.772107 (+983400us) ts_tablet_manager.cc:1151] Deleting tablet a7a97f4df3a84781bfcbdc768d518ef0
0927 13:49:57.772119 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:57.779065 (+ 6946us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:57.781957 (+ 2892us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.051742 (+269785us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":983233}
I20260927 13:49:58.052338 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet a7a97f4df3a84781bfcbdc768d518ef0 (table default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]) successfully deleted
I20260927 13:49:58.052639 5623 tablet_replica.cc:333] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.052819 5623 raft_consensus.cc:2243] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.052948 5623 raft_consensus.cc:2272] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.053489 5623 ts_tablet_manager.cc:1916] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.054608 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2c133084fc48484bbe4dd43a4ee2eb1d" } modify_external_catalogs: true
I20260927 13:49:58.054774 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2c133084fc48484bbe4dd43a4ee2eb1d" } modify_external_catalogs: true
I20260927 13:49:58.054754 6690 tablet.cc:1751] T c2fc2734e88e431facdf72e9ef136106 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:58.058506 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fe47041b75d492bbce62c95d90de021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.058730 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c82fd138de14f218b4ec2c7d44723bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.058955 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0021dbaf7e8440479bcf24cce693b158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.062253 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a003afa0fbb74d548cfaba51ea6cef58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.067025 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7966f71a814eab918b0da2ddfc16c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.069659 5626 tablet_bootstrap.cc:492] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:58.069788 5626 ts_tablet_manager.cc:1403] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.169s user 0.004s sys 0.011s
I20260927 13:49:58.070715 5626 raft_consensus.cc:359] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.070881 5626 raft_consensus.cc:385] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.070942 5626 raft_consensus.cc:740] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.071198 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8437f48a0c4645fbbc205aca8def77b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.071192 5626 consensus_queue.cc:260] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.071573 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2753a2efb2094219bcb02825e9568d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.072389 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 5230aab9688e45b79bd0064716378152 (DEFAULT_TABLE table=default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.073563 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 5230aab9688e45b79bd0064716378152 (DEFAULT_TABLE table=default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.073896 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5230aab9688e45b79bd0064716378152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.075963 5347 tablet_service.cc:1511] Processing CreateTablet for tablet f98a8d63149f4c3d84bc804ef5a14e00 (DEFAULT_TABLE table=default.Table_f01116bdf8b644238db27fc1b3ae9fc6 [id=4e36bb70ef2942beaea498936148ac99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.077018 5626 ts_tablet_manager.cc:1434] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 13:49:58.077508 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 98b434884a3f4c63a9ba341e53703023 (DEFAULT_TABLE table=default.Table_0956a69da22a495691888f08a70b62dc [id=126aea719ed34308a0742ed1fe5d6970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.078011 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b434884a3f4c63a9ba341e53703023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.080260 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f98a8d63149f4c3d84bc804ef5a14e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.080471 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5230aab9688e45b79bd0064716378152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.080535 4924 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_27e66012e36e4417a0ff30c28955e58e [id=77f96d35f95b45f9972f1e5cf494031f] alter complete (version 2)
I20260927 13:49:58.081059 5626 tablet_bootstrap.cc:492] T c332b6ec9ca94ce398a71e82e20897d4 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:49:58.081332 4924 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.67:52291 (request call id 128) took 788 ms (client timeout 1000 ms). Trace:
W20260927 13:49:58.081446 4924 rpcz_store.cc:269] 0927 13:49:57.292590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:57.355161 (+ 62571us) service_pool.cc:224] Handling call
0927 13:49:57.368162 (+ 13001us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x616000051a54. stack: 00007fa4fa3bd5c6 00007fa4fa3bd380 00007fa4f93c534d 00000000009a4cb4 00000000009a4c7d 00007fa50993765d 00007fa509937753 00007fa5064b4db1 00007fa50e2a8a7d 00007fa50e4326e8 00007fa504e011f6 00007fa504e00f25 00007fa50150763e 00007fa50150651e 00007fa50150c758 00007fa50150d0bf
0927 13:49:58.081296 (+713134us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:49:57.836976 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:57.837069 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:57.837073 (+ 4us) write_op.cc:435] Acquired schema lock
0927 13:49:57.837076 (+ 3us) tablet.cc:662] Decoding operations
0927 13:49:57.837156 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:57.837166 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:57.837170 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:49:57.837220 (+ 50us) tablet.cc:701] Row locks acquired
0927 13:49:57.837222 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:49:57.837249 (+ 27us) write_op.cc:270] Start()
0927 13:49:57.837285 (+ 36us) write_op.cc:276] Timestamp: P: 1790516997837200 usec, L: 0
0927 13:49:57.837288 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:49:57.837437 (+ 149us) log.cc:844] Serialized 530 byte log entry
0927 13:49:57.840672 (+ 3235us) op_driver.cc:464] REPLICATION: finished
0927 13:49:57.840856 (+ 184us) write_op.cc:301] APPLY: starting
0927 13:49:57.840870 (+ 14us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:57.840901 (+ 31us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:57.840925 (+ 24us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:57.840970 (+ 45us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:57.840996 (+ 26us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:57.841002 (+ 6us) write_op.cc:312] APPLY: finished
0927 13:49:57.841059 (+ 57us) log.cc:844] Serialized 23 byte log entry
0927 13:49:57.841108 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:57.841123 (+ 15us) write_op.cc:454] Released schema lock
0927 13:49:57.841128 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:57.856883 (+ 15755us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:57.856890 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0927 13:49:58.045503 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:58.045613 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:58.045617 (+ 4us) write_op.cc:435] Acquired schema lock
0927 13:49:58.045619 (+ 2us) tablet.cc:662] Decoding operations
0927 13:49:58.045759 (+ 140us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:58.045777 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:58.045785 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:49:58.045904 (+ 119us) tablet.cc:701] Row locks acquired
0927 13:49:58.045909 (+ 5us) write_op.cc:260] PREPARE: finished
0927 13:49:58.045954 (+ 45us) write_op.cc:270] Start()
0927 13:49:58.046001 (+ 47us) write_op.cc:276] Timestamp: P: 1790516998045925 usec, L: 0
0927 13:49:58.046006 (+ 5us) op_driver.cc:348] REPLICATION: starting
0927 13:49:58.046215 (+ 209us) log.cc:844] Serialized 356 byte log entry
0927 13:49:58.079455 (+ 33240us) op_driver.cc:464] REPLICATION: finished
0927 13:49:58.079590 (+ 135us) write_op.cc:301] APPLY: starting
0927 13:49:58.079603 (+ 13us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:58.079633 (+ 30us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:58.079657 (+ 24us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:58.079699 (+ 42us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:58.079737 (+ 38us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:58.079744 (+ 7us) write_op.cc:312] APPLY: finished
0927 13:49:58.079810 (+ 66us) log.cc:844] Serialized 23 byte log entry
0927 13:49:58.079861 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:58.079874 (+ 13us) write_op.cc:454] Released schema lock
0927 13:49:58.079880 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:58.079949 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:58.079952 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"spinlock_wait_cycles":28575488,"child_traces":[["op",{"apply.queue_time_us":142,"apply.run_cpu_time_us":330,"apply.run_wall_time_us":330,"num_ops":1,"prepare.queue_time_us":465829,"prepare.run_cpu_time_us":570,"prepare.run_wall_time_us":19896,"raft.queue_time_us":34,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":197,"replication_time_us":3358}],["op",{"apply.queue_time_us":95,"apply.run_cpu_time_us":348,"apply.run_wall_time_us":347,"num_ops":1,"prepare.queue_time_us":198053,"prepare.run_cpu_time_us":810,"prepare.run_wall_time_us":809,"raft.queue_time_us":21515,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":309,"replication_time_us":33420}]]}
I20260927 13:49:58.082567 4924 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f0c950212bbf448eb0f057c01e482ecf" } modify_external_catalogs: true
I20260927 13:49:58.082779 4924 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f0c950212bbf448eb0f057c01e482ecf" } modify_external_catalogs: true
I20260927 13:49:58.083976 4926 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet dbac01a4f3ea4b6f957a44e916362902
I20260927 13:49:58.084079 4926 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:44072 (request call id 828) took 1033 ms. Trace:
I20260927 13:49:58.084164 4926 rpcz_store.cc:276] 0927 13:49:57.050338 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:57.861704 (+811366us) service_pool.cc:224] Handling call
0927 13:49:57.865378 (+ 3674us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x616000051a54. stack: 00007fa4fa3bd5c6 00007fa4fa3bd380 00007fa4f93c534d 00000000009a4cb4 00000000009a4c7d 00007fa50993765d 00007fa509937753 00007fa5064b4db1 00007fa50e2a8a7d 00007fa50e438e96 00007fa504e059d6 00007fa504e05705 00007fa50150763e 00007fa50150651e 00007fa50150c758 00007fa50150d0bf
0927 13:49:57.865702 (+ 324us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:49:57.865826 (+ 124us) catalog_manager.cc:2854] Modifying in-memory table state
0927 13:49:57.865881 (+ 55us) catalog_manager.cc:2863] Locking tablets
0927 13:49:57.865987 (+ 106us) catalog_manager.cc:2877] Removing table and tablets from system table
0927 13:49:58.083822 (+217835us) catalog_manager.cc:2895] Removing table from by-name map
0927 13:49:58.083878 (+ 56us) catalog_manager.cc:2911] Committing in-memory state
0927 13:49:58.083918 (+ 40us) catalog_manager.cc:2915] Aborting table tasks
0927 13:49:58.084051 (+ 133us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:49:58.046337 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:58.046438 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:58.046445 (+ 7us) write_op.cc:435] Acquired schema lock
0927 13:49:58.046449 (+ 4us) tablet.cc:662] Decoding operations
0927 13:49:58.046572 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:58.046584 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:58.046591 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:49:58.046681 (+ 90us) tablet.cc:701] Row locks acquired
0927 13:49:58.046685 (+ 4us) write_op.cc:260] PREPARE: finished
0927 13:49:58.046725 (+ 40us) write_op.cc:270] Start()
0927 13:49:58.046759 (+ 34us) write_op.cc:276] Timestamp: P: 1790516998046699 usec, L: 0
0927 13:49:58.046765 (+ 6us) op_driver.cc:348] REPLICATION: starting
0927 13:49:58.047065 (+ 300us) log.cc:844] Serialized 533 byte log entry
0927 13:49:58.079514 (+ 32449us) op_driver.cc:464] REPLICATION: finished
0927 13:49:58.080015 (+ 501us) write_op.cc:301] APPLY: starting
0927 13:49:58.080025 (+ 10us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:58.080068 (+ 43us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:58.080100 (+ 32us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:58.080144 (+ 44us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:58.080170 (+ 26us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:49:58.080178 (+ 8us) write_op.cc:312] APPLY: finished
0927 13:49:58.080229 (+ 51us) log.cc:844] Serialized 29 byte log entry
0927 13:49:58.080270 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:58.080283 (+ 13us) write_op.cc:454] Released schema lock
0927 13:49:58.080288 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:58.080347 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:58.080351 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":7915264,"child_traces":[["op",{"apply.queue_time_us":473,"apply.run_cpu_time_us":325,"apply.run_wall_time_us":325,"num_ops":2,"prepare.queue_time_us":179782,"prepare.run_cpu_time_us":849,"prepare.run_wall_time_us":21887,"raft.queue_time_us":21035,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":4,"replication_time_us":32734,"spinlock_wait_cycles":189184}]]}
I20260927 13:49:58.084995 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6654f7ea3c6c4d07806b732f11f5d352" } modify_external_catalogs: true
I20260927 13:49:58.085155 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6654f7ea3c6c4d07806b732f11f5d352" } modify_external_catalogs: true
I20260927 13:49:58.085870 5626 tablet_bootstrap.cc:654] T c332b6ec9ca94ce398a71e82e20897d4 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.088533 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet d1f9ae430c414cdf9370388d51dd7c63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.088792 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 059afd48ac4a41569ed1d3556b7974f0 with delete_type TABLET_DATA_DELETED (replaced by tablet b57886cc11a2423983c2b7bac79150a0) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.088830 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f080b4ca9894eae8305d1548010a6cb with delete_type TABLET_DATA_DELETED (replaced by tablet da5d9bda857f467da6930a6c64266f3a) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.089016 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 56b9612ffea543b9b0779c46533d91ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.089075 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3b7666d87acf47bda3e3e2545c8cfb25" } modify_external_catalogs: true
I20260927 13:49:58.089248 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3b7666d87acf47bda3e3e2545c8cfb25" } modify_external_catalogs: true
I20260927 13:49:58.090070 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b855dedb8d04145b0c4469b9ba79453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.090392 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ffe83306e74749b5b3f68e6c2c708c with delete_type TABLET_DATA_DELETED (replaced by tablet 98b434884a3f4c63a9ba341e53703023) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.090445 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet ec40378eb80c412198d5b66c02e975ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.090660 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ee75d0a39c42b09f2f46a1774f925c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.090821 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet b8311ff24259477a9523355908ac14f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:48 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.090962 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet a7a97f4df3a84781bfcbdc768d518ef0 with delete_type TABLET_DATA_DELETED (replaced by tablet b5a9f864e4274666a86baed43e1623cd) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.092612 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet 4211f338c6a648c5b3e36c6df0b3c510 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:58.099607 5623 ts_tablet_manager.cc:1929] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.099711 5623 log.cc:1199] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/1245334728994a60ad641c2e90f8d2df
I20260927 13:49:58.100018 5623 ts_tablet_manager.cc:1950] T 1245334728994a60ad641c2e90f8d2df P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.101228 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet a443f65eba384b998fdc57ec57e37d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:58.101990 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a443f65eba384b998fdc57ec57e37d87 because the tablet was not found. No further retry: Not found: Tablet not found: a443f65eba384b998fdc57ec57e37d87
I20260927 13:49:58.102221 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 602) took 1313 ms. Trace:
I20260927 13:49:58.106601 5623 rpcz_store.cc:276] 0927 13:49:56.789098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.789142 (+ 44us) service_pool.cc:224] Handling call
0927 13:49:58.052596 (+1263454us) ts_tablet_manager.cc:1151] Deleting tablet 1245334728994a60ad641c2e90f8d2df
0927 13:49:58.052606 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.087315 (+ 34709us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.099548 (+ 12233us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.102200 (+ 2652us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1263300}
I20260927 13:49:58.108876 5077 tablet_service.cc:1511] Processing CreateTablet for tablet f98a8d63149f4c3d84bc804ef5a14e00 (DEFAULT_TABLE table=default.Table_f01116bdf8b644238db27fc1b3ae9fc6 [id=4e36bb70ef2942beaea498936148ac99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.109282 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f98a8d63149f4c3d84bc804ef5a14e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.110605 5085 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c2f814bb9ff41ebab19e8c16cf4affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.110885 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet da75a470ec0c4ec9afa7c18a51cd7276 with delete_type TABLET_DATA_DELETED (replaced by tablet bad30e7310c842e6818471272f5d669e) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.113610 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.113857 5070 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b082227264e442a8b1db7a68fb0c3eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.117578 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 592) took 1367 ms. Trace:
I20260927 13:49:58.117602 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 1245334728994a60ad641c2e90f8d2df (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]) successfully deleted
I20260927 13:49:58.117683 5623 rpcz_store.cc:276] 0927 13:49:56.782077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.794170 (+ 12093us) service_pool.cc:224] Handling call
0927 13:49:58.117421 (+1323251us) ts_tablet_manager.cc:1151] Deleting tablet c57b60cbc1ca462789fd8e7a235f7119
0927 13:49:58.117436 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.117556 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1322998}
W20260927 13:49:58.118290 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet c57b60cbc1ca462789fd8e7a235f7119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c57b60cbc1ca462789fd8e7a235f7119 already in progress: creating tablet
I20260927 13:49:58.118774 5623 tablet_replica.cc:333] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.118995 5623 raft_consensus.cc:2243] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.119580 5619 tablet_bootstrap.cc:492] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.119709 5619 ts_tablet_manager.cc:1403] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.158s user 0.008s sys 0.005s
I20260927 13:49:58.119886 5623 raft_consensus.cc:2272] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.120517 5623 ts_tablet_manager.cc:1916] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.120657 5619 raft_consensus.cc:359] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.120841 5619 raft_consensus.cc:385] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.120901 5619 raft_consensus.cc:740] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.121124 5619 consensus_queue.cc:260] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.121584 5619 ts_tablet_manager.cc:1434] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:58.121837 5619 tablet_bootstrap.cc:492] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:57.996394 6685 raft_consensus.cc:493] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.000782 6684 raft_consensus.cc:493] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.005414 5628 tablet_bootstrap.cc:492] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:58.123307 5628 ts_tablet_manager.cc:1403] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.434s user 0.019s sys 0.006s
I20260927 13:49:58.123270 6684 raft_consensus.cc:515] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.029950 6592 tablet.cc:1751] T c2fc2734e88e431facdf72e9ef136106 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260927 13:49:57.869953 5044 leader_election.cc:343] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.123706 5619 tablet_bootstrap.cc:654] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.039407 6673 raft_consensus.cc:493] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.123847 6673 raft_consensus.cc:515] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.125304 5222 tablet_service.cc:1511] Processing CreateTablet for tablet f98a8d63149f4c3d84bc804ef5a14e00 (DEFAULT_TABLE table=default.Table_f01116bdf8b644238db27fc1b3ae9fc6 [id=4e36bb70ef2942beaea498936148ac99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.125700 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f98a8d63149f4c3d84bc804ef5a14e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.132627 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 98b434884a3f4c63a9ba341e53703023 (DEFAULT_TABLE table=default.Table_0956a69da22a495691888f08a70b62dc [id=126aea719ed34308a0742ed1fe5d6970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.133263 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b434884a3f4c63a9ba341e53703023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.133826 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a07adcd33414d18ae9720e7a307548a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.134023 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet a813939920244be781d546311fe8a33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:58.134274 4915 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet fa9d09ca7952499ba135e15cecb1143e (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fa9d09ca7952499ba135e15cecb1143e consensus state has no leader
I20260927 13:49:58.123638 5044 leader_election.cc:304] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:58.135319 5044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 265355us
I20260927 13:49:58.136127 6683 raft_consensus.cc:2749] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.136289 6683 raft_consensus.cc:493] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.137579 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860aa52d44ad494594c73707e6ef98e2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.138275 5084 tablet_service.cc:1511] Processing CreateTablet for tablet c655651f9cb24310a5aa2e5b84c2a455 (DEFAULT_TABLE table=default.Table_22e17296fde940779eb9160306ff386d [id=db63359dda9d4b729446d6ddf78c30b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.140781 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 1636b9f2dbbc46b3a8e554ed220d2a38 (DEFAULT_TABLE table=default.Table_a635daf12a4a42d5b5ba20c5eb11daa5 [id=90ae08ac2494432c84e387c80c1c2ee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.141240 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1636b9f2dbbc46b3a8e554ed220d2a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.141366 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 417b99e95ab4422d96b606fc76698324 (DEFAULT_TABLE table=default.Table_10bbf85be3e5407c809f9867c6e1bb3f [id=1e72f52f29cc4e56b566acad006de1df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.141782 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417b99e95ab4422d96b606fc76698324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.143291 6684 leader_election.cc:290] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.146433 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 1636b9f2dbbc46b3a8e554ed220d2a38 (DEFAULT_TABLE table=default.Table_a635daf12a4a42d5b5ba20c5eb11daa5 [id=90ae08ac2494432c84e387c80c1c2ee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.136385 6683 raft_consensus.cc:515] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.153662 5214 tablet_service.cc:1511] Processing CreateTablet for tablet c655651f9cb24310a5aa2e5b84c2a455 (DEFAULT_TABLE table=default.Table_22e17296fde940779eb9160306ff386d [id=db63359dda9d4b729446d6ddf78c30b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.154152 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c655651f9cb24310a5aa2e5b84c2a455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.156819 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2f814bb9ff41ebab19e8c16cf4affa" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:58.157397 5045 leader_election.cc:343] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.123519 6685 raft_consensus.cc:515] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.158473 5347 tablet_service.cc:1511] Processing CreateTablet for tablet 1636b9f2dbbc46b3a8e554ed220d2a38 (DEFAULT_TABLE table=default.Table_a635daf12a4a42d5b5ba20c5eb11daa5 [id=90ae08ac2494432c84e387c80c1c2ee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.158584 5358 tablet_service.cc:1511] Processing CreateTablet for tablet c655651f9cb24310a5aa2e5b84c2a455 (DEFAULT_TABLE table=default.Table_22e17296fde940779eb9160306ff386d [id=db63359dda9d4b729446d6ddf78c30b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.158941 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1636b9f2dbbc46b3a8e554ed220d2a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.160226 6673 leader_election.cc:290] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.161425 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 98b434884a3f4c63a9ba341e53703023 (DEFAULT_TABLE table=default.Table_0956a69da22a495691888f08a70b62dc [id=126aea719ed34308a0742ed1fe5d6970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.165802 6145 raft_consensus.cc:493] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.165944 6145 raft_consensus.cc:515] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.166754 6145 leader_election.cc:290] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.167346 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efaf62692c545dcaa5175fcd826785a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:58.168501 5319 leader_election.cc:343] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:58.168686 5319 leader_election.cc:343] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 1efaf62692c545dcaa5175fcd826785a
I20260927 13:49:58.168754 5319 leader_election.cc:304] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:58.169226 6145 raft_consensus.cc:2749] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.176018 5626 tablet_bootstrap.cc:492] T c332b6ec9ca94ce398a71e82e20897d4 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:58.176174 5626 ts_tablet_manager.cc:1403] T c332b6ec9ca94ce398a71e82e20897d4 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.095s user 0.007s sys 0.002s
I20260927 13:49:58.177178 5626 raft_consensus.cc:359] T c332b6ec9ca94ce398a71e82e20897d4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.177374 5626 raft_consensus.cc:385] T c332b6ec9ca94ce398a71e82e20897d4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.177435 5626 raft_consensus.cc:740] T c332b6ec9ca94ce398a71e82e20897d4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.177781 5626 consensus_queue.cc:260] T c332b6ec9ca94ce398a71e82e20897d4 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:58.180114 4930 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66b0c74e3ff84cc2889de29106c43350 consensus state has no leader
I20260927 13:49:58.180286 4930 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:44072 (request call id 829) took 1128 ms. Trace:
I20260927 13:49:58.180388 4930 rpcz_store.cc:276] 0927 13:49:57.051386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:57.871212 (+819826us) service_pool.cc:224] Handling call
0927 13:49:57.894637 (+ 23425us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x616000051a54. stack: 00007fa4fa3bd5c6 00007fa4fa3bd380 00007fa4f93c534d 00000000009a4cb4 00000000009a4c7d 00007fa50993765d 00007fa509937753 00007fa5064b4db1 00007fa50e2a8a7d 00007fa50e43a136 00007fa504e07696 00007fa504e073c5 00007fa50150763e 00007fa50150651e 00007fa50150c758 00007fa50150d0bf
0927 13:49:57.894927 (+ 290us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:49:57.895113 (+ 186us) catalog_manager.cc:3764] Apply alter schema
0927 13:49:57.895289 (+ 176us) catalog_manager.cc:3796] Acquired catalog manager lock
0927 13:49:57.895376 (+ 87us) catalog_manager.cc:3954] Updating metadata on disk
0927 13:49:58.179850 (+284474us) catalog_manager.cc:3985] Committing alterations to in-memory state
0927 13:49:58.180252 (+ 402us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:49:58.068259 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:58.068376 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:58.068381 (+ 5us) write_op.cc:435] Acquired schema lock
0927 13:49:58.068385 (+ 4us) tablet.cc:662] Decoding operations
0927 13:49:58.068475 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:58.068484 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:58.068488 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:49:58.068543 (+ 55us) tablet.cc:701] Row locks acquired
0927 13:49:58.068546 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:49:58.068584 (+ 38us) write_op.cc:270] Start()
0927 13:49:58.068616 (+ 32us) write_op.cc:276] Timestamp: P: 1790516998068556 usec, L: 0
0927 13:49:58.068619 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:49:58.068821 (+ 202us) log.cc:844] Serialized 405 byte log entry
0927 13:49:58.178187 (+109366us) op_driver.cc:464] REPLICATION: finished
0927 13:49:58.178511 (+ 324us) write_op.cc:301] APPLY: starting
0927 13:49:58.178528 (+ 17us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:58.178561 (+ 33us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:58.178593 (+ 32us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:58.178643 (+ 50us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:58.178672 (+ 29us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:58.178679 (+ 7us) write_op.cc:312] APPLY: finished
0927 13:49:58.178762 (+ 83us) log.cc:844] Serialized 23 byte log entry
0927 13:49:58.178825 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:58.178841 (+ 16us) write_op.cc:454] Released schema lock
0927 13:49:58.178847 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:58.178916 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:58.178920 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":53327232,"child_traces":[["op",{"apply.queue_time_us":261,"apply.run_cpu_time_us":401,"apply.run_wall_time_us":402,"num_ops":1,"prepare.queue_time_us":172368,"prepare.run_cpu_time_us":634,"prepare.run_wall_time_us":634,"replication_time_us":109529}]]}
I20260927 13:49:58.181562 6524 raft_consensus.cc:493] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.181675 6524 raft_consensus.cc:515] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.181834 4921 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 5a3f40a2da8649e0898c0e09b6e14a61
I20260927 13:49:58.182348 4921 catalog_manager.cc:6934] ReplaceTablet: tablet 5a3f40a2da8649e0898c0e09b6e14a61 deleted and replaced by tablet ead437e93bb14a73a820631b0be041aa
I20260927 13:49:58.182468 4921 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:44072 (request call id 830) took 1064 ms. Trace:
I20260927 13:49:58.182655 6524 leader_election.cc:290] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.182927 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a3f40a2da8649e0898c0e09b6e14a61 with delete_type TABLET_DATA_DELETED (replaced by tablet ead437e93bb14a73a820631b0be041aa) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.182565 4921 rpcz_store.cc:276] 0927 13:49:57.117916 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:57.900937 (+783021us) service_pool.cc:224] Handling call
0927 13:49:57.909465 (+ 8528us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x616000051a54. stack: 00007fa4fa3bd5c6 00007fa4fa3bd380 00007fa4f93c534d 00000000009a4cb4 00000000009a4c7d 00007fa50993765d 00007fa509937753 00007fa5064b4db1 00007fa50e2a8a7d 00007fa50e444d2b 00007fa504e10657 00007fa504e10385 00007fa50150763e 00007fa50150651e 00007fa50150c758 00007fa50150d0bf
0927 13:49:58.182437 (+272972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:49:58.068945 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:58.069038 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:58.069044 (+ 6us) write_op.cc:435] Acquired schema lock
0927 13:49:58.069047 (+ 3us) tablet.cc:662] Decoding operations
0927 13:49:58.069150 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:58.071814 (+ 2664us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:58.071820 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:49:58.071911 (+ 91us) tablet.cc:701] Row locks acquired
0927 13:49:58.071914 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:49:58.071951 (+ 37us) write_op.cc:270] Start()
0927 13:49:58.071980 (+ 29us) write_op.cc:276] Timestamp: P: 1790516998071923 usec, L: 0
0927 13:49:58.071984 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:49:58.072137 (+ 153us) log.cc:844] Serialized 625 byte log entry
0927 13:49:58.178270 (+106133us) op_driver.cc:464] REPLICATION: finished
0927 13:49:58.178984 (+ 714us) write_op.cc:301] APPLY: starting
0927 13:49:58.178995 (+ 11us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:58.179030 (+ 35us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:58.179052 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:58.179145 (+ 93us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:58.179189 (+ 44us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:58.179216 (+ 27us) write_op.cc:312] APPLY: finished
0927 13:49:58.179267 (+ 51us) log.cc:844] Serialized 29 byte log entry
0927 13:49:58.179305 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:58.179318 (+ 13us) write_op.cc:454] Released schema lock
0927 13:49:58.179323 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:58.179383 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:58.179387 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":18767744,"child_traces":[["op",{"apply.queue_time_us":684,"apply.run_cpu_time_us":392,"apply.run_wall_time_us":391,"num_ops":2,"prepare.queue_time_us":158433,"prepare.run_cpu_time_us":617,"prepare.run_wall_time_us":3244,"replication_time_us":106267}]]}
I20260927 13:49:58.183578 5619 tablet_bootstrap.cc:492] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.183697 5619 ts_tablet_manager.cc:1403] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.002s
I20260927 13:49:58.183681 5626 ts_tablet_manager.cc:1434] T c332b6ec9ca94ce398a71e82e20897d4 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260927 13:49:58.184072 6644 catalog_manager.cc:1623] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: acquiring CA information for follower catalog manager: success
W20260927 13:49:58.186787 5184 leader_election.cc:343] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3b855dedb8d04145b0c4469b9ba79453
I20260927 13:49:58.187804 5626 tablet_bootstrap.cc:492] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:58.198151 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a3f40a2da8649e0898c0e09b6e14a61 with delete_type TABLET_DATA_DELETED (replaced by tablet ead437e93bb14a73a820631b0be041aa) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.199260 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 417b99e95ab4422d96b606fc76698324 (DEFAULT_TABLE table=default.Table_10bbf85be3e5407c809f9867c6e1bb3f [id=1e72f52f29cc4e56b566acad006de1df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.199559 5070 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a3f40a2da8649e0898c0e09b6e14a61 with delete_type TABLET_DATA_DELETED (replaced by tablet ead437e93bb14a73a820631b0be041aa) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:58.200258 5185 leader_election.cc:343] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 3b855dedb8d04145b0c4469b9ba79453
I20260927 13:49:58.200397 5185 leader_election.cc:304] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.200979 5626 tablet_bootstrap.cc:654] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.201076 6524 raft_consensus.cc:2749] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.202090 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 417b99e95ab4422d96b606fc76698324 (DEFAULT_TABLE table=default.Table_10bbf85be3e5407c809f9867c6e1bb3f [id=1e72f52f29cc4e56b566acad006de1df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:58.202747 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b434884a3f4c63a9ba341e53703023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.203195 6493 ts_tablet_manager.cc:1929] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.203310 6493 log.cc:1199] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/2657276c4b2f43c1ad64a8c1fd58ada9
I20260927 13:49:58.203599 6493 ts_tablet_manager.cc:1950] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:58.204030 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b2b6f2ce1145a18c199bb37cc7e5b2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:58.204658 5045 leader_election.cc:343] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.206739 5623 ts_tablet_manager.cc:1929] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:49:58.208256 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2e30216e0487496f8efdb8a3b06deb5a consensus state has no leader
I20260927 13:49:58.208549 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet d51c3fa3624340059f6508ced1a2220e
I20260927 13:49:58.209971 5070 tablet_service.cc:1558] Processing DeleteTablet for tablet d51c3fa3624340059f6508ced1a2220e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.210906 6683 leader_election.cc:290] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.210960 5623 log.cc:1199] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/321b26c89f1a4c8d88f401c8ece448b0
I20260927 13:49:58.211283 5623 ts_tablet_manager.cc:1950] T 321b26c89f1a4c8d88f401c8ece448b0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.212029 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 603) took 1311 ms. Trace:
I20260927 13:49:58.212105 5623 rpcz_store.cc:276] 0927 13:49:56.900981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.901055 (+ 74us) service_pool.cc:224] Handling call
0927 13:49:58.118717 (+1217662us) ts_tablet_manager.cc:1151] Deleting tablet 321b26c89f1a4c8d88f401c8ece448b0
0927 13:49:58.118731 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.171764 (+ 53033us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.203966 (+ 32202us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.212008 (+ 8042us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1217403}
I20260927 13:49:58.212579 4924 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet d3b38f40431f47a0acf1e11092d7717b
I20260927 13:49:58.212550 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 321b26c89f1a4c8d88f401c8ece448b0 (table default.Table_dbe657f659e24156b29a259c4b995402 [id=c1b3466f7acf411dbb7b0a2d63403edf]) successfully deleted
I20260927 13:49:58.213762 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da75a470ec0c4ec9afa7c18a51cd7276" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.214203 5070 tablet_service.cc:1558] Processing DeleteTablet for tablet d3b38f40431f47a0acf1e11092d7717b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:58.214373 5045 leader_election.cc:343] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.214824 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet d3b38f40431f47a0acf1e11092d7717b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.216634 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b4f7512333e245c4b35018961a510efd
I20260927 13:49:58.217700 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 605) took 1316 ms. Trace:
I20260927 13:49:58.218153 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7512333e245c4b35018961a510efd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.218887 5070 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7512333e245c4b35018961a510efd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.218888 5623 rpcz_store.cc:276] 0927 13:49:56.901263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.901316 (+ 53us) service_pool.cc:224] Handling call
0927 13:49:58.217558 (+1316242us) ts_tablet_manager.cc:1151] Deleting tablet d9198ace6a264737a990d6fb573faf2d
0927 13:49:58.217569 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.217678 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1316051}
I20260927 13:49:58.219341 5623 tablet_replica.cc:333] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
W20260927 13:49:58.219683 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet d9198ace6a264737a990d6fb573faf2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9198ace6a264737a990d6fb573faf2d already in progress: creating tablet
I20260927 13:49:58.220584 5623 raft_consensus.cc:2243] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.221028 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7512333e245c4b35018961a510efd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.222020 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 4211f338c6a648c5b3e36c6df0b3c510
I20260927 13:49:58.222064 5623 raft_consensus.cc:2272] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.222626 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet d51c3fa3624340059f6508ced1a2220e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.222528 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_aa475363b82246bcbc00b2b60ce222ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.223129 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa475363b82246bcbc00b2b60ce222ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.223235 5619 raft_consensus.cc:359] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.223420 5619 raft_consensus.cc:385] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.223493 5619 raft_consensus.cc:740] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.223636 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_daa2858f5f994d1ba5432fa5506b2a44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:58.223721 5619 consensus_queue.cc:260] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.224210 5619 ts_tablet_manager.cc:1434] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.040s user 0.001s sys 0.000s
I20260927 13:49:58.224155 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c4f4659ddd2a47c48ae7d545ac78f2cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.224637 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4f4659ddd2a47c48ae7d545ac78f2cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.225627 4922 catalog_manager.cc:6934] ReplaceTablet: tablet 4211f338c6a648c5b3e36c6df0b3c510 deleted and replaced by tablet 85debab98b0f42a5b50f1b0d132147d3
I20260927 13:49:58.225945 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_511f1dce0d9445d8af1a859b3b04c3d5" } new_table_name: "default.Table_7b9eaaab4c6149e09eb18425cb5c38a3" modify_external_catalogs: true
I20260927 13:49:58.226094 5623 ts_tablet_manager.cc:1916] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.227677 6685 leader_election.cc:290] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.228272 4924 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_4cd659e994114aa1b042d1f2391b9760" } new_table_name: "default.Table_adbaa26694924194a1f32f00d83a8f3d" modify_external_catalogs: true
I20260927 13:49:58.228976 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet d51c3fa3624340059f6508ced1a2220e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.229293 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c655651f9cb24310a5aa2e5b84c2a455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.230197 5626 tablet_bootstrap.cc:492] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:58.230332 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417b99e95ab4422d96b606fc76698324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.230325 5626 ts_tablet_manager.cc:1403] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.001s
I20260927 13:49:58.230343 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b082227264e442a8b1db7a68fb0c3eb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.231065 5626 raft_consensus.cc:359] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.231200 5626 raft_consensus.cc:385] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.231241 5626 raft_consensus.cc:740] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.231585 5626 consensus_queue.cc:260] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.232069 5626 ts_tablet_manager.cc:1434] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260927 13:49:58.232226 5045 leader_election.cc:343] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.232206 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a7a5af7cfafc47a49d35f8a72e1d1ab5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:58.232426 5619 tablet_bootstrap.cc:492] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:58.232589 5626 tablet_bootstrap.cc:492] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:49:58.232692 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7a5af7cfafc47a49d35f8a72e1d1ab5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:58.234624 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 5a3f40a2da8649e0898c0e09b6e14a61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a3f40a2da8649e0898c0e09b6e14a61 already in progress: creating tablet
W20260927 13:49:58.234885 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet d3b38f40431f47a0acf1e11092d7717b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3b38f40431f47a0acf1e11092d7717b already in progress: creating tablet
W20260927 13:49:58.235109 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b4f7512333e245c4b35018961a510efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4f7512333e245c4b35018961a510efd already in progress: creating tablet
W20260927 13:49:58.235325 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet d51c3fa3624340059f6508ced1a2220e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d51c3fa3624340059f6508ced1a2220e already in progress: creating tablet
I20260927 13:49:58.236403 5070 tablet_service.cc:1558] Processing DeleteTablet for tablet 4211f338c6a648c5b3e36c6df0b3c510 with delete_type TABLET_DATA_DELETED (replaced by tablet 85debab98b0f42a5b50f1b0d132147d3) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.236514 5626 tablet_bootstrap.cc:654] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.239315 5619 tablet_bootstrap.cc:654] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.239228 5628 raft_consensus.cc:359] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.239411 5628 raft_consensus.cc:385] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.239460 5628 raft_consensus.cc:740] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.240082 5628 consensus_queue.cc:260] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.240608 5628 ts_tablet_manager.cc:1434] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.117s user 0.001s sys 0.001s
W20260927 13:49:58.224167 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daa2858f5f994d1ba5432fa5506b2a44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.248925 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 4211f338c6a648c5b3e36c6df0b3c510 with delete_type TABLET_DATA_DELETED (replaced by tablet 85debab98b0f42a5b50f1b0d132147d3) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.251587 5623 ts_tablet_manager.cc:1929] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260927 13:49:58.257920 5044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 121960us
I20260927 13:49:58.261446 5623 log.cc:1199] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/a443f65eba384b998fdc57ec57e37d87
I20260927 13:49:58.263971 5623 ts_tablet_manager.cc:1950] T a443f65eba384b998fdc57ec57e37d87 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.266077 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 611) took 1040 ms. Trace:
I20260927 13:49:58.267028 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1636b9f2dbbc46b3a8e554ed220d2a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.267735 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417b99e95ab4422d96b606fc76698324. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:58.268689 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 4211f338c6a648c5b3e36c6df0b3c510 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4211f338c6a648c5b3e36c6df0b3c510 already in progress: creating tablet
I20260927 13:49:58.269138 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c655651f9cb24310a5aa2e5b84c2a455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:58.269004 4921 catalog_manager.cc:5838] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:58.270452 5623 rpcz_store.cc:276] 0927 13:49:57.225354 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:57.225421 (+ 67us) service_pool.cc:224] Handling call
0927 13:49:58.219273 (+993852us) ts_tablet_manager.cc:1151] Deleting tablet a443f65eba384b998fdc57ec57e37d87
0927 13:49:58.219284 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.248232 (+ 28948us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.251534 (+ 3302us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.266058 (+ 14524us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":993575}
I20260927 13:49:58.271016 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 612) took 1028 ms. Trace:
I20260927 13:49:58.271103 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet a443f65eba384b998fdc57ec57e37d87 (table default.Table_43b89b55155b4b51ab4b271a93f30d59 [id=f7a31bf57f1245cab85dd2c38d85c79f]) successfully deleted
I20260927 13:49:58.271099 5623 rpcz_store.cc:276] 0927 13:49:57.242903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:57.242956 (+ 53us) service_pool.cc:224] Handling call
0927 13:49:58.270861 (+1027905us) ts_tablet_manager.cc:1151] Deleting tablet 03a1f13b31934baa8ce18fc499e94806
0927 13:49:58.270872 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.270998 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1027669}
I20260927 13:49:58.271382 5623 tablet_replica.cc:333] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.271579 5623 raft_consensus.cc:2243] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:58.271665 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 03a1f13b31934baa8ce18fc499e94806 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03a1f13b31934baa8ce18fc499e94806 already in progress: creating tablet
I20260927 13:49:58.271764 5623 raft_consensus.cc:2272] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.272387 5623 ts_tablet_manager.cc:1916] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.269706 4921 catalog_manager.cc:5838] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:58.274860 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet c332b6ec9ca94ce398a71e82e20897d4 (table default.Table_ba46c52966764f5989cc55eed4059edf [id=db33cf0d6695498f8e5100abb2103d08]). Expected version 2 got 0
I20260927 13:49:58.275707 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 4211f338c6a648c5b3e36c6df0b3c510 with delete_type TABLET_DATA_DELETED (replaced by tablet 85debab98b0f42a5b50f1b0d132147d3) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.276432 5626 tablet_bootstrap.cc:492] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:58.277287 5626 ts_tablet_manager.cc:1403] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.003s
I20260927 13:49:58.277678 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet d3b38f40431f47a0acf1e11092d7717b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.278163 5626 raft_consensus.cc:359] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.278348 5626 raft_consensus.cc:385] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.278410 5626 raft_consensus.cc:740] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.278746 5626 consensus_queue.cc:260] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.279346 5626 ts_tablet_manager.cc:1434] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:58.279625 5626 tablet_bootstrap.cc:492] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:58.281993 5626 tablet_bootstrap.cc:654] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.285429 6644 catalog_manager.cc:1651] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260927 13:49:58.289806 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 604) took 1654 ms. Trace:
I20260927 13:49:58.290218 5628 tablet_bootstrap.cc:492] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:58.289904 6493 rpcz_store.cc:276] 0927 13:49:56.635382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.635665 (+ 283us) service_pool.cc:224] Handling call
0927 13:49:57.855767 (+1220102us) ts_tablet_manager.cc:1151] Deleting tablet 2657276c4b2f43c1ad64a8c1fd58ada9
0927 13:49:57.855775 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.158493 (+302718us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.203143 (+ 44650us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.289788 (+ 86645us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1219896}
I20260927 13:49:58.294613 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 606) took 1650 ms. Trace:
I20260927 13:49:58.294744 6493 rpcz_store.cc:276] 0927 13:49:56.644229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.644285 (+ 56us) service_pool.cc:224] Handling call
0927 13:49:58.294449 (+1650164us) ts_tablet_manager.cc:1151] Deleting tablet bb980bca9f16480ba050971b58aa46f3
0927 13:49:58.294464 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.294589 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1649985}
I20260927 13:49:58.295091 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 607) took 1622 ms. Trace:
I20260927 13:49:58.295161 6493 rpcz_store.cc:276] 0927 13:49:56.672356 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.672416 (+ 60us) service_pool.cc:224] Handling call
0927 13:49:58.294991 (+1622575us) ts_tablet_manager.cc:1151] Deleting tablet 7e3b98290dc74d88856e13f003a1e4c7
0927 13:49:58.295003 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.295077 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1622353}
I20260927 13:49:58.295480 6493 tablet_replica.cc:333] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:58.295696 6493 raft_consensus.cc:2243] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.295861 6493 raft_consensus.cc:2272] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.300132 6493 ts_tablet_manager.cc:1916] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.309327 5619 tablet_bootstrap.cc:492] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.309499 5619 ts_tablet_manager.cc:1403] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.079s user 0.005s sys 0.012s
I20260927 13:49:58.310242 5619 raft_consensus.cc:359] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.310457 5619 raft_consensus.cc:385] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.310496 6695 raft_consensus.cc:493] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.310559 5619 raft_consensus.cc:740] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.310792 5619 consensus_queue.cc:260] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.311342 5619 ts_tablet_manager.cc:1434] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:58.311420 6608 raft_consensus.cc:493] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.311570 6608 raft_consensus.cc:515] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.311676 5619 tablet_bootstrap.cc:492] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:58.312176 6608 leader_election.cc:290] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.312610 5623 ts_tablet_manager.cc:1929] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:58.312793 5623 log.cc:1199] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/4d35148d80b44fca9b39a4625d3e61c1
I20260927 13:49:58.312749 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04b3a942c404f3894fbbd6ece24a727" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.313169 5249 raft_consensus.cc:2468] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:58.313174 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04b3a942c404f3894fbbd6ece24a727" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:58.313274 5623 ts_tablet_manager.cc:1950] T 4d35148d80b44fca9b39a4625d3e61c1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.313344 5105 raft_consensus.cc:2468] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:58.313803 5319 leader_election.cc:304] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:58.314044 6145 raft_consensus.cc:2804] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:58.314185 6145 raft_consensus.cc:493] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:58.314303 6145 raft_consensus.cc:3060] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.310655 6695 raft_consensus.cc:515] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.316921 6145 raft_consensus.cc:515] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.317639 6145 leader_election.cc:290] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.318388 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04b3a942c404f3894fbbd6ece24a727" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:58.318549 5249 raft_consensus.cc:3060] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.318387 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04b3a942c404f3894fbbd6ece24a727" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:58.320799 5105 raft_consensus.cc:3060] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.321614 5249 raft_consensus.cc:2468] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:58.321947 5623 tablet_replica.cc:333] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.322129 5623 raft_consensus.cc:2243] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.322276 5623 raft_consensus.cc:2272] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.322742 5623 ts_tablet_manager.cc:1916] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.322712 5319 leader_election.cc:304] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:58.324117 6608 raft_consensus.cc:2804] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:58.329770 5628 tablet_bootstrap.cc:654] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.330195 6695 leader_election.cc:290] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.330812 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a813939920244be781d546311fe8a33e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:58.331352 5045 leader_election.cc:343] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.337898 6695 raft_consensus.cc:493] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.338085 6695 raft_consensus.cc:515] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.338724 6695 leader_election.cc:290] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.339771 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a07adcd33414d18ae9720e7a307548a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:58.341900 5045 leader_election.cc:343] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.344404 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 2657276c4b2f43c1ad64a8c1fd58ada9 (table default.Table_b12c6e4211af4ab7b866815072339fe6 [id=3e30b8610f4c4406a115aaeee8abebdf]) successfully deleted
I20260927 13:49:58.346753 5623 ts_tablet_manager.cc:1929] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.348814 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]). Expected version 1 got 0
I20260927 13:49:58.349313 4921 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:49:58.350296 5105 raft_consensus.cc:2468] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:49:58.350944 4917 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 45096.8us
W20260927 13:49:58.351423 4916 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 45580.9us
W20260927 13:49:58.351744 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet bb980bca9f16480ba050971b58aa46f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb980bca9f16480ba050971b58aa46f3 already in progress: creating tablet
I20260927 13:49:58.351763 6608 raft_consensus.cc:697] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
W20260927 13:49:58.352068 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7e3b98290dc74d88856e13f003a1e4c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e3b98290dc74d88856e13f003a1e4c7 already in progress: creating tablet
I20260927 13:49:58.352114 6608 consensus_queue.cc:237] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.352789 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 4d35148d80b44fca9b39a4625d3e61c1 (table default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]) successfully deleted
W20260927 13:49:58.353123 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2e768c83fae54619ac849dfedd5ec654 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e768c83fae54619ac849dfedd5ec654 already in progress: creating tablet
W20260927 13:49:58.353467 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2d64750141d74d988612304ce050688d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d64750141d74d988612304ce050688d already in progress: creating tablet
W20260927 13:49:58.353785 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet d9cb99ad45d1445cb2e2854319a3d73d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9cb99ad45d1445cb2e2854319a3d73d already in progress: creating tablet
I20260927 13:49:58.354069 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2159a2c74b9c4769be385712b34f41c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.354743 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2159a2c74b9c4769be385712b34f41c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.356421 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_544497088a2047e8a6b190c4e23e3e1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.356997 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_544497088a2047e8a6b190c4e23e3e1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.362435 6493 ts_tablet_manager.cc:1929] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.362560 6493 log.cc:1199] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/64c7919f5076406186000cd4077aadaf
I20260927 13:49:58.362833 6493 ts_tablet_manager.cc:1950] T 64c7919f5076406186000cd4077aadaf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:58.363121 5628 tablet_bootstrap.cc:492] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:58.363117 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 602) took 1743 ms. Trace:
I20260927 13:49:58.363276 5628 ts_tablet_manager.cc:1403] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.000s
I20260927 13:49:58.363240 6493 rpcz_store.cc:276] 0927 13:49:56.619580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.708374 (+ 88794us) service_pool.cc:224] Handling call
0927 13:49:58.295440 (+1587066us) ts_tablet_manager.cc:1151] Deleting tablet 64c7919f5076406186000cd4077aadaf
0927 13:49:58.295449 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.319346 (+ 23897us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.362375 (+ 43029us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.363102 (+ 727us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1495158}
I20260927 13:49:58.363760 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 64c7919f5076406186000cd4077aadaf (table default.Table_a84034c9d8ab4ec5ada3c6fbb73934e1 [id=5dfc4daab06e4be5846fc9be88d222f4]) successfully deleted
I20260927 13:49:58.364033 5628 raft_consensus.cc:359] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.364193 5628 raft_consensus.cc:385] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.364248 5628 raft_consensus.cc:740] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.364352 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 609) took 1514 ms. Trace:
I20260927 13:49:58.364485 5628 consensus_queue.cc:260] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.364502 6493 rpcz_store.cc:276] 0927 13:49:56.849952 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.850011 (+ 59us) service_pool.cc:224] Handling call
0927 13:49:58.364072 (+1514061us) ts_tablet_manager.cc:1151] Deleting tablet d9198ace6a264737a990d6fb573faf2d
0927 13:49:58.364082 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.364292 (+ 210us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1513825}
I20260927 13:49:58.365105 5628 ts_tablet_manager.cc:1434] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260927 13:49:58.365329 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet d9198ace6a264737a990d6fb573faf2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9198ace6a264737a990d6fb573faf2d already in progress: creating tablet
I20260927 13:49:58.365388 5628 tablet_bootstrap.cc:492] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:58.365657 6493 tablet_replica.cc:333] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:58.365852 6493 raft_consensus.cc:2243] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.365979 5623 log.cc:1199] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/d1f9ae430c414cdf9370388d51dd7c63
I20260927 13:49:58.366169 6493 raft_consensus.cc:2272] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.366369 5623 ts_tablet_manager.cc:1950] T d1f9ae430c414cdf9370388d51dd7c63 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.366811 6493 ts_tablet_manager.cc:1916] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.367100 5628 tablet_bootstrap.cc:654] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.367410 5623 tablet_replica.cc:333] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.367576 5623 raft_consensus.cc:2243] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:58.367782 5623 pending_rounds.cc:70] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:58.367826 5623 pending_rounds.cc:77] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957622855176192 op_type: NO_OP noop_request { }
I20260927 13:49:58.367918 5623 raft_consensus.cc:2889] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:58.368003 5623 raft_consensus.cc:2272] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.368436 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet d1f9ae430c414cdf9370388d51dd7c63 (table default.Table_e680c915b7b546a7927c1795fa7f3ef4 [id=793fd3b0ccee43a88ba3992caa0408ab]) successfully deleted
W20260927 13:49:58.368777 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 059afd48ac4a41569ed1d3556b7974f0 because the tablet was not found. No further retry: Not found: Tablet not found: 059afd48ac4a41569ed1d3556b7974f0
I20260927 13:49:58.373353 5249 raft_consensus.cc:3060] T c332b6ec9ca94ce398a71e82e20897d4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.376928 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2f814bb9ff41ebab19e8c16cf4affa" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.377198 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da75a470ec0c4ec9afa7c18a51cd7276" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.377339 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b2b6f2ce1145a18c199bb37cc7e5b2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.377907 6608 consensus_queue.cc:1048] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:49:58.378340 5044 leader_election.cc:343] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.378489 5044 leader_election.cc:304] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:58.379555 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f551c48587df4681961234121507af1a has no consensus state
W20260927 13:49:58.379931 4924 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69606adaa96d431791ed5c8455a7c548 consensus state has no leader
I20260927 13:49:58.379917 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b082227264e442a8b1db7a68fb0c3eb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.380048 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_9f53709861824b0591e1b8ce63a64393"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:58.380326 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5972ad040bd64ddda4bf22eac0f03998"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.380633 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f53709861824b0591e1b8ce63a64393 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:58.380813 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5972ad040bd64ddda4bf22eac0f03998 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.384694 6695 raft_consensus.cc:2749] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.364017 5626 tablet_bootstrap.cc:492] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:58.365046 6524 raft_consensus.cc:493] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.386085 6524 raft_consensus.cc:515] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.386780 6524 leader_election.cc:290] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.387179 5626 ts_tablet_manager.cc:1403] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.108s user 0.017s sys 0.004s
I20260927 13:49:58.387219 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575501a5d1f4b0d80f153cf5bde5fa9" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:58.387421 5105 raft_consensus.cc:2468] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:58.388017 5626 raft_consensus.cc:359] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.388159 5626 raft_consensus.cc:385] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.388211 5626 raft_consensus.cc:740] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.388289 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575501a5d1f4b0d80f153cf5bde5fa9" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.388471 5384 raft_consensus.cc:2468] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:58.389213 5184 leader_election.cc:304] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:58.389786 6524 raft_consensus.cc:2804] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:58.389858 6524 raft_consensus.cc:493] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:58.389911 6524 raft_consensus.cc:3060] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.390823 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ac14a94068db47ec93c7f92b477d620f" } new_table_name: "default.Table_9f46cb29a3744a8ca0ed3c95c5aaed3a" modify_external_catalogs: true
W20260927 13:49:58.392023 5044 leader_election.cc:343] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.392120 5044 leader_election.cc:304] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.392309 6695 raft_consensus.cc:2749] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:58.392658 5044 leader_election.cc:343] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.392679 6524 raft_consensus.cc:515] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.392761 5044 leader_election.cc:304] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.392977 5626 consensus_queue.cc:260] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.393821 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575501a5d1f4b0d80f153cf5bde5fa9" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:58.393903 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575501a5d1f4b0d80f153cf5bde5fa9" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:58.393987 5384 raft_consensus.cc:3060] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.394048 5105 raft_consensus.cc:3060] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.394667 6524 leader_election.cc:290] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.394799 6695 raft_consensus.cc:2749] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:58.395155 5044 leader_election.cc:343] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.395242 5044 leader_election.cc:304] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.395844 6695 raft_consensus.cc:2749] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:58.396106 5044 leader_election.cc:343] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.396713 5384 raft_consensus.cc:2468] T 1575501a5d1f4b0d80f153cf5bde5fa9 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:58.397650 5185 leader_election.cc:304] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:58.398295 6524 raft_consensus.cc:2804] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:58.398547 6524 raft_consensus.cc:697] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:58.398831 6524 consensus_queue.cc:237] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.404294 5623 ts_tablet_manager.cc:1916] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.396237 5044 leader_election.cc:304] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.406301 5626 ts_tablet_manager.cc:1434] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260927 13:49:58.406368 6695 raft_consensus.cc:2749] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.406586 5626 tablet_bootstrap.cc:492] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:58.407495 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a07adcd33414d18ae9720e7a307548a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.407722 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a813939920244be781d546311fe8a33e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.413829 5626 tablet_bootstrap.cc:654] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.414710 5623 ts_tablet_manager.cc:1929] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:58.414883 5623 log.cc:1199] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/9f080b4ca9894eae8305d1548010a6cb
I20260927 13:49:58.415349 5623 ts_tablet_manager.cc:1950] T 9f080b4ca9894eae8305d1548010a6cb P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.418347 6493 ts_tablet_manager.cc:1929] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.418632 6493 log.cc:1199] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/bb25bb5ee153494d803130f1ad4f7c2e
I20260927 13:49:58.418833 5105 raft_consensus.cc:2468] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:58.419713 6493 ts_tablet_manager.cc:1950] T bb25bb5ee153494d803130f1ad4f7c2e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:58.420439 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 9f080b4ca9894eae8305d1548010a6cb (table default.Table_98a47a6f58fe457395c7f1accbac44eb [id=42bfb85e0c8f425ea04c34b94ec24c58]) successfully deleted
I20260927 13:49:58.420926 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 612) took 1532 ms. Trace:
I20260927 13:49:58.421051 6493 rpcz_store.cc:276] 0927 13:49:56.888728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:56.888784 (+ 56us) service_pool.cc:224] Handling call
0927 13:49:58.365616 (+1476832us) ts_tablet_manager.cc:1151] Deleting tablet bb25bb5ee153494d803130f1ad4f7c2e
0927 13:49:58.365625 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.404821 (+ 39196us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.418296 (+ 13475us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.420911 (+ 2615us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1476543}
I20260927 13:49:58.421610 6608 consensus_queue.cc:1048] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:58.421754 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet bb25bb5ee153494d803130f1ad4f7c2e (table default.Table_cb8208423d374903b009adbf0c2cbe9d [id=7aabe4ef709d4722a07adc668a50b9de]) successfully deleted
I20260927 13:49:58.422086 6493 tablet_replica.cc:333] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:58.422338 6493 raft_consensus.cc:2243] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.422566 6493 raft_consensus.cc:2272] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.423131 6493 ts_tablet_manager.cc:1916] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:58.422608 5045 consensus_peers.cc:597] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 -> Peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Couldn't send request to peer bb28c54312c94d7dafb1c2abf7870735. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d35148d80b44fca9b39a4625d3e61c1. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:58.421260 5623 tablet_replica.cc:333] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
W20260927 13:49:58.437012 5044 consensus_peers.cc:597] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d35148d80b44fca9b39a4625d3e61c1. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:49:58.437306 5044 leader_election.cc:343] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.437763 5044 leader_election.cc:304] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.438486 6695 raft_consensus.cc:2749] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:49:58.439059 5044 leader_election.cc:343] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.441211 5623 raft_consensus.cc:2243] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.441447 5623 raft_consensus.cc:2272] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.442294 5623 ts_tablet_manager.cc:1916] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.452458 5626 tablet_bootstrap.cc:492] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:58.452605 5626 ts_tablet_manager.cc:1403] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.006s
I20260927 13:49:58.453277 5626 raft_consensus.cc:359] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.453522 5626 raft_consensus.cc:385] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.453590 5626 raft_consensus.cc:740] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.455328 5623 ts_tablet_manager.cc:1929] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.455490 5623 log.cc:1199] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/56b9612ffea543b9b0779c46533d91ab
I20260927 13:49:58.457505 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3057055163b742648fbe697cf93a2f0b" } modify_external_catalogs: true
I20260927 13:49:58.457702 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3057055163b742648fbe697cf93a2f0b" } modify_external_catalogs: true
I20260927 13:49:58.456199 5623 ts_tablet_manager.cc:1950] T 56b9612ffea543b9b0779c46533d91ab P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.459476 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 56b9612ffea543b9b0779c46533d91ab (table default.Table_8f56db43a65c4bd5a295fc1966c944a2 [id=a8089fe90d01478dbf155541ed227099]) successfully deleted
I20260927 13:49:58.459822 5623 tablet_replica.cc:333] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.460048 5623 raft_consensus.cc:2243] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.460256 5623 raft_consensus.cc:2272] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.461331 4927 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]). Expected version 1 got 0
I20260927 13:49:58.463706 5623 ts_tablet_manager.cc:1916] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.465349 4930 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]). Expected version 1 got 0
I20260927 13:49:58.466014 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 931a48792f4c4525bd563a4dd1062e35
I20260927 13:49:58.468046 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 931a48792f4c4525bd563a4dd1062e35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.468350 5606 tablet_replica.cc:333] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:58.468607 5606 raft_consensus.cc:2243] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:58.469020 5606 raft_consensus.cc:2272] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.470185 5623 ts_tablet_manager.cc:1929] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.470424 5623 log.cc:1199] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/3b855dedb8d04145b0c4469b9ba79453
I20260927 13:49:58.470817 5623 ts_tablet_manager.cc:1950] T 3b855dedb8d04145b0c4469b9ba79453 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.471334 5606 ts_tablet_manager.cc:1916] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.471951 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 3b855dedb8d04145b0c4469b9ba79453 (table default.Table_fec7020fbf30493cbe6a218ae1cc9dab [id=05951559c98143f5bf067109c7ce2e28]) successfully deleted
I20260927 13:49:58.472307 5623 tablet_replica.cc:333] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.472525 5623 raft_consensus.cc:2243] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.472713 5623 raft_consensus.cc:2272] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.473229 5623 ts_tablet_manager.cc:1916] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.440879 6493 ts_tablet_manager.cc:1929] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:58.476233 6493 log.cc:1199] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a443f65eba384b998fdc57ec57e37d87
I20260927 13:49:58.476198 5044 leader_election.cc:304] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.476230 4930 master_service.cc:960] ReplaceTablet: received request to replace tablet db75594e5ee0427a80016bb8a19b6703 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:58.476277 5626 consensus_queue.cc:260] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.476464 6695 raft_consensus.cc:2749] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.476616 6493 ts_tablet_manager.cc:1950] T a443f65eba384b998fdc57ec57e37d87 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:58.476945 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 616) took 1252 ms. Trace:
I20260927 13:49:58.477025 6493 rpcz_store.cc:276] 0927 13:49:57.224546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:57.224855 (+ 309us) service_pool.cc:224] Handling call
0927 13:49:58.422043 (+1197188us) ts_tablet_manager.cc:1151] Deleting tablet a443f65eba384b998fdc57ec57e37d87
0927 13:49:58.422054 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.437683 (+ 15629us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.440837 (+ 3154us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.476928 (+ 36091us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1196908}
I20260927 13:49:58.477348 6493 tablet_replica.cc:333] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:58.477483 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a443f65eba384b998fdc57ec57e37d87 (table default.Table_43b89b55155b4b51ab4b271a93f30d59 [id=f7a31bf57f1245cab85dd2c38d85c79f]) successfully deleted
I20260927 13:49:58.477536 6493 raft_consensus.cc:2243] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.477682 6493 raft_consensus.cc:2272] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.442960 5628 tablet_bootstrap.cc:492] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:58.477756 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet bb505472de024c2e9b3861f3225b7e40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.467507 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 931a48792f4c4525bd563a4dd1062e35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.477928 5628 ts_tablet_manager.cc:1403] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.113s user 0.005s sys 0.001s
I20260927 13:49:58.478745 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce893441d5e4d9f89743e75eb762276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.478987 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f080b4ca9894eae8305d1548010a6cb with delete_type TABLET_DATA_DELETED (replaced by tablet da5d9bda857f467da6930a6c64266f3a) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.482515 5626 ts_tablet_manager.cc:1434] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20260927 13:49:58.482828 5626 tablet_bootstrap.cc:492] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:58.483144 5606 ts_tablet_manager.cc:1929] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:58.483263 5606 log.cc:1199] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/931a48792f4c4525bd563a4dd1062e35
I20260927 13:49:58.483242 5623 ts_tablet_manager.cc:1929] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.483371 6709 tablet.cc:1751] T c2fc2734e88e431facdf72e9ef136106 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:49:58.483649 5606 ts_tablet_manager.cc:1950] T 931a48792f4c4525bd563a4dd1062e35 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:58.483520 5623 log.cc:1199] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/98ffe83306e74749b5b3f68e6c2c708c
I20260927 13:49:58.483999 5623 ts_tablet_manager.cc:1950] T 98ffe83306e74749b5b3f68e6c2c708c P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.484680 5626 tablet_bootstrap.cc:654] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.485138 5623 tablet_replica.cc:333] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.485039 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_48319d13c4f549a7997788187d90c91b" } new_table_name: "default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f" modify_external_catalogs: true
I20260927 13:49:58.485111 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 98ffe83306e74749b5b3f68e6c2c708c (table default.Table_0956a69da22a495691888f08a70b62dc [id=126aea719ed34308a0742ed1fe5d6970]) successfully deleted
I20260927 13:49:58.485417 5623 raft_consensus.cc:2243] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:58.485692 5623 pending_rounds.cc:70] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:58.485788 5623 pending_rounds.cc:77] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957623339937792 op_type: NO_OP noop_request { }
I20260927 13:49:58.485939 5623 raft_consensus.cc:2889] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:58.486421 5623 raft_consensus.cc:2272] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.487258 5623 ts_tablet_manager.cc:1916] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.487552 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_c759fc3bc488489a94e8a6193c491682"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.488138 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c759fc3bc488489a94e8a6193c491682 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.489336 6493 ts_tablet_manager.cc:1916] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.490649 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 931a48792f4c4525bd563a4dd1062e35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.491626 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 931a48792f4c4525bd563a4dd1062e35 (table default.Table_3b7666d87acf47bda3e3e2545c8cfb25 [id=bed97aef149a417bb3807414f58ba52a]) successfully deleted
I20260927 13:49:58.493539 5628 raft_consensus.cc:359] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.493718 5628 raft_consensus.cc:385] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.493778 5628 raft_consensus.cc:740] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.493983 5628 consensus_queue.cc:260] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.494581 5628 ts_tablet_manager.cc:1434] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260927 13:49:58.497509 5626 tablet_bootstrap.cc:492] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:58.497648 5626 ts_tablet_manager.cc:1403] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
I20260927 13:49:58.498402 5626 raft_consensus.cc:359] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.498571 5626 raft_consensus.cc:385] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.501099 5623 ts_tablet_manager.cc:1929] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:58.501348 5623 log.cc:1199] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/ec40378eb80c412198d5b66c02e975ef
I20260927 13:49:58.501524 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_f467eb34e5ed44eaa26bde85eded8dac" } new_table_name: "default.Table_d4e365ba6dad4ed594b173f874e884d4" modify_external_catalogs: true
I20260927 13:49:58.501802 5623 ts_tablet_manager.cc:1950] T ec40378eb80c412198d5b66c02e975ef P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.502879 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet ec40378eb80c412198d5b66c02e975ef (table default.Table_c6bf40a827d4408d9436b87449f15866 [id=27609594a3c74bf895858e5dc48a543e]) successfully deleted
I20260927 13:49:58.503260 5623 tablet_replica.cc:333] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.503479 5623 raft_consensus.cc:2243] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.498625 5626 raft_consensus.cc:740] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.503702 5623 raft_consensus.cc:2272] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.503931 5626 consensus_queue.cc:260] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.504366 5623 ts_tablet_manager.cc:1916] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.507099 5626 ts_tablet_manager.cc:1434] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260927 13:49:58.507477 5626 tablet_bootstrap.cc:492] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:58.513639 5623 ts_tablet_manager.cc:1929] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.513855 5623 log.cc:1199] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/31ee75d0a39c42b09f2f46a1774f925c
I20260927 13:49:58.516644 6695 raft_consensus.cc:493] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.516817 5623 ts_tablet_manager.cc:1950] T 31ee75d0a39c42b09f2f46a1774f925c P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.516811 6695 raft_consensus.cc:515] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.517764 5623 tablet_replica.cc:333] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.517957 5623 raft_consensus.cc:2243] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.517959 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 31ee75d0a39c42b09f2f46a1774f925c (table default.Table_ee4b85ee72994fe596598538d6755252 [id=c2ce8f3fda214134bf35a2866675d0f7]) successfully deleted
I20260927 13:49:58.518082 5623 raft_consensus.cc:2272] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.518252 6695 leader_election.cc:290] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.518666 5623 ts_tablet_manager.cc:1916] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.518992 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f7512333e245c4b35018961a510efd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.519179 5384 raft_consensus.cc:2468] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:58.519629 5045 leader_election.cc:304] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:58.519965 6695 raft_consensus.cc:2804] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:58.520045 6695 raft_consensus.cc:493] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:58.520114 6695 raft_consensus.cc:3060] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.522806 6695 raft_consensus.cc:515] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.523818 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cbf0b5fb90a54c53a85f0b44822c3ab6" } modify_external_catalogs: true
I20260927 13:49:58.523828 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f7512333e245c4b35018961a510efd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:58.523995 5384 raft_consensus.cc:3060] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.524000 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_cbf0b5fb90a54c53a85f0b44822c3ab6" } modify_external_catalogs: true
I20260927 13:49:58.524626 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5f348882b88d4bdc8b238f4794b07610"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:58.524762 5623 ts_tablet_manager.cc:1929] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.524868 5623 log.cc:1199] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b8311ff24259477a9523355908ac14f8
W20260927 13:49:58.525169 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f348882b88d4bdc8b238f4794b07610 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.525143 5623 ts_tablet_manager.cc:1950] T b8311ff24259477a9523355908ac14f8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.526161 6695 leader_election.cc:290] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.526846 5384 raft_consensus.cc:2468] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:58.526978 5623 tablet_replica.cc:333] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.527153 5623 raft_consensus.cc:2243] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.527283 5623 raft_consensus.cc:2272] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.527282 5045 leader_election.cc:304] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:58.527534 6695 raft_consensus.cc:2804] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:58.527655 6695 raft_consensus.cc:697] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:58.527900 6695 consensus_queue.cc:237] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.528110 5623 ts_tablet_manager.cc:1916] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.528522 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b8311ff24259477a9523355908ac14f8 (table default.Table_2e1239a5183b45839ad4a031b7398f95 [id=deaa0ccfa31b4763887d5bfd6418ce26]) successfully deleted
W20260927 13:49:58.528853 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a7a97f4df3a84781bfcbdc768d518ef0 because the tablet was not found. No further retry: Not found: Tablet not found: a7a97f4df3a84781bfcbdc768d518ef0
I20260927 13:49:58.528914 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f7512333e245c4b35018961a510efd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:58.528963 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f7512333e245c4b35018961a510efd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:58.529080 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 5a3f40a2da8649e0898c0e09b6e14a61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a3f40a2da8649e0898c0e09b6e14a61 already in progress: creating tablet
W20260927 13:49:58.529327 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b4f7512333e245c4b35018961a510efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4f7512333e245c4b35018961a510efd already in progress: creating tablet
W20260927 13:49:58.529507 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet d51c3fa3624340059f6508ced1a2220e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d51c3fa3624340059f6508ced1a2220e already in progress: creating tablet
W20260927 13:49:58.529528 5044 leader_election.cc:343] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:58.529686 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 4211f338c6a648c5b3e36c6df0b3c510 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4211f338c6a648c5b3e36c6df0b3c510 already in progress: creating tablet
W20260927 13:49:58.529832 5044 leader_election.cc:343] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:58.529908 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet d3b38f40431f47a0acf1e11092d7717b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3b38f40431f47a0acf1e11092d7717b already in progress: creating tablet
I20260927 13:49:58.531692 5628 tablet_bootstrap.cc:492] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:58.541879 5623 ts_tablet_manager.cc:1929] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.542042 5623 log.cc:1199] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/bb505472de024c2e9b3861f3225b7e40
I20260927 13:49:58.542348 5623 ts_tablet_manager.cc:1950] T bb505472de024c2e9b3861f3225b7e40 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.543308 5623 tablet_replica.cc:333] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.543509 5623 raft_consensus.cc:2243] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.543712 5623 raft_consensus.cc:2272] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.544580 5623 ts_tablet_manager.cc:1916] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.544677 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet bb505472de024c2e9b3861f3225b7e40 (table default.Table_d936492f977944a59cdb4de68a75c0a8 [id=3bbc5d02a6d14ec98f4377270e60e6fc]) successfully deleted
I20260927 13:49:58.546128 6682 raft_consensus.cc:493] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.546324 6682 raft_consensus.cc:515] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.546977 6682 leader_election.cc:290] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.547668 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d3c47755c94148a488782dbc379011" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.548063 5626 tablet_bootstrap.cc:654] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.548291 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d3c47755c94148a488782dbc379011" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.550241 5619 tablet_bootstrap.cc:654] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.552053 5623 ts_tablet_manager.cc:1929] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.552145 5623 log.cc:1199] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/6ce893441d5e4d9f89743e75eb762276
I20260927 13:49:58.552423 5623 ts_tablet_manager.cc:1950] T 6ce893441d5e4d9f89743e75eb762276 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.553471 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 6ce893441d5e4d9f89743e75eb762276 (table default.Table_6f968553a801422ba747b1d4516c2074 [id=b330cf549e3842ad9e82aed396bcba89]) successfully deleted
W20260927 13:49:58.554144 4916 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 9f080b4ca9894eae8305d1548010a6cb because the tablet was not found. No further retry: Not found: Tablet not found: 9f080b4ca9894eae8305d1548010a6cb
I20260927 13:49:58.554412 5623 tablet_replica.cc:333] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
W20260927 13:49:58.554759 5044 leader_election.cc:343] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.554580 5623 raft_consensus.cc:2243] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:58.554997 5045 leader_election.cc:343] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.555119 5623 raft_consensus.cc:2272] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.555112 5045 leader_election.cc:304] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.555518 6682 raft_consensus.cc:2749] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.555964 5623 ts_tablet_manager.cc:1916] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.559918 5628 tablet_bootstrap.cc:654] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.562219 5623 ts_tablet_manager.cc:1929] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:58.562393 5623 log.cc:1199] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/931a48792f4c4525bd563a4dd1062e35
I20260927 13:49:58.562816 5623 ts_tablet_manager.cc:1950] T 931a48792f4c4525bd563a4dd1062e35 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.563899 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 931a48792f4c4525bd563a4dd1062e35 (table default.Table_3b7666d87acf47bda3e3e2545c8cfb25 [id=bed97aef149a417bb3807414f58ba52a]) successfully deleted
W20260927 13:49:58.566129 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb consensus state has no leader
W20260927 13:49:58.566185 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 78c4bbb0512c4411916eb4c48731f32f consensus state has no leader
I20260927 13:49:58.566551 4926 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet ae7bc587724c420091444f3f0e3ec3bc
I20260927 13:49:58.570474 5626 tablet_bootstrap.cc:492] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:58.570744 5626 ts_tablet_manager.cc:1403] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.002s
I20260927 13:49:58.571470 5626 raft_consensus.cc:359] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.571637 5626 raft_consensus.cc:385] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.571687 5626 raft_consensus.cc:740] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.571884 5626 consensus_queue.cc:260] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.572620 5626 ts_tablet_manager.cc:1434] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:49:58.578527 5626 tablet_bootstrap.cc:492] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:58.583902 6682 raft_consensus.cc:493] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.584080 6682 raft_consensus.cc:515] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.584723 6682 leader_election.cc:290] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.585568 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc140bba42a43758fa0c6540d728275" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:58.586220 5045 leader_election.cc:343] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.586714 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc140bba42a43758fa0c6540d728275" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.587004 5619 tablet_bootstrap.cc:492] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.587137 5619 ts_tablet_manager.cc:1403] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.276s user 0.018s sys 0.000s
W20260927 13:49:58.587256 5044 leader_election.cc:343] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.587356 5044 leader_election.cc:304] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.587574 6682 raft_consensus.cc:2749] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.587806 5619 raft_consensus.cc:359] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.587961 5619 raft_consensus.cc:385] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.588014 5619 raft_consensus.cc:740] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.588266 5619 consensus_queue.cc:260] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.592769 5619 ts_tablet_manager.cc:1434] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:49:58.593071 5619 tablet_bootstrap.cc:492] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:58.594435 5626 tablet_bootstrap.cc:654] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.595345 5619 tablet_bootstrap.cc:654] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.608368 5619 tablet_bootstrap.cc:492] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.608573 5619 ts_tablet_manager.cc:1403] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.002s
I20260927 13:49:58.609257 5619 raft_consensus.cc:359] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.610719 5619 raft_consensus.cc:385] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.610847 5619 raft_consensus.cc:740] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.611158 5619 consensus_queue.cc:260] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.613963 5619 ts_tablet_manager.cc:1434] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:58.614332 6524 raft_consensus.cc:493] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.614467 6524 raft_consensus.cc:515] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.615101 6524 leader_election.cc:290] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.616179 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet db75594e5ee0427a80016bb8a19b6703
I20260927 13:49:58.616868 4930 catalog_manager.cc:6934] ReplaceTablet: tablet db75594e5ee0427a80016bb8a19b6703 deleted and replaced by tablet a4099c41981f46758a8f478d7fdb4182
W20260927 13:49:58.617100 5184 leader_election.cc:343] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: fa9d09ca7952499ba135e15cecb1143e
I20260927 13:49:58.617551 5626 tablet_bootstrap.cc:492] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:58.617838 5626 ts_tablet_manager.cc:1403] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.003s
W20260927 13:49:58.618384 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 880ce1300eac40b28aac8cba3e11077e consensus state has no leader
I20260927 13:49:58.618734 4923 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet ce42bfbdb64d4ee99a8ea7d092e00c69
I20260927 13:49:58.618785 5626 raft_consensus.cc:359] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.618891 5628 tablet_bootstrap.cc:492] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:58.618927 5626 raft_consensus.cc:385] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.618975 5626 raft_consensus.cc:740] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.619023 5628 ts_tablet_manager.cc:1403] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.087s user 0.006s sys 0.004s
I20260927 13:49:58.619185 5626 consensus_queue.cc:260] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.619730 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet db75594e5ee0427a80016bb8a19b6703 with delete_type TABLET_DATA_DELETED (replaced by tablet a4099c41981f46758a8f478d7fdb4182) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.619843 5628 raft_consensus.cc:359] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.620003 5626 ts_tablet_manager.cc:1434] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:49:58.620064 5628 raft_consensus.cc:385] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.620167 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9d09ca7952499ba135e15cecb1143e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.620332 5384 raft_consensus.cc:2468] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:58.620662 5626 tablet_bootstrap.cc:492] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:58.620785 5185 leader_election.cc:304] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:58.621227 6524 raft_consensus.cc:2804] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:58.621297 6524 raft_consensus.cc:493] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:58.621361 6524 raft_consensus.cc:3060] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.622246 5619 tablet_bootstrap.cc:492] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:58.623545 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3242a0694fbc44279128e33f2c62d622" } modify_external_catalogs: true
I20260927 13:49:58.623713 5619 tablet_bootstrap.cc:654] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.623716 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3242a0694fbc44279128e33f2c62d622" } modify_external_catalogs: true
I20260927 13:49:58.623988 6524 raft_consensus.cc:515] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.624441 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet db75594e5ee0427a80016bb8a19b6703 with delete_type TABLET_DATA_DELETED (replaced by tablet a4099c41981f46758a8f478d7fdb4182) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.624584 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_7251f4705fb24a3fa6018fc2a5364c77" } new_table_name: "default.Table_908235dbf46e4c6f9a13506c919c6492" modify_external_catalogs: true
I20260927 13:49:58.624742 6524 leader_election.cc:290] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.625259 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a226c3e5ff3042b98cc46517327d4610" } modify_external_catalogs: true
I20260927 13:49:58.625439 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_a226c3e5ff3042b98cc46517327d4610" } modify_external_catalogs: true
I20260927 13:49:58.626506 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9d09ca7952499ba135e15cecb1143e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:58.626672 5384 raft_consensus.cc:3060] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.629343 5384 raft_consensus.cc:2468] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:58.629499 5626 tablet_bootstrap.cc:654] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:58.629948 5184 leader_election.cc:343] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: fa9d09ca7952499ba135e15cecb1143e
W20260927 13:49:58.629961 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet db75594e5ee0427a80016bb8a19b6703 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db75594e5ee0427a80016bb8a19b6703 already in progress: creating tablet
W20260927 13:49:58.630292 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet db75594e5ee0427a80016bb8a19b6703 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db75594e5ee0427a80016bb8a19b6703 already in progress: creating tablet
I20260927 13:49:58.630347 5185 leader_election.cc:304] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:58.630764 6524 raft_consensus.cc:2804] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:58.630995 6524 raft_consensus.cc:697] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
W20260927 13:49:58.631081 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 consensus state has no leader
I20260927 13:49:58.631279 6524 consensus_queue.cc:237] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.631518 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_5de6d07207814569a0b1f42ac2e12c24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.632094 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5de6d07207814569a0b1f42ac2e12c24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.633998 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f76750964cba404fb197cc254b4ed32a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.634493 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f76750964cba404fb197cc254b4ed32a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.635797 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_6dcaf176a0984afab14290b72962bdf4" } new_table_name: "default.Table_4c3a11147b0c4ecbac699f3e43945347" modify_external_catalogs: true
I20260927 13:49:58.641892 4929 master_service.cc:960] ReplaceTablet: received request to replace tablet 3add644bb1f544e1b3c91fecfd6a541b from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:58.643281 4922 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:51808 (request call id 1) took 1013 ms. Trace:
I20260927 13:49:58.643401 4922 rpcz_store.cc:276] 0927 13:49:57.630207 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.643060 (+1012853us) service_pool.cc:224] Handling call
0927 13:49:58.643232 (+ 172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260927 13:49:58.646595 6667 raft_consensus.cc:493] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.646603 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_51418e08551949709fa1cc76c3d6bd21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:58.646762 6667 raft_consensus.cc:515] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:58.647289 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51418e08551949709fa1cc76c3d6bd21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.647373 6667 leader_election.cc:290] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:58.648574 5184 leader_election.cc:343] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 5b224b590e5c4a2ab26ea7eaeedd976c
I20260927 13:49:58.649271 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b224b590e5c4a2ab26ea7eaeedd976c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.649482 5382 raft_consensus.cc:2468] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:49:58.649736 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3ff54037c03446db8068c7bfd74ac465"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:58.649958 5185 leader_election.cc:304] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:58.620118 5628 raft_consensus.cc:740] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.627277 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet db75594e5ee0427a80016bb8a19b6703 with delete_type TABLET_DATA_DELETED (replaced by tablet a4099c41981f46758a8f478d7fdb4182) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:58.650432 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ff54037c03446db8068c7bfd74ac465 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.650487 6667 raft_consensus.cc:2804] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:58.650552 6667 raft_consensus.cc:493] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:58.650614 6667 raft_consensus.cc:3060] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.653405 6667 raft_consensus.cc:515] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:58.655234 5184 leader_election.cc:343] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 5b224b590e5c4a2ab26ea7eaeedd976c
I20260927 13:49:58.657212 6667 leader_election.cc:290] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.657812 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b224b590e5c4a2ab26ea7eaeedd976c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:58.657976 5382 raft_consensus.cc:3060] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.660859 5382 raft_consensus.cc:2468] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:58.661412 5185 leader_election.cc:304] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:58.664672 6667 raft_consensus.cc:2804] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:58.664923 6667 raft_consensus.cc:697] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:58.665198 6667 consensus_queue.cc:237] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.669484 5626 tablet_bootstrap.cc:492] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:58.669641 5626 ts_tablet_manager.cc:1403] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.049s user 0.000s sys 0.006s
I20260927 13:49:58.670490 5626 raft_consensus.cc:359] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.670640 5626 raft_consensus.cc:385] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.670687 5626 raft_consensus.cc:740] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
W20260927 13:49:58.673547 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 27131f0e8c9e4f1ea290989155ddcd0b has no consensus state
I20260927 13:49:58.673949 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_000065d7fd1245df945d5c14cf4b881b" } modify_external_catalogs: true
I20260927 13:49:58.674327 5628 consensus_queue.cc:260] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.674535 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_000065d7fd1245df945d5c14cf4b881b" } modify_external_catalogs: true
W20260927 13:49:58.677537 5319 consensus_peers.cc:597] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1f9ae430c414cdf9370388d51dd7c63. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:58.684289 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 74226753751a49fa8ce98eafb2ca1250
I20260927 13:49:58.685087 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 74226753751a49fa8ce98eafb2ca1250 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.685320 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 74226753751a49fa8ce98eafb2ca1250 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.685572 5606 tablet_replica.cc:333] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:58.685753 5606 raft_consensus.cc:2243] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:58.685837 5626 consensus_queue.cc:260] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.686048 5606 raft_consensus.cc:2272] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.686395 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 74226753751a49fa8ce98eafb2ca1250 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.686595 5623 tablet_replica.cc:333] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:58.686740 5623 raft_consensus.cc:2243] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.686821 5628 ts_tablet_manager.cc:1434] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.068s user 0.002s sys 0.000s
I20260927 13:49:58.687134 5628 tablet_bootstrap.cc:492] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:58.687492 5606 ts_tablet_manager.cc:1916] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.688539 5628 tablet_bootstrap.cc:654] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.692523 6695 raft_consensus.cc:493] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.692644 6695 raft_consensus.cc:515] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.693580 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20766b5a757e4a7e954c198f8c9ca41f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:58.694136 5044 leader_election.cc:343] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.694908 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20766b5a757e4a7e954c198f8c9ca41f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:58.695389 5045 leader_election.cc:343] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.695495 5045 leader_election.cc:304] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.695730 6682 raft_consensus.cc:2749] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.695945 6695 leader_election.cc:290] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.698002 5606 ts_tablet_manager.cc:1929] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:58.698206 5606 log.cc:1199] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/74226753751a49fa8ce98eafb2ca1250
I20260927 13:49:58.698688 5606 ts_tablet_manager.cc:1950] T 74226753751a49fa8ce98eafb2ca1250 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:58.701253 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_552cc54d365f49b1848f9806cae88e18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.702122 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_552cc54d365f49b1848f9806cae88e18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.705500 6493 ts_tablet_manager.cc:1929] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.705643 6493 log.cc:1199] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/03a1f13b31934baa8ce18fc499e94806
I20260927 13:49:58.705996 6493 ts_tablet_manager.cc:1950] T 03a1f13b31934baa8ce18fc499e94806 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:58.706440 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet 14f5479761f94ee0b339e125d06a808c from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:58.707839 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 617) took 1467 ms. Trace:
I20260927 13:49:58.707922 6493 rpcz_store.cc:276] 0927 13:49:57.240614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:57.241508 (+ 894us) service_pool.cc:224] Handling call
0927 13:49:58.477305 (+1235797us) ts_tablet_manager.cc:1151] Deleting tablet 03a1f13b31934baa8ce18fc499e94806
0927 13:49:58.477315 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.640966 (+163651us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.705424 (+ 64458us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.707807 (+ 2383us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1235583}
I20260927 13:49:58.708444 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 03a1f13b31934baa8ce18fc499e94806 (table default.Table_cf1d80366a7743b3b4fea68ea5246139 [id=ded13e9c993046cd891db043b1ff6a95]) successfully deleted
I20260927 13:49:58.711095 6493 tablet_replica.cc:333] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:58.711652 5623 raft_consensus.cc:2272] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.712342 5623 ts_tablet_manager.cc:1916] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.722775 5623 ts_tablet_manager.cc:1929] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:58.722965 5623 log.cc:1199] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/74226753751a49fa8ce98eafb2ca1250
I20260927 13:49:58.723409 5623 ts_tablet_manager.cc:1950] T 74226753751a49fa8ce98eafb2ca1250 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:58.724957 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 74226753751a49fa8ce98eafb2ca1250 (table default.Table_000065d7fd1245df945d5c14cf4b881b [id=8c41592b4b4c4d4b9286336ed3c77b4b]) successfully deleted
I20260927 13:49:58.725190 6493 raft_consensus.cc:2243] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:58.725546 6493 raft_consensus.cc:2272] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.726081 6493 ts_tablet_manager.cc:1916] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.726926 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 74226753751a49fa8ce98eafb2ca1250 (table default.Table_000065d7fd1245df945d5c14cf4b881b [id=8c41592b4b4c4d4b9286336ed3c77b4b]) successfully deleted
I20260927 13:49:58.728071 5628 tablet_bootstrap.cc:492] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:58.728209 5628 ts_tablet_manager.cc:1403] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.000s
I20260927 13:49:58.728880 5628 raft_consensus.cc:359] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.729063 5628 raft_consensus.cc:385] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.729127 5628 raft_consensus.cc:740] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.729386 5628 consensus_queue.cc:260] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.735898 5628 ts_tablet_manager.cc:1434] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260927 13:49:58.737810 5619 tablet_bootstrap.cc:492] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.737991 5619 ts_tablet_manager.cc:1403] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.118s user 0.009s sys 0.008s
I20260927 13:49:58.738667 5619 raft_consensus.cc:359] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.738940 5619 raft_consensus.cc:385] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.739032 5619 raft_consensus.cc:740] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.739333 5619 consensus_queue.cc:260] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.739926 5619 ts_tablet_manager.cc:1434] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:58.740286 5628 tablet_bootstrap.cc:492] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:58.740525 5619 tablet_bootstrap.cc:492] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:58.741951 5619 tablet_bootstrap.cc:654] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:58.744994 5319 consensus_peers.cc:597] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1f9ae430c414cdf9370388d51dd7c63. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:58.747105 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_74c7885b9da54e549b3e0207088d8fc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.747802 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74c7885b9da54e549b3e0207088d8fc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.748080 6695 raft_consensus.cc:493] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.748196 6695 raft_consensus.cc:515] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.748796 6695 leader_election.cc:290] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.749516 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb2045e5d84ed2b51dd88e197e84cb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.749707 5247 raft_consensus.cc:2468] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:58.750175 5044 leader_election.cc:304] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:58.750432 6672 raft_consensus.cc:2804] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:58.750507 6672 raft_consensus.cc:493] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:58.750567 6672 raft_consensus.cc:3060] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.750727 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb2045e5d84ed2b51dd88e197e84cb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.750907 5382 raft_consensus.cc:2468] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:58.753553 6695 raft_consensus.cc:493] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.753593 6672 raft_consensus.cc:515] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.753652 6695 raft_consensus.cc:515] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.754530 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_eaa1571598144afbb2bb374264f3f84a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:58.755273 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb2045e5d84ed2b51dd88e197e84cb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:58.755443 5247 raft_consensus.cc:3060] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.755443 6672 leader_election.cc:290] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.758268 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4211f338c6a648c5b3e36c6df0b3c510" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.758422 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d6b9b32a54ed4746b880a4ae62ad9ba3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.758838 5044 leader_election.cc:343] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.759183 6695 leader_election.cc:290] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.760280 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb2045e5d84ed2b51dd88e197e84cb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:58.760444 5382 raft_consensus.cc:3060] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.760888 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4211f338c6a648c5b3e36c6df0b3c510" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.761111 4923 master_service.cc:960] ReplaceTablet: received request to replace tablet 45096e907a9c44b7ace81357cdd575d4 from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:58.763372 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6b9b32a54ed4746b880a4ae62ad9ba3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.763899 5382 raft_consensus.cc:2468] T daeb2045e5d84ed2b51dd88e197e84cb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
W20260927 13:49:58.764426 5045 leader_election.cc:343] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:58.764524 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eaa1571598144afbb2bb374264f3f84a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.764544 5045 leader_election.cc:304] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.764971 5045 leader_election.cc:304] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:58.766665 6695 raft_consensus.cc:2749] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.766865 6695 raft_consensus.cc:2804] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:58.766973 6695 raft_consensus.cc:697] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:58.767092 5247 raft_consensus.cc:2468] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:58.767227 6695 consensus_queue.cc:237] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.769238 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_8a05998b42404d7aa570c504e6973e38" } new_table_name: "default.Table_b06f5c4b54b642a8b25acb1c186d9aa9" modify_external_catalogs: true
I20260927 13:49:58.770200 5626 ts_tablet_manager.cc:1434] T daeb2045e5d84ed2b51dd88e197e84cb P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.100s user 0.001s sys 0.002s
I20260927 13:49:58.772167 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_270422451be448a2b25e3952c94c9a61" } new_table_name: "default.Table_c59836cd19cf4bbaad679c62e79a19f8" modify_external_catalogs: true
I20260927 13:49:58.772879 6672 raft_consensus.cc:493] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.773108 6672 raft_consensus.cc:515] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.774223 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60de1c28618f4e478aae68ad07fbcf98" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:58.774766 5044 leader_election.cc:343] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.775779 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60de1c28618f4e478aae68ad07fbcf98" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:49:58.776371 5045 leader_election.cc:343] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.776470 5045 leader_election.cc:304] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.776671 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ccb6887bdbc847159519b36b4f89b414" } modify_external_catalogs: true
I20260927 13:49:58.776733 6682 raft_consensus.cc:2749] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.776862 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ccb6887bdbc847159519b36b4f89b414" } modify_external_catalogs: true
I20260927 13:49:58.777092 6672 leader_election.cc:290] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.780803 5619 tablet_bootstrap.cc:492] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.780951 5619 ts_tablet_manager.cc:1403] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
W20260927 13:49:58.782189 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4099c41981f46758a8f478d7fdb4182 has no consensus state
I20260927 13:49:58.782625 6145 raft_consensus.cc:493] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.786460 6145 raft_consensus.cc:515] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.787072 6145 leader_election.cc:290] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.786998 5619 raft_consensus.cc:359] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.787145 5619 raft_consensus.cc:385] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.787195 5619 raft_consensus.cc:740] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.787380 5619 consensus_queue.cc:260] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.787789 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aafbbdaa8ac48329ad422cb0c08e518" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:58.787878 5619 ts_tablet_manager.cc:1434] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 13:49:58.787995 5105 raft_consensus.cc:2468] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:58.788158 5619 tablet_bootstrap.cc:492] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:58.789235 6672 raft_consensus.cc:493] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.789369 6672 raft_consensus.cc:515] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.789633 5619 tablet_bootstrap.cc:654] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.789572 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aafbbdaa8ac48329ad422cb0c08e518" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:58.790169 5319 leader_election.cc:343] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.790295 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0880140d99004eb1803d6b5dcf41af13" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.790683 4927 master_service.cc:960] ReplaceTablet: received request to replace tablet a0575418f5ea4d82b34112e1bc9ab8b4 from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:58.790791 5044 leader_election.cc:343] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:49:58.792030 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5feae3a28cd44ff9392a1574a444db3 consensus state has no leader
I20260927 13:49:58.792833 6672 leader_election.cc:290] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:58.798090 5319 leader_election.cc:304] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:58.798259 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0880140d99004eb1803d6b5dcf41af13" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.798525 6145 raft_consensus.cc:2804] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:58.798602 6145 raft_consensus.cc:493] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:58.798660 6145 raft_consensus.cc:3060] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:58.798839 5045 leader_election.cc:343] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.798952 5045 leader_election.cc:304] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.799378 6695 raft_consensus.cc:2749] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.801440 6145 raft_consensus.cc:515] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.802026 6145 leader_election.cc:290] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.802906 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aafbbdaa8ac48329ad422cb0c08e518" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:58.803063 5105 raft_consensus.cc:3060] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.806259 5626 tablet_bootstrap.cc:492] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:58.806891 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aafbbdaa8ac48329ad422cb0c08e518" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:58.807976 5626 tablet_bootstrap.cc:654] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:58.808363 5319 leader_election.cc:343] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.808611 5105 raft_consensus.cc:2468] T 6aafbbdaa8ac48329ad422cb0c08e518 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:58.809063 5319 leader_election.cc:304] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:58.809420 6608 raft_consensus.cc:2804] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:58.809521 6608 raft_consensus.cc:697] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:58.809729 6608 consensus_queue.cc:237] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.812103 5628 tablet_bootstrap.cc:654] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.817066 6145 consensus_queue.cc:1048] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:58.827556 4925 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet c332b6ec9ca94ce398a71e82e20897d4 (table default.Table_ba46c52966764f5989cc55eed4059edf [id=db33cf0d6695498f8e5100abb2103d08]). Expected version 2 got 0
I20260927 13:49:58.838966 5619 tablet_bootstrap.cc:492] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.839116 5619 ts_tablet_manager.cc:1403] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.005s
I20260927 13:49:58.839835 5619 raft_consensus.cc:359] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.839996 5619 raft_consensus.cc:385] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.840040 5619 raft_consensus.cc:740] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.840265 5619 consensus_queue.cc:260] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.840761 5619 ts_tablet_manager.cc:1434] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:58.841027 5619 tablet_bootstrap.cc:492] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:58.843230 5619 tablet_bootstrap.cc:654] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.846282 6695 raft_consensus.cc:493] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.846481 6695 raft_consensus.cc:515] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.847060 6493 ts_tablet_manager.cc:1929] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:58.847160 6493 log.cc:1199] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/4d35148d80b44fca9b39a4625d3e61c1
I20260927 13:49:58.847519 6493 ts_tablet_manager.cc:1950] T 4d35148d80b44fca9b39a4625d3e61c1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:58.847622 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afb800e7ff44aadaed8f8d85aa9efe2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:49:58.848223 5044 leader_election.cc:343] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.849822 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afb800e7ff44aadaed8f8d85aa9efe2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:58.850201 6695 leader_election.cc:290] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:58.850610 5045 leader_election.cc:343] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.850713 5045 leader_election.cc:304] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:58.851114 6695 raft_consensus.cc:2749] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:58.854626 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_479338a884a047389e0343ea71022b50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:58.855413 5619 tablet_bootstrap.cc:492] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.855536 5619 ts_tablet_manager.cc:1403] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.002s
I20260927 13:49:58.856236 5619 raft_consensus.cc:359] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.856403 5619 raft_consensus.cc:385] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.856480 5619 raft_consensus.cc:740] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.856696 5619 consensus_queue.cc:260] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.857151 5619 ts_tablet_manager.cc:1434] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:58.857527 5619 tablet_bootstrap.cc:492] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:58.859175 5619 tablet_bootstrap.cc:654] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.859647 6703 consensus_queue.cc:1048] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:58.862526 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 619) took 1505 ms. Trace:
I20260927 13:49:58.862640 6493 rpcz_store.cc:276] 0927 13:49:57.357106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:57.364055 (+ 6949us) service_pool.cc:224] Handling call
0927 13:49:58.711038 (+1346983us) ts_tablet_manager.cc:1151] Deleting tablet 4d35148d80b44fca9b39a4625d3e61c1
0927 13:49:58.711050 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.830271 (+119221us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.847004 (+ 16733us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:58.862505 (+ 15501us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1346183}
I20260927 13:49:58.867540 5619 tablet_bootstrap.cc:492] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.867676 5619 ts_tablet_manager.cc:1403] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260927 13:49:58.868924 5619 raft_consensus.cc:359] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.869105 5619 raft_consensus.cc:385] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.869154 5619 raft_consensus.cc:740] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.869370 5619 consensus_queue.cc:260] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.870291 5619 ts_tablet_manager.cc:1434] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:58.870639 5619 tablet_bootstrap.cc:492] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:58.872035 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 620) took 1492 ms. Trace:
I20260927 13:49:58.872133 6493 rpcz_store.cc:276] 0927 13:49:57.379945 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:57.381903 (+ 1958us) service_pool.cc:224] Handling call
0927 13:49:58.871899 (+1489996us) ts_tablet_manager.cc:1151] Deleting tablet 2e768c83fae54619ac849dfedd5ec654
0927 13:49:58.871910 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.872014 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1489810}
I20260927 13:49:58.873752 5619 tablet_bootstrap.cc:654] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.877552 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 622) took 1444 ms. Trace:
I20260927 13:49:58.877648 6493 rpcz_store.cc:276] 0927 13:49:57.433402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:57.433454 (+ 52us) service_pool.cc:224] Handling call
0927 13:49:58.877420 (+1443966us) ts_tablet_manager.cc:1151] Deleting tablet 2d64750141d74d988612304ce050688d
0927 13:49:58.877432 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:58.877531 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1443802}
I20260927 13:49:58.879400 6609 raft_consensus.cc:493] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.879529 6609 raft_consensus.cc:515] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.880182 6609 leader_election.cc:290] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.880307 6609 raft_consensus.cc:493] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.880399 6609 raft_consensus.cc:515] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.880915 6609 leader_election.cc:290] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.881695 6493 tablet_replica.cc:333] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:58.881902 6493 raft_consensus.cc:2243] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.882072 6493 raft_consensus.cc:2272] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.882673 6493 ts_tablet_manager.cc:1916] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.887508 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20766b5a757e4a7e954c198f8c9ca41f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.887784 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20766b5a757e4a7e954c198f8c9ca41f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:58.887979 5107 raft_consensus.cc:2468] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:58.888705 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0851e183315a45f4a85d68d698e74cb7" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:58.888855 5107 raft_consensus.cc:2468] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:58.888902 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0851e183315a45f4a85d68d698e74cb7" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:58.889125 5249 raft_consensus.cc:2468] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:49:58.889530 5319 leader_election.cc:343] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:58.889731 5319 leader_election.cc:304] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:58.890072 5319 leader_election.cc:304] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:58.890250 6703 raft_consensus.cc:2804] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:58.890326 6703 raft_consensus.cc:493] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:58.890389 6703 raft_consensus.cc:3060] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.890421 6609 raft_consensus.cc:2804] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:58.890487 6609 raft_consensus.cc:493] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:58.890537 6609 raft_consensus.cc:3060] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.893154 6703 raft_consensus.cc:515] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.893227 6609 raft_consensus.cc:515] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.893723 6609 leader_election.cc:290] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.893921 5628 tablet_bootstrap.cc:492] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:58.894050 5628 ts_tablet_manager.cc:1403] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.154s user 0.005s sys 0.008s
I20260927 13:49:58.893723 6703 leader_election.cc:290] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:58.894873 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 1a50f61eec39438f9d2b652f0346a0e5
I20260927 13:49:58.895356 5619 tablet_bootstrap.cc:492] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.895462 5619 ts_tablet_manager.cc:1403] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.001s
I20260927 13:49:58.895561 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 39fa23553c554826ad811ebe2e978ef9
I20260927 13:49:58.896179 5619 raft_consensus.cc:359] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.896317 5619 raft_consensus.cc:385] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.896356 5619 raft_consensus.cc:740] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.896420 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ea9d56ff62de487fb4f0291ecb728711" } new_table_name: "default.Table_5fd18aaf3713418e96976bc82c39f6e0" modify_external_catalogs: true
I20260927 13:49:58.896512 5619 consensus_queue.cc:260] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.896955 5619 ts_tablet_manager.cc:1434] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 13:49:58.897204 5619 tablet_bootstrap.cc:492] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:58.899050 5628 raft_consensus.cc:359] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.899240 5619 tablet_bootstrap.cc:654] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.899245 5628 raft_consensus.cc:385] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.899298 5628 raft_consensus.cc:740] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.899521 5628 consensus_queue.cc:260] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.900288 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 39fa23553c554826ad811ebe2e978ef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:58.901551 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 39fa23553c554826ad811ebe2e978ef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.902649 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 3add644bb1f544e1b3c91fecfd6a541b
I20260927 13:49:58.905071 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 284f6113fa4b443a869bce6d0c15f273
I20260927 13:49:58.906071 5628 ts_tablet_manager.cc:1434] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260927 13:49:58.906577 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 284f6113fa4b443a869bce6d0c15f273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.906906 5628 tablet_bootstrap.cc:492] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:58.908592 5628 tablet_bootstrap.cc:654] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:58.910419 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 39fa23553c554826ad811ebe2e978ef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:58.911103 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 39fa23553c554826ad811ebe2e978ef9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39fa23553c554826ad811ebe2e978ef9 already in progress: creating tablet
W20260927 13:49:58.911423 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 284f6113fa4b443a869bce6d0c15f273 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 284f6113fa4b443a869bce6d0c15f273 already in progress: creating tablet
I20260927 13:49:58.912935 6740 raft_consensus.cc:493] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:58.913055 6740 raft_consensus.cc:515] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.913619 6740 leader_election.cc:290] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:58.915400 5619 tablet_bootstrap.cc:492] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:58.915545 5619 ts_tablet_manager.cc:1403] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260927 13:49:58.916507 5619 raft_consensus.cc:359] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.916704 5619 raft_consensus.cc:385] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:58.916764 5619 raft_consensus.cc:740] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:58.916953 5619 consensus_queue.cc:260] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.917389 5619 ts_tablet_manager.cc:1434] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:49:58.917675 5619 tablet_bootstrap.cc:492] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:58.920367 5619 tablet_bootstrap.cc:654] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:49:58.855280 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_479338a884a047389e0343ea71022b50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.929702 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 4d35148d80b44fca9b39a4625d3e61c1 (table default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]) successfully deleted
I20260927 13:49:58.930425 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a0575418f5ea4d82b34112e1bc9ab8b4
I20260927 13:49:58.930717 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a50f61eec39438f9d2b652f0346a0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.930857 4927 catalog_manager.cc:6934] ReplaceTablet: tablet a0575418f5ea4d82b34112e1bc9ab8b4 deleted and replaced by tablet e3765fe06c664e60a11acf76c825bc42
I20260927 13:49:58.931880 4927 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_183efeacde2a430ba345a16786994e76" } new_table_name: "default.Table_06b04cbe300b4373813df57694d32684" modify_external_catalogs: true
I20260927 13:49:58.932431 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet a0575418f5ea4d82b34112e1bc9ab8b4 with delete_type TABLET_DATA_DELETED (replaced by tablet e3765fe06c664e60a11acf76c825bc42) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.928170 4925 catalog_manager.cc:5838] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:58.934058 4929 catalog_manager.cc:6934] ReplaceTablet: tablet 3add644bb1f544e1b3c91fecfd6a541b deleted and replaced by tablet c27872794fb24934b723c56935d94702
I20260927 13:49:58.934576 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_645d9205892845cdb661a97f3576207e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.935075 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_645d9205892845cdb661a97f3576207e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.936129 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7db7dcae15a64ff4b308591077608880"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.936584 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7db7dcae15a64ff4b308591077608880 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:58.937708 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 2e768c83fae54619ac849dfedd5ec654 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e768c83fae54619ac849dfedd5ec654 already in progress: creating tablet
W20260927 13:49:58.937948 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 2d64750141d74d988612304ce050688d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d64750141d74d988612304ce050688d already in progress: creating tablet
W20260927 13:49:58.938218 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet d9cb99ad45d1445cb2e2854319a3d73d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9cb99ad45d1445cb2e2854319a3d73d already in progress: creating tablet
W20260927 13:49:58.939116 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 39fa23553c554826ad811ebe2e978ef9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39fa23553c554826ad811ebe2e978ef9 already in progress: creating tablet
I20260927 13:49:58.939316 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet a0575418f5ea4d82b34112e1bc9ab8b4 with delete_type TABLET_DATA_DELETED (replaced by tablet e3765fe06c664e60a11acf76c825bc42) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:58.939379 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 1a50f61eec39438f9d2b652f0346a0e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a50f61eec39438f9d2b652f0346a0e5 already in progress: creating tablet
I20260927 13:49:58.939519 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet 284f6113fa4b443a869bce6d0c15f273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.939702 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 3add644bb1f544e1b3c91fecfd6a541b with delete_type TABLET_DATA_DELETED (replaced by tablet c27872794fb24934b723c56935d94702) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.939851 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a50f61eec39438f9d2b652f0346a0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:58.939853 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a0575418f5ea4d82b34112e1bc9ab8b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0575418f5ea4d82b34112e1bc9ab8b4 already in progress: creating tablet
I20260927 13:49:58.940236 4926 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d97c60c7dbc6419b8009c1559ca7a49a" } modify_external_catalogs: true
I20260927 13:49:58.940397 4926 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d97c60c7dbc6419b8009c1559ca7a49a" } modify_external_catalogs: true
I20260927 13:49:58.940464 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 3add644bb1f544e1b3c91fecfd6a541b with delete_type TABLET_DATA_DELETED (replaced by tablet c27872794fb24934b723c56935d94702) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:58.940873 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8ab05fcb5824893abfc6953fb28d6b4 consensus state has no leader
I20260927 13:49:58.941190 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_54a5f652ce3b4855b55545b034f1e17d" } new_table_name: "default.Table_139a8135a98d4bc08abfa250a55f9d0c" modify_external_catalogs: true
W20260927 13:49:58.942353 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 3add644bb1f544e1b3c91fecfd6a541b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3add644bb1f544e1b3c91fecfd6a541b already in progress: creating tablet
I20260927 13:49:58.947315 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 45096e907a9c44b7ace81357cdd575d4
I20260927 13:49:58.947779 4923 catalog_manager.cc:6934] ReplaceTablet: tablet 45096e907a9c44b7ace81357cdd575d4 deleted and replaced by tablet fd861e06085e4c7b8bdf1101432bdc31
I20260927 13:49:58.948113 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_8ccdfb70bd5f4ae9912dd1e5669a09e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.948594 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ccdfb70bd5f4ae9912dd1e5669a09e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.950675 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 45096e907a9c44b7ace81357cdd575d4 with delete_type TABLET_DATA_DELETED (replaced by tablet fd861e06085e4c7b8bdf1101432bdc31) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:58.951285 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 45096e907a9c44b7ace81357cdd575d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45096e907a9c44b7ace81357cdd575d4 already in progress: creating tablet
I20260927 13:49:58.951396 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 45096e907a9c44b7ace81357cdd575d4 with delete_type TABLET_DATA_DELETED (replaced by tablet fd861e06085e4c7b8bdf1101432bdc31) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.958546 4924 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c332b6ec9ca94ce398a71e82e20897d4 (table default.Table_ba46c52966764f5989cc55eed4059edf [id=db33cf0d6695498f8e5100abb2103d08]). Expected version 2 got 0
W20260927 13:49:58.958860 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a2ee02044b64e3eaff8136ac43f02e4 consensus state has no leader
I20260927 13:49:58.959157 4921 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_72330b1053c147a48acac2e12df2dcc0 [id=3a103249799f4a5383c5091fda81153e] alter complete (version 3)
I20260927 13:49:58.959264 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_800bad10399f4515acb401f9be49e957"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.959888 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_800bad10399f4515acb401f9be49e957 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:58.961174 4921 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.67:52291 (request call id 129) took 859 ms (client timeout 1000 ms). Trace:
W20260927 13:49:58.961292 4921 rpcz_store.cc:269] 0927 13:49:58.101794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.183184 (+ 81390us) service_pool.cc:224] Handling call
0927 13:49:58.222462 (+ 39278us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x616000051a54. stack: 00007fa4fa3bd5c6 00007fa4fa3bd380 00007fa4f93c534d 00000000009a4cb4 00000000009a4c7d 00007fa50993765d 00007fa509937753 00007fa5064b4db1 00007fa50e2a8a7d 00007fa50e4326e8 00007fa504e011f6 00007fa504e00f25 00007fa50150763e 00007fa50150651e 00007fa50150c758 00007fa50150d0bf
0927 13:49:58.961139 (+738677us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:49:58.393543 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:58.393647 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:58.393651 (+ 4us) write_op.cc:435] Acquired schema lock
0927 13:49:58.393653 (+ 2us) tablet.cc:662] Decoding operations
0927 13:49:58.393740 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:58.393747 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:58.393751 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:49:58.393919 (+ 168us) tablet.cc:701] Row locks acquired
0927 13:49:58.393921 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:49:58.393950 (+ 29us) write_op.cc:270] Start()
0927 13:49:58.393977 (+ 27us) write_op.cc:276] Timestamp: P: 1790516998393894 usec, L: 0
0927 13:49:58.393981 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:49:58.441612 (+ 47631us) log.cc:844] Serialized 907 byte log entry
0927 13:49:58.459666 (+ 18054us) op_driver.cc:464] REPLICATION: finished
0927 13:49:58.459772 (+ 106us) write_op.cc:301] APPLY: starting
0927 13:49:58.459793 (+ 21us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:58.459854 (+ 61us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:58.459895 (+ 41us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:58.459982 (+ 87us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:58.460027 (+ 45us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:49:58.460039 (+ 12us) write_op.cc:312] APPLY: finished
0927 13:49:58.460128 (+ 89us) log.cc:844] Serialized 29 byte log entry
0927 13:49:58.460197 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:58.460220 (+ 23us) write_op.cc:454] Released schema lock
0927 13:49:58.460229 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0927 13:49:58.528833 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:49:58.528976 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:49:58.528981 (+ 5us) write_op.cc:435] Acquired schema lock
0927 13:49:58.528983 (+ 2us) tablet.cc:662] Decoding operations
0927 13:49:58.529054 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:49:58.529060 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0927 13:49:58.529069 (+ 9us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:49:58.529113 (+ 44us) tablet.cc:701] Row locks acquired
0927 13:49:58.529115 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:49:58.529141 (+ 26us) write_op.cc:270] Start()
0927 13:49:58.529165 (+ 24us) write_op.cc:276] Timestamp: P: 1790516998529118 usec, L: 0
0927 13:49:58.529168 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:49:58.529735 (+ 567us) log.cc:844] Serialized 356 byte log entry
0927 13:49:58.564027 (+ 34292us) op_driver.cc:464] REPLICATION: finished
0927 13:49:58.565130 (+ 1103us) write_op.cc:301] APPLY: starting
0927 13:49:58.565140 (+ 10us) tablet.cc:1394] starting BulkCheckPresence
0927 13:49:58.565163 (+ 23us) tablet.cc:1397] finished BulkCheckPresence
0927 13:49:58.565181 (+ 18us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:49:58.565214 (+ 33us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:49:58.565236 (+ 22us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:49:58.565242 (+ 6us) write_op.cc:312] APPLY: finished
0927 13:49:58.565371 (+ 129us) log.cc:844] Serialized 23 byte log entry
0927 13:49:58.565424 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:58.565435 (+ 11us) write_op.cc:454] Released schema lock
0927 13:49:58.565440 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 13:49:58.565499 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:49:58.565503 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":16,"spinlock_wait_cycles":88609152,"child_traces":[["op",{"apply.queue_time_us":47,"apply.run_cpu_time_us":529,"apply.run_wall_time_us":528,"num_ops":2,"prepare.queue_time_us":43144,"prepare.run_cpu_time_us":819,"prepare.run_wall_time_us":58751,"raft.queue_time_us":7704,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":790,"replication_time_us":65648}],["op",{"apply.queue_time_us":1074,"apply.run_cpu_time_us":362,"apply.run_wall_time_us":362,"num_ops":1,"prepare.queue_time_us":64348,"prepare.run_cpu_time_us":531,"prepare.run_wall_time_us":1214,"replication_time_us":34846}]]}
I20260927 13:49:58.963056 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet fa9d09ca7952499ba135e15cecb1143e with delete_type TABLET_DATA_DELETED (replaced by tablet 4211f338c6a648c5b3e36c6df0b3c510) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.963145 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet d1f9ae430c414cdf9370388d51dd7c63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.963263 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet ec40378eb80c412198d5b66c02e975ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.963364 5606 tablet_replica.cc:333] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:58.963409 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b224b590e5c4a2ab26ea7eaeedd976c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.963543 5606 raft_consensus.cc:2243] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:58.963584 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 931a48792f4c4525bd563a4dd1062e35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.963698 5606 raft_consensus.cc:2272] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:58.963727 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 1efaf62692c545dcaa5175fcd826785a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.963546 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet a7a97f4df3a84781bfcbdc768d518ef0 with delete_type TABLET_DATA_DELETED (replaced by tablet b5a9f864e4274666a86baed43e1623cd) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.963995 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f080b4ca9894eae8305d1548010a6cb with delete_type TABLET_DATA_DELETED (replaced by tablet da5d9bda857f467da6930a6c64266f3a) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.964239 5606 ts_tablet_manager.cc:1916] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:58.964346 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet bb505472de024c2e9b3861f3225b7e40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.965730 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 with delete_type TABLET_DATA_DELETED (replaced by tablet cf1a58c67bf54493a3c62fb175acabb8) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.965628 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3787d49451114bc298d54d844cc68eaa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.971014 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 80955.8us
W20260927 13:49:58.971539 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3787d49451114bc298d54d844cc68eaa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.966641 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c700b32dc7b84e708c594f19077a40d1" } modify_external_catalogs: true
I20260927 13:49:58.972646 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_c700b32dc7b84e708c594f19077a40d1" } modify_external_catalogs: true
I20260927 13:49:58.973067 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20766b5a757e4a7e954c198f8c9ca41f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:58.967218 4926 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 9855fd321e4b4d0aa37f7b31d7a5efca
I20260927 13:49:58.974526 5606 ts_tablet_manager.cc:1929] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:58.974635 5606 log.cc:1199] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/fa9d09ca7952499ba135e15cecb1143e
I20260927 13:49:58.974725 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 9855fd321e4b4d0aa37f7b31d7a5efca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:58.974722 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet 9855fd321e4b4d0aa37f7b31d7a5efca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:58.967726 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2d0fed5c3d8c43dba32fce20571132d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:58.974933 5606 ts_tablet_manager.cc:1950] T fa9d09ca7952499ba135e15cecb1143e P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:49:58.975271 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d0fed5c3d8c43dba32fce20571132d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.975441 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0851e183315a45f4a85d68d698e74cb7" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:58.975606 5107 raft_consensus.cc:3060] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.976253 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet fa9d09ca7952499ba135e15cecb1143e (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]) successfully deleted
I20260927 13:49:58.976356 5606 tablet_replica.cc:333] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:58.976605 5606 raft_consensus.cc:2243] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:58.976923 5606 pending_rounds.cc:70] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:49:58.976972 5606 pending_rounds.cc:77] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957622512148480 op_type: NO_OP noop_request { }
I20260927 13:49:58.977074 5606 raft_consensus.cc:2889] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:58.977164 5606 raft_consensus.cc:2272] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:58.968091 4927 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36181512a94c4702ae0a417665919faa consensus state has no leader
I20260927 13:49:58.969944 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_240f3492390b48428f555f3f2dbce154"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:58.977651 5606 ts_tablet_manager.cc:1916] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:58.977717 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_240f3492390b48428f555f3f2dbce154 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.978653 5107 raft_consensus.cc:2468] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:58.979427 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46537e1b33f24d50b705d53f6978da3c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:58.979604 5107 raft_consensus.cc:2468] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:58.980211 5319 leader_election.cc:304] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:58.980621 6740 raft_consensus.cc:2804] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:58.980741 6740 raft_consensus.cc:697] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:58.980990 6740 consensus_queue.cc:237] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:58.981256 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_32fe69927df64b76b1aefe941e9f4241"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.981742 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32fe69927df64b76b1aefe941e9f4241 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.983042 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_fd6ee019e754408fab65109daeb90c0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:58.983743 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd6ee019e754408fab65109daeb90c0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:58.987349 5319 leader_election.cc:304] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:58.987767 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20766b5a757e4a7e954c198f8c9ca41f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:58.988818 5105 raft_consensus.cc:3060] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.988808 4921 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 0d54e51b5c104c75b938aba55cecf890 (table default.Table_a02033f4b12c4cdd986cd855cb148309 [id=0c14f160c8ab4321b14a35fc5f8d3b56]). Expected version 1 got 0
I20260927 13:49:58.989167 6703 raft_consensus.cc:2804] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:58.989243 6703 raft_consensus.cc:493] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:58.989305 6703 raft_consensus.cc:3060] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:58.989069 4921 catalog_manager.cc:5838] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65). New cstate: current_term: 1 leader_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260927 13:49:58.991565 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d0a9564fe50b4e92800203352ad52f81" } new_table_name: "default.Table_3e73c785e0d244c3ae23fc951d45174c" modify_external_catalogs: true
I20260927 13:49:58.991866 6703 raft_consensus.cc:515] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:58.992451 6703 leader_election.cc:290] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:49:58.993064 5319 leader_election.cc:343] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.002647 4923 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_66de536798af449096cd70f50b74a23a" } new_table_name: "default.Table_d79204140f8b4582bc15badf8200790b" modify_external_catalogs: true
I20260927 13:49:58.993495 5606 ts_tablet_manager.cc:1929] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:59.000360 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 27131f0e8c9e4f1ea290989155ddcd0b (DEFAULT_TABLE table=default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.011044 5606 log.cc:1199] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/d1f9ae430c414cdf9370388d51dd7c63
I20260927 13:49:59.011344 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27131f0e8c9e4f1ea290989155ddcd0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.011734 5606 ts_tablet_manager.cc:1950] T d1f9ae430c414cdf9370388d51dd7c63 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:59.013170 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet d1f9ae430c414cdf9370388d51dd7c63 (table default.Table_e680c915b7b546a7927c1795fa7f3ef4 [id=793fd3b0ccee43a88ba3992caa0408ab]) successfully deleted
I20260927 13:49:59.013507 5606 tablet_replica.cc:333] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:59.013682 5606 raft_consensus.cc:2243] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.013831 5606 raft_consensus.cc:2272] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.014415 5606 ts_tablet_manager.cc:1916] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.021152 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46537e1b33f24d50b705d53f6978da3c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:59.021342 5107 raft_consensus.cc:3060] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:59.022768 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 27131f0e8c9e4f1ea290989155ddcd0b (DEFAULT_TABLE table=default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.023161 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27131f0e8c9e4f1ea290989155ddcd0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.025635 5606 ts_tablet_manager.cc:1929] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.025735 5606 log.cc:1199] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/ec40378eb80c412198d5b66c02e975ef
I20260927 13:49:59.026002 5606 ts_tablet_manager.cc:1950] T ec40378eb80c412198d5b66c02e975ef P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:59.035331 5107 raft_consensus.cc:2468] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:59.039230 5319 leader_election.cc:304] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:49:59.039404 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 008516a474cc40f2b9de77b2f3e762cf
I20260927 13:49:59.040567 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 008516a474cc40f2b9de77b2f3e762cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:59.042887 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ef5969312044a2bab451841ec65aa84 consensus state has no leader
I20260927 13:49:59.043591 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 0880140d99004eb1803d6b5dcf41af13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.043855 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc140bba42a43758fa0c6540d728275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.043883 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet ec40378eb80c412198d5b66c02e975ef (table default.Table_c6bf40a827d4408d9436b87449f15866 [id=27609594a3c74bf895858e5dc48a543e]) successfully deleted
I20260927 13:49:59.040877 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet 008516a474cc40f2b9de77b2f3e762cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.045444 5606 tablet_replica.cc:333] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:59.045632 5606 raft_consensus.cc:2243] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.045826 6703 raft_consensus.cc:2804] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:59.045980 6703 raft_consensus.cc:697] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:59.046244 5606 raft_consensus.cc:2272] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.046895 6703 consensus_queue.cc:237] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:59.047035 5606 ts_tablet_manager.cc:1916] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:59.050262 4923 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eed08fbd918b4b78b6ab8f4099506e29 consensus state has no leader
I20260927 13:49:59.066170 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 3add644bb1f544e1b3c91fecfd6a541b with delete_type TABLET_DATA_DELETED (replaced by tablet c27872794fb24934b723c56935d94702) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.066237 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0851e183315a45f4a85d68d698e74cb7" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:59.066402 5247 raft_consensus.cc:3060] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:59.066982 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46537e1b33f24d50b705d53f6978da3c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:59.067857 6493 ts_tablet_manager.cc:1929] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.067826 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46537e1b33f24d50b705d53f6978da3c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:59.067976 6493 log.cc:1199] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/7c2f814bb9ff41ebab19e8c16cf4affa
I20260927 13:49:59.068826 6493 ts_tablet_manager.cc:1950] T 7c2f814bb9ff41ebab19e8c16cf4affa P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.069182 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a50f61eec39438f9d2b652f0346a0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.070843 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet a0575418f5ea4d82b34112e1bc9ab8b4 with delete_type TABLET_DATA_DELETED (replaced by tablet e3765fe06c664e60a11acf76c825bc42) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.071094 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 45096e907a9c44b7ace81357cdd575d4 with delete_type TABLET_DATA_DELETED (replaced by tablet fd861e06085e4c7b8bdf1101432bdc31) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.071254 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet fa9d09ca7952499ba135e15cecb1143e with delete_type TABLET_DATA_DELETED (replaced by tablet 4211f338c6a648c5b3e36c6df0b3c510) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.075484 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 284f6113fa4b443a869bce6d0c15f273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.076181 5623 tablet_replica.cc:333] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:59.076438 5623 raft_consensus.cc:2243] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:59.076718 5623 pending_rounds.cc:70] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:59.076766 5623 pending_rounds.cc:77] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957626396237824 op_type: NO_OP noop_request { }
I20260927 13:49:59.076870 5623 raft_consensus.cc:2889] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:59.076972 5623 raft_consensus.cc:2272] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.078136 5623 ts_tablet_manager.cc:1916] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.079614 5247 raft_consensus.cc:2468] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:59.080869 5606 ts_tablet_manager.cc:1929] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.080947 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 7c2f814bb9ff41ebab19e8c16cf4affa (table default.Table_e02f217077414076ab9e4f74fdd61b36 [id=578e09c772874fefab419fe01b8672b5]) successfully deleted
I20260927 13:49:59.081048 5606 log.cc:1199] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/5b224b590e5c4a2ab26ea7eaeedd976c
W20260927 13:49:59.081238 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 3add644bb1f544e1b3c91fecfd6a541b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3add644bb1f544e1b3c91fecfd6a541b already in progress: creating tablet
I20260927 13:49:59.081393 5606 ts_tablet_manager.cc:1950] T 5b224b590e5c4a2ab26ea7eaeedd976c P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:49:59.081485 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 1a50f61eec39438f9d2b652f0346a0e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a50f61eec39438f9d2b652f0346a0e5 already in progress: creating tablet
W20260927 13:49:59.081699 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a0575418f5ea4d82b34112e1bc9ab8b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0575418f5ea4d82b34112e1bc9ab8b4 already in progress: creating tablet
W20260927 13:49:59.081976 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 45096e907a9c44b7ace81357cdd575d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45096e907a9c44b7ace81357cdd575d4 already in progress: creating tablet
I20260927 13:49:59.082077 6493 tablet_replica.cc:333] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.082290 6493 raft_consensus.cc:2243] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.082444 6493 raft_consensus.cc:2272] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.082950 6493 ts_tablet_manager.cc:1916] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.082230 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 008516a474cc40f2b9de77b2f3e762cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.082542 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 27131f0e8c9e4f1ea290989155ddcd0b (DEFAULT_TABLE table=default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.083732 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27131f0e8c9e4f1ea290989155ddcd0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.082886 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 9855fd321e4b4d0aa37f7b31d7a5efca (DEFAULT_TABLE table=default.Table_d97c60c7dbc6419b8009c1559ca7a49a [id=bb0c608ad0274953b70fb347363f911e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.084049 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9855fd321e4b4d0aa37f7b31d7a5efca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.084340 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 5b224b590e5c4a2ab26ea7eaeedd976c (table default.Table_44d960a4808c41b3857a9d76053fc16a [id=0b26044e99f94ff398a2b411b35887b0]) successfully deleted
W20260927 13:49:59.085377 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 931a48792f4c4525bd563a4dd1062e35 because the tablet was not found. No further retry: Not found: Tablet not found: 931a48792f4c4525bd563a4dd1062e35
I20260927 13:49:59.085994 5606 tablet_replica.cc:333] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:59.086319 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 9855fd321e4b4d0aa37f7b31d7a5efca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.090585 5606 raft_consensus.cc:2243] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.090799 5606 raft_consensus.cc:2272] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.091463 5606 ts_tablet_manager.cc:1916] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.103451 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3c83565e14ba4bdf96fcfceb17acdff3" } modify_external_catalogs: true
I20260927 13:49:59.103720 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3c83565e14ba4bdf96fcfceb17acdff3" } modify_external_catalogs: true
I20260927 13:49:59.112834 5606 ts_tablet_manager.cc:1929] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.112973 5606 log.cc:1199] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/1efaf62692c545dcaa5175fcd826785a
I20260927 13:49:59.117070 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet e26a3a50396940cf826442e4ba7356a8
I20260927 13:49:59.118227 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet e26a3a50396940cf826442e4ba7356a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.119179 5606 ts_tablet_manager.cc:1950] T 1efaf62692c545dcaa5175fcd826785a P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:59.122007 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet e26a3a50396940cf826442e4ba7356a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.122367 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet e26a3a50396940cf826442e4ba7356a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.123047 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 1efaf62692c545dcaa5175fcd826785a (table default.Table_b76c0a83f3804d4fa4fab07460d3b61f [id=27d4534550fd49038bcf9101064bfeb6]) successfully deleted
I20260927 13:49:59.124732 5606 tablet_replica.cc:333] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:59.125787 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 1efaf62692c545dcaa5175fcd826785a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.126901 5606 raft_consensus.cc:2243] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.128213 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b224b590e5c4a2ab26ea7eaeedd976c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.128345 5606 raft_consensus.cc:2272] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.130640 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7512333e245c4b35018961a510efd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.131639 5606 ts_tablet_manager.cc:1916] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.137905 6493 ts_tablet_manager.cc:1929] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.138626 5623 ts_tablet_manager.cc:1929] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 13:49:59.142366 4915 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 9fdef4f56d9647118afe83ac3cd364fd (table default.Table_f9afa72c04394383a22302115766399d [id=c073a79da0b440698186e6856c8c8c68], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9fdef4f56d9647118afe83ac3cd364fd consensus state has no leader
I20260927 13:49:59.145507 6609 raft_consensus.cc:493] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:59.145660 6609 raft_consensus.cc:515] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:59.145884 5319 leader_election.cc:343] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.146303 6609 leader_election.cc:290] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:59.147084 5319 leader_election.cc:343] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.148020 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d7e2b621de8d45e69f6e88b3e51354d5" } modify_external_catalogs: true
I20260927 13:49:59.148200 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_d7e2b621de8d45e69f6e88b3e51354d5" } modify_external_catalogs: true
I20260927 13:49:59.148244 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 9855fd321e4b4d0aa37f7b31d7a5efca (DEFAULT_TABLE table=default.Table_d97c60c7dbc6419b8009c1559ca7a49a [id=bb0c608ad0274953b70fb347363f911e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.148617 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9855fd321e4b4d0aa37f7b31d7a5efca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.151979 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_81d446c6cfde4dd8b7cba22c219df25c" } modify_external_catalogs: true
I20260927 13:49:59.152199 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_81d446c6cfde4dd8b7cba22c219df25c" } modify_external_catalogs: true
I20260927 13:49:59.158986 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 50fb1288684c45f6a778d809a5e2c160
I20260927 13:49:59.160713 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 50fb1288684c45f6a778d809a5e2c160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.164469 5606 ts_tablet_manager.cc:1929] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.164590 5606 log.cc:1199] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/a7a97f4df3a84781bfcbdc768d518ef0
I20260927 13:49:59.164865 5606 ts_tablet_manager.cc:1950] T a7a97f4df3a84781bfcbdc768d518ef0 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:59.166913 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_139a8135a98d4bc08abfa250a55f9d0c" } new_table_name: "default.Table_eedb59651f834988beda0cf22feb1a18" modify_external_catalogs: true
I20260927 13:49:59.173071 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_bd9a1a5ec36343dd86a068a6875fe17d" } new_table_name: "default.Table_ae3b867d65d84e43bb112030a613db25" modify_external_catalogs: true
I20260927 13:49:59.174425 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_22c755d674734bbdaf00ff031dd35bde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.174959 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22c755d674734bbdaf00ff031dd35bde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.175796 6745 tablet.cc:1751] T c332b6ec9ca94ce398a71e82e20897d4 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:59.176175 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_83f977d77c3640b9b7c7c9ccfb96e327"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.176658 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83f977d77c3640b9b7c7c9ccfb96e327 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.178861 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet a7a97f4df3a84781bfcbdc768d518ef0 (table default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]) successfully deleted
W20260927 13:49:59.178964 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a2ee02044b64e3eaff8136ac43f02e4 consensus state has no leader
I20260927 13:49:59.179013 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 2e30216e0487496f8efdb8a3b06deb5a
I20260927 13:49:59.179973 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e30216e0487496f8efdb8a3b06deb5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.180408 5606 tablet_replica.cc:333] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:59.180877 5606 raft_consensus.cc:2243] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.181391 5606 raft_consensus.cc:2272] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.182204 5606 ts_tablet_manager.cc:1916] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.182950 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_7a4d7f5d2d204a5c8a42b30ae9b4623d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:59.183127 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_9f46cb29a3744a8ca0ed3c95c5aaed3a" } new_table_name: "default.Table_a8400e9d55a443c8be9578d5fffea620" modify_external_catalogs: true
W20260927 13:49:59.183482 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a4d7f5d2d204a5c8a42b30ae9b4623d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.184675 6609 raft_consensus.cc:493] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:59.184707 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_11f8a65c84454dc4a2bbe62a385ba8ce" } modify_external_catalogs: true
I20260927 13:49:59.184801 6609 raft_consensus.cc:515] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.184868 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_11f8a65c84454dc4a2bbe62a385ba8ce" } modify_external_catalogs: true
I20260927 13:49:59.185483 6609 leader_election.cc:290] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:59.193290 5606 ts_tablet_manager.cc:1929] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.193475 5606 log.cc:1199] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/9f080b4ca9894eae8305d1548010a6cb
I20260927 13:49:59.193866 5606 ts_tablet_manager.cc:1950] T 9f080b4ca9894eae8305d1548010a6cb P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:59.193940 6493 log.cc:1199] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/da75a470ec0c4ec9afa7c18a51cd7276
I20260927 13:49:59.194285 6493 ts_tablet_manager.cc:1950] T da75a470ec0c4ec9afa7c18a51cd7276 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.194591 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 643) took 1086 ms. Trace:
I20260927 13:49:59.194664 6493 rpcz_store.cc:276] 0927 13:49:58.108311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.110847 (+ 2536us) service_pool.cc:224] Handling call
0927 13:49:59.082020 (+971173us) ts_tablet_manager.cc:1151] Deleting tablet da75a470ec0c4ec9afa7c18a51cd7276
0927 13:49:59.082032 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:59.086011 (+ 3979us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.137848 (+ 51837us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.194575 (+ 56727us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":971028}
I20260927 13:49:59.195108 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet da75a470ec0c4ec9afa7c18a51cd7276 (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]) successfully deleted
I20260927 13:49:59.195444 6493 tablet_replica.cc:333] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.195619 6493 raft_consensus.cc:2243] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.156960 6695 raft_consensus.cc:493] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:59.195994 6695 raft_consensus.cc:515] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.196230 6493 raft_consensus.cc:2272] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.196592 6695 leader_election.cc:290] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:59.196753 6493 ts_tablet_manager.cc:1916] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.165993 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 9855fd321e4b4d0aa37f7b31d7a5efca (DEFAULT_TABLE table=default.Table_d97c60c7dbc6419b8009c1559ca7a49a [id=bb0c608ad0274953b70fb347363f911e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.180187 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 50fb1288684c45f6a778d809a5e2c160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.188877 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e30216e0487496f8efdb8a3b06deb5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.197228 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9855fd321e4b4d0aa37f7b31d7a5efca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.204649 4924 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]). Expected version 1 got 0
I20260927 13:49:59.205456 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4f52702b62174d5a906804a02e82bea5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.206202 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f52702b62174d5a906804a02e82bea5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.207314 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 9f080b4ca9894eae8305d1548010a6cb (table default.Table_98a47a6f58fe457395c7f1accbac44eb [id=42bfb85e0c8f425ea04c34b94ec24c58]) successfully deleted
I20260927 13:49:59.209132 5606 tablet_replica.cc:333] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:59.209708 5606 raft_consensus.cc:2243] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.210207 5606 raft_consensus.cc:2272] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.214679 5606 ts_tablet_manager.cc:1916] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.218752 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_57a1a48cec114fb98010ba314921320d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.219367 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57a1a48cec114fb98010ba314921320d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:59.224151 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 78c4bbb0512c4411916eb4c48731f32f consensus state has no leader
I20260927 13:49:59.224414 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 6964f549d6214ad9a21cf213a9bfa3ce
I20260927 13:49:59.225440 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet 6964f549d6214ad9a21cf213a9bfa3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:59.225930 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc8de5211f7b4d3daa14b825ce17793a consensus state has no leader
I20260927 13:49:59.232263 4924 catalog_manager.cc:5838] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:59.237244 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]). Expected version 1 got 0
I20260927 13:49:59.237849 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 6964f549d6214ad9a21cf213a9bfa3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:59.238767 6746 log.cc:927] Time spent T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260927 13:49:59.238600 4924 catalog_manager.cc:5838] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:59.239403 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:49:59.239717 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 46537e1b33f24d50b705d53f6978da3c (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:49:59.239780 5606 ts_tablet_manager.cc:1929] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.239887 5606 log.cc:1199] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/bb505472de024c2e9b3861f3225b7e40
I20260927 13:49:59.240187 5606 ts_tablet_manager.cc:1950] T bb505472de024c2e9b3861f3225b7e40 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:59.140121 5626 tablet_bootstrap.cc:492] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:59.241259 5626 ts_tablet_manager.cc:1403] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.435s user 0.006s sys 0.011s
I20260927 13:49:59.241246 4930 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_43e6c5c3e28d4a2e825ad7e4c9619888" } modify_external_catalogs: true
I20260927 13:49:59.241492 4930 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_43e6c5c3e28d4a2e825ad7e4c9619888" } modify_external_catalogs: true
I20260927 13:49:59.242067 5626 raft_consensus.cc:359] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.242274 5626 raft_consensus.cc:385] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:59.242331 5626 raft_consensus.cc:740] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:59.242528 5626 consensus_queue.cc:260] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.241323 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet bb505472de024c2e9b3861f3225b7e40 (table default.Table_d936492f977944a59cdb4de68a75c0a8 [id=3bbc5d02a6d14ec98f4377270e60e6fc]) successfully deleted
I20260927 13:49:59.243046 5626 ts_tablet_manager.cc:1434] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:49:59.243359 5626 tablet_bootstrap.cc:492] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:59.245056 5626 tablet_bootstrap.cc:654] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:59.164615 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 50fb1288684c45f6a778d809a5e2c160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.168663 5227 tablet_service.cc:1511] Processing CreateTablet for tablet d7d8e7d09c424b5e81083b0b95a1b704 (DEFAULT_TABLE table=default.Table_3656ebf9c8b64bff8f00bf1941a3aec4 [id=fd3d1f802598418a8d6f740db979940f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.250072 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d8e7d09c424b5e81083b0b95a1b704. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:59.250205 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 9855fd321e4b4d0aa37f7b31d7a5efca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9855fd321e4b4d0aa37f7b31d7a5efca already in progress: creating tablet
I20260927 13:49:59.251124 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6e893d08117849cea8b823b4d752b91b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:59.251241 4929 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_f11cc18b15654825aa1a7da20c318f26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.251732 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e893d08117849cea8b823b4d752b91b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.252261 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_3fb24892ee2347868762b8a77ed1f594"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.252763 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fb24892ee2347868762b8a77ed1f594 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:59.251753 4929 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f11cc18b15654825aa1a7da20c318f26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:59.253059 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 008516a474cc40f2b9de77b2f3e762cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 008516a474cc40f2b9de77b2f3e762cf already in progress: creating tablet
I20260927 13:49:59.188611 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e30216e0487496f8efdb8a3b06deb5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.254292 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2f47a147309843cda12839d088afebef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:59.254314 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_e34a6db37cbf47d79d8f13cd46cc83fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:59.203081 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52050d7e35dc4fbab3c7c079d07478e8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:59.226660 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 6964f549d6214ad9a21cf213a9bfa3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:59.254796 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f47a147309843cda12839d088afebef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:59.254827 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e34a6db37cbf47d79d8f13cd46cc83fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:59.255678 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet e26a3a50396940cf826442e4ba7356a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e26a3a50396940cf826442e4ba7356a8 already in progress: creating tablet
W20260927 13:49:59.255748 5044 leader_election.cc:343] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.256201 4928 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_996a1ca374d349c59a00107c906d5175" } new_table_name: "default.Table_1fbf1fb833ce44d686292862a8964c3a" modify_external_catalogs: true
W20260927 13:49:59.256664 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 50fb1288684c45f6a778d809a5e2c160 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50fb1288684c45f6a778d809a5e2c160 already in progress: creating tablet
W20260927 13:49:59.257453 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2e30216e0487496f8efdb8a3b06deb5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e30216e0487496f8efdb8a3b06deb5a already in progress: creating tablet
W20260927 13:49:59.258186 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 6964f549d6214ad9a21cf213a9bfa3ce because the tablet was not found. No further retry: Not found: Tablet not found: 6964f549d6214ad9a21cf213a9bfa3ce
I20260927 13:49:59.260890 6740 raft_consensus.cc:493] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:59.261292 6740 raft_consensus.cc:515] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.262857 6740 leader_election.cc:290] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:59.263268 5623 log.cc:1199] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/fa9d09ca7952499ba135e15cecb1143e
I20260927 13:49:59.263929 5623 ts_tablet_manager.cc:1950] T fa9d09ca7952499ba135e15cecb1143e P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:59.264492 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2e4f0715e1e94f4ca85d9f6c4fbbbc76" } new_table_name: "default.Table_f91817f1255d4f8fa48accfa3c7c842d" modify_external_catalogs: true
I20260927 13:49:59.270169 4930 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 4bb8dc5aadf243e6838a48f6219b9ae2
I20260927 13:49:59.271663 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:59.272416 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 because the tablet was not found. No further retry: Not found: Tablet not found: 4bb8dc5aadf243e6838a48f6219b9ae2
I20260927 13:49:59.284395 4925 master_service.cc:960] ReplaceTablet: received request to replace tablet 2e768c83fae54619ac849dfedd5ec654 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:59.285307 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.285574 5105 raft_consensus.cc:2468] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:59.240654 4924 catalog_manager.cc:5838] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:59.287652 4924 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_996a1ca374d349c59a00107c906d5175 [id=e60348438be94e88be62039a5ac173b5]). Expected version 2 got 0
W20260927 13:49:59.290428 4928 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20766b5a757e4a7e954c198f8c9ca41f consensus state has no leader
I20260927 13:49:59.292657 6493 ts_tablet_manager.cc:1929] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.292829 6493 log.cc:1199] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f5b2b6f2ce1145a18c199bb37cc7e5b2
I20260927 13:49:59.293293 6493 ts_tablet_manager.cc:1950] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.294158 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 641) took 1186 ms. Trace:
I20260927 13:49:59.294289 6493 rpcz_store.cc:276] 0927 13:49:58.108125 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.113541 (+ 5416us) service_pool.cc:224] Handling call
0927 13:49:59.195381 (+1081840us) ts_tablet_manager.cc:1151] Deleting tablet f5b2b6f2ce1145a18c199bb37cc7e5b2
0927 13:49:59.195390 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:59.200033 (+ 4643us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.292599 (+ 92566us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.294140 (+ 1541us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1081644}
I20260927 13:49:59.294817 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 (table default.Table_88984f1568c54b4398964528d6e45861 [id=661c2995cafa41669d92b0b4549f0cce]) successfully deleted
I20260927 13:49:59.295154 6493 tablet_replica.cc:333] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.295431 6493 raft_consensus.cc:2243] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.295830 6493 raft_consensus.cc:2272] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.296427 6493 ts_tablet_manager.cc:1916] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.291134 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.301192 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2885e0829d014765b54124a0eb23a4dc" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:59.299047 5626 tablet_bootstrap.cc:492] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:59.302356 5626 ts_tablet_manager.cc:1403] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.002s
I20260927 13:49:59.303122 5626 raft_consensus.cc:359] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.303282 5626 raft_consensus.cc:385] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:59.303333 5626 raft_consensus.cc:740] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:59.303566 5626 consensus_queue.cc:260] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.307543 5319 leader_election.cc:304] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:49:59.308113 5319 leader_election.cc:343] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2885e0829d014765b54124a0eb23a4dc
I20260927 13:49:59.308367 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e0e8d6bc744d69a9f41d45459d3b2b" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:59.310249 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet fa9d09ca7952499ba135e15cecb1143e (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]) successfully deleted
I20260927 13:49:59.312527 5086 tablet_service.cc:1511] Processing CreateTablet for tablet d7d8e7d09c424b5e81083b0b95a1b704 (DEFAULT_TABLE table=default.Table_3656ebf9c8b64bff8f00bf1941a3aec4 [id=fd3d1f802598418a8d6f740db979940f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.312894 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d8e7d09c424b5e81083b0b95a1b704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.313220 6493 ts_tablet_manager.cc:1929] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.313308 6493 log.cc:1199] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/2b082227264e442a8b1db7a68fb0c3eb
I20260927 13:49:59.313585 6493 ts_tablet_manager.cc:1950] T 2b082227264e442a8b1db7a68fb0c3eb P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.314045 5626 ts_tablet_manager.cc:1434] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260927 13:49:59.314287 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 644) took 1205 ms. Trace:
I20260927 13:49:59.314354 6493 rpcz_store.cc:276] 0927 13:49:58.108382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.113822 (+ 5440us) service_pool.cc:224] Handling call
0927 13:49:59.295102 (+1181280us) ts_tablet_manager.cc:1151] Deleting tablet 2b082227264e442a8b1db7a68fb0c3eb
0927 13:49:59.295111 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:59.300649 (+ 5538us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.313175 (+ 12526us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.314274 (+ 1099us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1181148}
I20260927 13:49:59.314790 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 2b082227264e442a8b1db7a68fb0c3eb (table default.Table_967519598f9b4c999e93c6f358381116 [id=701057885bc4473193538947593d74e3]) successfully deleted
I20260927 13:49:59.315083 6493 tablet_replica.cc:333] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.315253 6493 raft_consensus.cc:2243] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.315376 6493 raft_consensus.cc:2272] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.317641 6493 ts_tablet_manager.cc:1916] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.319768 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_658c8fe0fb60498296e1a93815016286" } modify_external_catalogs: true
I20260927 13:49:59.320451 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_658c8fe0fb60498296e1a93815016286" } modify_external_catalogs: true
I20260927 13:49:59.326174 6493 ts_tablet_manager.cc:1929] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.326514 6493 log.cc:1199] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/3a07adcd33414d18ae9720e7a307548a
I20260927 13:49:59.326870 6493 ts_tablet_manager.cc:1950] T 3a07adcd33414d18ae9720e7a307548a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.327204 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 645) took 1218 ms. Trace:
I20260927 13:49:59.327342 6493 rpcz_store.cc:276] 0927 13:49:58.108450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.113981 (+ 5531us) service_pool.cc:224] Handling call
0927 13:49:59.315040 (+1201059us) ts_tablet_manager.cc:1151] Deleting tablet 3a07adcd33414d18ae9720e7a307548a
0927 13:49:59.315049 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:59.323192 (+ 8143us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.326094 (+ 2902us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.327188 (+ 1094us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1181067}
I20260927 13:49:59.327917 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 3a07adcd33414d18ae9720e7a307548a (table default.Table_c470b14844004302969f3c3a0802ace8 [id=0a8e61eac14b4098a290333fcc01204e]) successfully deleted
I20260927 13:49:59.328295 6493 tablet_replica.cc:333] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.328531 6493 raft_consensus.cc:2243] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.328747 6493 raft_consensus.cc:2272] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.329706 6493 ts_tablet_manager.cc:1916] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.335999 6493 ts_tablet_manager.cc:1929] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.336172 6493 log.cc:1199] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a813939920244be781d546311fe8a33e
I20260927 13:49:59.336498 6493 ts_tablet_manager.cc:1950] T a813939920244be781d546311fe8a33e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.336809 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 646) took 1228 ms. Trace:
I20260927 13:49:59.337016 6493 rpcz_store.cc:276] 0927 13:49:58.108550 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.114009 (+ 5459us) service_pool.cc:224] Handling call
0927 13:49:59.328245 (+1214236us) ts_tablet_manager.cc:1151] Deleting tablet a813939920244be781d546311fe8a33e
0927 13:49:59.328257 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:59.333023 (+ 4766us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.335948 (+ 2925us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.336795 (+ 847us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1194143}
I20260927 13:49:59.337589 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a813939920244be781d546311fe8a33e (table default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]) successfully deleted
I20260927 13:49:59.338040 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 651) took 1139 ms. Trace:
I20260927 13:49:59.338184 6493 rpcz_store.cc:276] 0927 13:49:58.198923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.199516 (+ 593us) service_pool.cc:224] Handling call
0927 13:49:59.337907 (+1138391us) ts_tablet_manager.cc:1151] Deleting tablet 5a3f40a2da8649e0898c0e09b6e14a61
0927 13:49:59.337916 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:59.338021 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1138236}
I20260927 13:49:59.338518 4925 master_service.cc:960] ReplaceTablet: received request to replace tablet 46537e1b33f24d50b705d53f6978da3c from {username='slave'} at 127.0.0.1:44072
W20260927 13:49:59.339087 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 5a3f40a2da8649e0898c0e09b6e14a61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a3f40a2da8649e0898c0e09b6e14a61 already in progress: creating tablet
I20260927 13:49:59.339484 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 652) took 1129 ms. Trace:
I20260927 13:49:59.339604 6493 rpcz_store.cc:276] 0927 13:49:58.209859 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.209911 (+ 52us) service_pool.cc:224] Handling call
0927 13:49:59.339382 (+1129471us) ts_tablet_manager.cc:1151] Deleting tablet d51c3fa3624340059f6508ced1a2220e
0927 13:49:59.339390 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:59.339470 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1129288}
W20260927 13:49:59.340170 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet d51c3fa3624340059f6508ced1a2220e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d51c3fa3624340059f6508ced1a2220e already in progress: creating tablet
I20260927 13:49:59.340534 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 653) took 1126 ms. Trace:
I20260927 13:49:59.340641 6493 rpcz_store.cc:276] 0927 13:49:58.214085 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.214155 (+ 70us) service_pool.cc:224] Handling call
0927 13:49:59.340431 (+1126276us) ts_tablet_manager.cc:1151] Deleting tablet d3b38f40431f47a0acf1e11092d7717b
0927 13:49:59.340439 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:59.340518 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1126098}
W20260927 13:49:59.341039 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet d3b38f40431f47a0acf1e11092d7717b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3b38f40431f47a0acf1e11092d7717b already in progress: creating tablet
I20260927 13:49:59.341315 6493 tablet_replica.cc:333] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.341522 6493 raft_consensus.cc:2243] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:59.341763 6493 pending_rounds.cc:70] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: Trying to abort 1 pending ops.
I20260927 13:49:59.341845 6493 pending_rounds.cc:77] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957626027364352 op_type: NO_OP noop_request { }
I20260927 13:49:59.341984 6493 raft_consensus.cc:2889] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:59.342136 6493 raft_consensus.cc:2272] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.343032 6493 ts_tablet_manager.cc:1916] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.349314 6493 ts_tablet_manager.cc:1929] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:59.349495 6493 log.cc:1199] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b4f7512333e245c4b35018961a510efd
I20260927 13:49:59.349879 6493 ts_tablet_manager.cc:1950] T b4f7512333e245c4b35018961a510efd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.350227 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 654) took 1131 ms. Trace:
I20260927 13:49:59.350349 6493 rpcz_store.cc:276] 0927 13:49:58.218778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.218842 (+ 64us) service_pool.cc:224] Handling call
0927 13:49:59.341278 (+1122436us) ts_tablet_manager.cc:1151] Deleting tablet b4f7512333e245c4b35018961a510efd
0927 13:49:59.341286 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:59.346292 (+ 5006us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.349266 (+ 2974us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.350212 (+ 946us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1122276}
I20260927 13:49:59.350936 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b4f7512333e245c4b35018961a510efd (table default.Table_6654f7ea3c6c4d07806b732f11f5d352 [id=cdbd4d2971cc4150b7fb0aa966a3a87c]) successfully deleted
I20260927 13:49:59.351280 6493 tablet_replica.cc:333] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.351511 6493 raft_consensus.cc:2243] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.351722 6493 raft_consensus.cc:2272] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.352690 6493 ts_tablet_manager.cc:1916] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.360431 6493 ts_tablet_manager.cc:1929] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.360633 6493 log.cc:1199] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/4211f338c6a648c5b3e36c6df0b3c510
I20260927 13:49:59.360954 6493 ts_tablet_manager.cc:1950] T 4211f338c6a648c5b3e36c6df0b3c510 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.361291 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 655) took 1125 ms. Trace:
I20260927 13:49:59.361433 6493 rpcz_store.cc:276] 0927 13:49:58.236291 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:58.236347 (+ 56us) service_pool.cc:224] Handling call
0927 13:49:59.351233 (+1114886us) ts_tablet_manager.cc:1151] Deleting tablet 4211f338c6a648c5b3e36c6df0b3c510
0927 13:49:59.351243 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:59.357394 (+ 6151us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.360370 (+ 2976us) tablet_metadata.cc:665] Metadata flushed
0927 13:49:59.361272 (+ 902us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1114698}
I20260927 13:49:59.362057 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 4211f338c6a648c5b3e36c6df0b3c510 (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]) successfully deleted
I20260927 13:49:59.362226 6747 tablet.cc:1751] T c332b6ec9ca94ce398a71e82e20897d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:59.362524 6493 tablet_replica.cc:333] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.362785 6493 raft_consensus.cc:2243] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.363013 6493 raft_consensus.cc:2272] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.363576 6493 ts_tablet_manager.cc:1916] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.369359 4922 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fa1834afe3c24278ad9e378c9c237e52" } modify_external_catalogs: true
I20260927 13:49:59.369599 4922 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_fa1834afe3c24278ad9e378c9c237e52" } modify_external_catalogs: true
I20260927 13:49:59.372274 6493 ts_tablet_manager.cc:1929] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:49:59.372443 6493 log.cc:1199] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/931a48792f4c4525bd563a4dd1062e35
I20260927 13:49:59.372799 6493 ts_tablet_manager.cc:1950] T 931a48792f4c4525bd563a4dd1062e35 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.373487 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 931a48792f4c4525bd563a4dd1062e35 (table default.Table_3b7666d87acf47bda3e3e2545c8cfb25 [id=bed97aef149a417bb3807414f58ba52a]) successfully deleted
W20260927 13:49:59.374186 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet db75594e5ee0427a80016bb8a19b6703 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db75594e5ee0427a80016bb8a19b6703 already in progress: creating tablet
I20260927 13:49:59.374544 6493 tablet_replica.cc:333] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.374776 6493 raft_consensus.cc:2243] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.374981 6493 raft_consensus.cc:2272] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.375573 6493 ts_tablet_manager.cc:1916] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.381271 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3d7781d4f12941689327daa8fc4c7ae0" } modify_external_catalogs: true
I20260927 13:49:59.381489 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3d7781d4f12941689327daa8fc4c7ae0" } modify_external_catalogs: true
I20260927 13:49:59.383397 6493 ts_tablet_manager.cc:1929] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:49:59.383524 6493 log.cc:1199] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/74226753751a49fa8ce98eafb2ca1250
I20260927 13:49:59.383857 6493 ts_tablet_manager.cc:1950] T 74226753751a49fa8ce98eafb2ca1250 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.384466 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 74226753751a49fa8ce98eafb2ca1250 (table default.Table_000065d7fd1245df945d5c14cf4b881b [id=8c41592b4b4c4d4b9286336ed3c77b4b]) successfully deleted
I20260927 13:49:59.381300 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_2106fec9f3fd4ed7abfa52fe5960add5" } new_table_name: "default.Table_fbe3019feb804488bb1c921ca74d85d1" modify_external_catalogs: true
W20260927 13:49:59.385207 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 39fa23553c554826ad811ebe2e978ef9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39fa23553c554826ad811ebe2e978ef9 already in progress: creating tablet
W20260927 13:49:59.386562 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a0575418f5ea4d82b34112e1bc9ab8b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0575418f5ea4d82b34112e1bc9ab8b4 already in progress: creating tablet
W20260927 13:49:59.386788 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 284f6113fa4b443a869bce6d0c15f273 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 284f6113fa4b443a869bce6d0c15f273 already in progress: creating tablet
W20260927 13:49:59.387396 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 3add644bb1f544e1b3c91fecfd6a541b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3add644bb1f544e1b3c91fecfd6a541b already in progress: creating tablet
W20260927 13:49:59.388008 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 1a50f61eec39438f9d2b652f0346a0e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a50f61eec39438f9d2b652f0346a0e5 already in progress: creating tablet
I20260927 13:49:59.389356 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_438c450d2fff477aaf6e67a530a1532a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.389923 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_438c450d2fff477aaf6e67a530a1532a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:59.391485 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 45096e907a9c44b7ace81357cdd575d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45096e907a9c44b7ace81357cdd575d4 already in progress: creating tablet
I20260927 13:49:59.391834 6493 tablet_replica.cc:333] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.392072 6493 raft_consensus.cc:2243] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.392288 6493 raft_consensus.cc:2272] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.392935 6493 ts_tablet_manager.cc:1916] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.399783 6493 ts_tablet_manager.cc:1929] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.399960 6493 log.cc:1199] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/3afb800e7ff44aadaed8f8d85aa9efe2
I20260927 13:49:59.400307 6493 ts_tablet_manager.cc:1950] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.400957 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 3afb800e7ff44aadaed8f8d85aa9efe2 (table default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]) successfully deleted
I20260927 13:49:59.401086 6493 tablet_replica.cc:333] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.401279 6493 raft_consensus.cc:2243] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.401446 6493 raft_consensus.cc:2272] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:59.401579 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 9855fd321e4b4d0aa37f7b31d7a5efca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9855fd321e4b4d0aa37f7b31d7a5efca already in progress: creating tablet
W20260927 13:49:59.401803 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 008516a474cc40f2b9de77b2f3e762cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 008516a474cc40f2b9de77b2f3e762cf already in progress: creating tablet
I20260927 13:49:59.401986 6493 ts_tablet_manager.cc:1916] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.420442 6493 ts_tablet_manager.cc:1929] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.422952 4928 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 4a31c060e1af4ebfaadf9d5afd6f7a8d
I20260927 13:49:59.423355 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_835ec246322b4927a1c94badce00f804"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.423955 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_835ec246322b4927a1c94badce00f804 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.425192 4922 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 26a8aca52f8c4566b274d13e6bb13ce5
I20260927 13:49:59.425966 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 329fa4c25cec48f9830a8eb19794ea72
I20260927 13:49:59.427153 4927 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]). Expected version 1 got 0
I20260927 13:49:59.431360 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ba83ebe4eac44519a9ebd65f9a503c58" } modify_external_catalogs: true
I20260927 13:49:59.431571 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_ba83ebe4eac44519a9ebd65f9a503c58" } modify_external_catalogs: true
I20260927 13:49:59.435518 4929 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: default.Table_ba46c52966764f5989cc55eed4059edf [id=db33cf0d6695498f8e5100abb2103d08] alter complete (version 2)
W20260927 13:49:59.435899 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6596ed8c4d44ad58a7ec495a665d1e9 consensus state has no leader
I20260927 13:49:59.435945 4922 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_e6d47becef9f4cfd8311c129ebee35bd" } new_table_name: "default.Table_c13ee5ddbad749ccb5ae5deb842c4715" modify_external_catalogs: true
I20260927 13:49:59.436065 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_05fe23910876400aa7273b1f5e5f84e9" } new_table_name: "default.Table_96ac3db0376145b99e6793ebf9ec550d" modify_external_catalogs: true
I20260927 13:49:59.436297 4926 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_4121f961061a429290fbb458b1059ba0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.436823 4926 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4121f961061a429290fbb458b1059ba0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.437768 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6b5cdd8077ed408991f25cc07e1cb24f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.438299 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b5cdd8077ed408991f25cc07e1cb24f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.442857 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 46537e1b33f24d50b705d53f6978da3c
I20260927 13:49:59.443364 4925 catalog_manager.cc:6934] ReplaceTablet: tablet 46537e1b33f24d50b705d53f6978da3c deleted and replaced by tablet 34cd6225aaf34bdbbec06df453d57301
I20260927 13:49:59.443756 6752 raft_consensus.cc:493] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:59.443902 6752 raft_consensus.cc:515] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.444486 6752 leader_election.cc:290] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:59.445590 4928 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_28a47364bcdf40bf851bc99d3513ca99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:59.446698 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 46537e1b33f24d50b705d53f6978da3c with delete_type TABLET_DATA_DELETED (replaced by tablet 34cd6225aaf34bdbbec06df453d57301) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.448081 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 26a8aca52f8c4566b274d13e6bb13ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
W20260927 13:49:59.448522 4928 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28a47364bcdf40bf851bc99d3513ca99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.449215 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 329fa4c25cec48f9830a8eb19794ea72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.442927 6695 raft_consensus.cc:493] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:59.449579 6695 raft_consensus.cc:515] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.448896 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet 329fa4c25cec48f9830a8eb19794ea72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.449126 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 46537e1b33f24d50b705d53f6978da3c with delete_type TABLET_DATA_DELETED (replaced by tablet 34cd6225aaf34bdbbec06df453d57301) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.450765 6695 leader_election.cc:290] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:49:59.454792 4921 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36314f4c93434b1f8d462aa9d838da78 consensus state has no leader
I20260927 13:49:59.458338 5071 tablet_service.cc:1511] Processing CreateTablet for tablet fe7008e37ce74568943dca179b82f126 (DEFAULT_TABLE table=default.Table_22fb4180565648f68805c7c792bd8f1c [id=20fc9e9a5fdb48918650a29f68c18ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.458748 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7008e37ce74568943dca179b82f126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.459439 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 87802ba0a5fa4c5fb7e34da8621c8593 (DEFAULT_TABLE table=default.Table_83075bfe4fcb4d80b6a90c020b475e1b [id=b5f86a8836f749d5b8761878725da3a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.460137 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 8f0c532e0f064f40a1e2078b81fdc095 (DEFAULT_TABLE table=default.Table_3bd7d29894a24011b97fb7157002b917 [id=c2de98abee2849d9a2517bb6be800706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.460831 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 352aacd4c0984bc0bea7590fa2d7a95a (DEFAULT_TABLE table=default.Table_7925881f0cb44436964ec5d3a85ccb31 [id=a92416af3eac48e0b7a272bdc8bb83c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.461498 5212 tablet_service.cc:1511] Processing CreateTablet for tablet df74edb799ae4aa681072f2041e249fe (DEFAULT_TABLE table=default.Table_1e8d21fc0eb44229a3a03b14792918c7 [id=b20698fb30ef49d9932dd3635df4788e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.462204 5219 tablet_service.cc:1511] Processing CreateTablet for tablet 2cc7301d09b245328a851a0734669965 (DEFAULT_TABLE table=default.Table_be21b5e424724df9868d8ded75617bdb [id=1f268483d3c7447abfe7a024dd0aec58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.462637 5084 tablet_service.cc:1511] Processing CreateTablet for tablet fb8c993214094940968aba3fcc38855c (DEFAULT_TABLE table=default.Table_761013ba2d1f4a3ebfb61cc1e4089f8a [id=254b66d489074ce98c78c6e7dad7a382]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.463032 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8c993214094940968aba3fcc38855c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.465747 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e30216e0487496f8efdb8a3b06deb5a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:59.465849 5249 raft_consensus.cc:3060] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:49:59.466324 5044 leader_election.cc:343] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.465723 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cec272546cb4373bf69e3ab344c46e1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:59.466526 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df74edb799ae4aa681072f2041e249fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:59.467640 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 284f6113fa4b443a869bce6d0c15f273 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 284f6113fa4b443a869bce6d0c15f273 already in progress: creating tablet
I20260927 13:49:59.469152 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 87802ba0a5fa4c5fb7e34da8621c8593 (DEFAULT_TABLE table=default.Table_83075bfe4fcb4d80b6a90c020b475e1b [id=b5f86a8836f749d5b8761878725da3a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.469535 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87802ba0a5fa4c5fb7e34da8621c8593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.470309 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0c532e0f064f40a1e2078b81fdc095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.470538 5214 tablet_service.cc:1511] Processing CreateTablet for tablet fb8c993214094940968aba3fcc38855c (DEFAULT_TABLE table=default.Table_761013ba2d1f4a3ebfb61cc1e4089f8a [id=254b66d489074ce98c78c6e7dad7a382]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.470826 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8c993214094940968aba3fcc38855c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.474129 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 8f0c532e0f064f40a1e2078b81fdc095 (DEFAULT_TABLE table=default.Table_3bd7d29894a24011b97fb7157002b917 [id=c2de98abee2849d9a2517bb6be800706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.474301 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352aacd4c0984bc0bea7590fa2d7a95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.474552 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0c532e0f064f40a1e2078b81fdc095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.474678 4925 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_10bbf85be3e5407c809f9867c6e1bb3f" } modify_external_catalogs: true
I20260927 13:49:59.474877 4925 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_10bbf85be3e5407c809f9867c6e1bb3f" } modify_external_catalogs: true
I20260927 13:49:59.478147 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 352aacd4c0984bc0bea7590fa2d7a95a (DEFAULT_TABLE table=default.Table_7925881f0cb44436964ec5d3a85ccb31 [id=a92416af3eac48e0b7a272bdc8bb83c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.478332 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cc7301d09b245328a851a0734669965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.478579 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352aacd4c0984bc0bea7590fa2d7a95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.478638 5227 tablet_service.cc:1511] Processing CreateTablet for tablet fe7008e37ce74568943dca179b82f126 (DEFAULT_TABLE table=default.Table_22fb4180565648f68805c7c792bd8f1c [id=20fc9e9a5fdb48918650a29f68c18ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.478948 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7008e37ce74568943dca179b82f126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.482304 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87802ba0a5fa4c5fb7e34da8621c8593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.482717 5626 tablet_bootstrap.cc:492] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:59.485085 5075 tablet_service.cc:1511] Processing CreateTablet for tablet df74edb799ae4aa681072f2041e249fe (DEFAULT_TABLE table=default.Table_1e8d21fc0eb44229a3a03b14792918c7 [id=b20698fb30ef49d9932dd3635df4788e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.485419 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df74edb799ae4aa681072f2041e249fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.489537 6752 consensus_queue.cc:1048] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:59.492033 4930 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_39166aa385de4916b3c9aaf6d9133e1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.492722 4930 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39166aa385de4916b3c9aaf6d9133e1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.492009 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_fef73c8f52d144b6ae2358a575f61151"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:59.493722 6695 raft_consensus.cc:493] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:59.493882 6695 raft_consensus.cc:515] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:59.494225 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fef73c8f52d144b6ae2358a575f61151 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.494578 6695 leader_election.cc:290] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:59.495623 4921 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]). Expected version 1 got 0
I20260927 13:49:59.449398 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 26a8aca52f8c4566b274d13e6bb13ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.420586 6493 log.cc:1199] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/0880140d99004eb1803d6b5dcf41af13
I20260927 13:49:59.497465 6493 ts_tablet_manager.cc:1950] T 0880140d99004eb1803d6b5dcf41af13 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.498015 6493 tablet_replica.cc:333] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.498229 6493 raft_consensus.cc:2243] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.498374 6493 raft_consensus.cc:2272] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.498543 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet efd31e3dd142413c92fce2043e053d32 with delete_type TABLET_DATA_DELETED (replaced by tablet 11d48db9b20a41419d5be703190fadd8) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.498510 4921 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_19de48446f02465ca170ad7a349da94d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:59.498876 6493 ts_tablet_manager.cc:1916] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:49:59.499053 4921 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19de48446f02465ca170ad7a349da94d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:59.502566 4754 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 171556us
W20260927 13:49:59.503773 5184 leader_election.cc:343] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b4f7512333e245c4b35018961a510efd
I20260927 13:49:59.499241 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 0880140d99004eb1803d6b5dcf41af13 (table default.Table_8c3b2a8ae18e4aa0a1e71601ac62ea43 [id=4a7f10ca480d42bca8cd7d0e7fe8bd00]) successfully deleted
I20260927 13:49:59.506311 5623 tablet_replica.cc:333] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:59.506501 5623 raft_consensus.cc:2243] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:59.506570 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 008516a474cc40f2b9de77b2f3e762cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 008516a474cc40f2b9de77b2f3e762cf already in progress: creating tablet
I20260927 13:49:59.506632 5623 raft_consensus.cc:2272] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:59.506803 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 9855fd321e4b4d0aa37f7b31d7a5efca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9855fd321e4b4d0aa37f7b31d7a5efca already in progress: creating tablet
W20260927 13:49:59.507063 4916 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet e26a3a50396940cf826442e4ba7356a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e26a3a50396940cf826442e4ba7356a8 already in progress: creating tablet
I20260927 13:49:59.507141 5623 ts_tablet_manager.cc:1916] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.512499 4923 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet b0d6a3af321049b099e72dbfeb6b7a24
I20260927 13:49:59.513882 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet b0d6a3af321049b099e72dbfeb6b7a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.513834 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet b0d6a3af321049b099e72dbfeb6b7a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.516371 6667 consensus_queue.cc:1048] T 1575501a5d1f4b0d80f153cf5bde5fa9 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:59.516882 4923 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_9749d8dab54a412fb6dd1234772d3155"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.517459 4923 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9749d8dab54a412fb6dd1234772d3155 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:49:59.523948 4922 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d237de6ef27c49c4a330c07cb75c103d consensus state has no leader
I20260927 13:49:59.308869 6145 raft_consensus.cc:2804] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:59.311957 5350 tablet_service.cc:1511] Processing CreateTablet for tablet d7d8e7d09c424b5e81083b0b95a1b704 (DEFAULT_TABLE table=default.Table_3656ebf9c8b64bff8f00bf1941a3aec4 [id=fd3d1f802598418a8d6f740db979940f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:59.527220 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 219091us
W20260927 13:49:59.527477 5319 leader_election.cc:343] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2cec272546cb4373bf69e3ab344c46e1
I20260927 13:49:59.527616 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d8e7d09c424b5e81083b0b95a1b704. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:59.528075 5319 leader_election.cc:343] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f3e0e8d6bc744d69a9f41d45459d3b2b
I20260927 13:49:59.536752 6145 raft_consensus.cc:697] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:49:59.537087 6145 consensus_queue.cc:237] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.403818 6740 raft_consensus.cc:493] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:59.430447 5358 tablet_service.cc:1558] Processing DeleteTablet for tablet 26a8aca52f8c4566b274d13e6bb13ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.435545 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet 329fa4c25cec48f9830a8eb19794ea72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.538290 6740 raft_consensus.cc:515] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.440799 5357 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e0e8d6bc744d69a9f41d45459d3b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.440958 5346 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cec272546cb4373bf69e3ab344c46e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.538822 6740 leader_election.cc:290] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:59.441069 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet efd31e3dd142413c92fce2043e053d32 with delete_type TABLET_DATA_DELETED (replaced by tablet 11d48db9b20a41419d5be703190fadd8) from {username='slave'} at 127.0.0.1:50216
W20260927 13:49:59.539059 4917 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 26a8aca52f8c4566b274d13e6bb13ce5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26a8aca52f8c4566b274d13e6bb13ce5 already in progress: creating tablet
I20260927 13:49:59.539109 5606 tablet_replica.cc:333] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:59.539331 5606 raft_consensus.cc:2243] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:49:59.539361 4917 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 329fa4c25cec48f9830a8eb19794ea72 because the tablet was not found. No further retry: Not found: Tablet not found: 329fa4c25cec48f9830a8eb19794ea72
I20260927 13:49:59.539458 5606 raft_consensus.cc:2272] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.441190 5347 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7512333e245c4b35018961a510efd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.441295 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 03a1f13b31934baa8ce18fc499e94806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.539904 5606 ts_tablet_manager.cc:1916] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.445168 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f7512333e245c4b35018961a510efd" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:59.446173 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet 46537e1b33f24d50b705d53f6978da3c with delete_type TABLET_DATA_DELETED (replaced by tablet 34cd6225aaf34bdbbec06df453d57301) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.540200 5382 raft_consensus.cc:2393] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:49:59.450882 6703 raft_consensus.cc:493] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:49:59.455834 5619 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.535s user 0.084s sys 0.130s
I20260927 13:49:59.457687 5362 tablet_service.cc:1511] Processing CreateTablet for tablet fe7008e37ce74568943dca179b82f126 (DEFAULT_TABLE table=default.Table_22fb4180565648f68805c7c792bd8f1c [id=20fc9e9a5fdb48918650a29f68c18ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.541615 6703 raft_consensus.cc:515] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.541913 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7008e37ce74568943dca179b82f126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.464135 5360 tablet_service.cc:1511] Processing CreateTablet for tablet fb8c993214094940968aba3fcc38855c (DEFAULT_TABLE table=default.Table_761013ba2d1f4a3ebfb61cc1e4089f8a [id=254b66d489074ce98c78c6e7dad7a382]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.464510 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 87802ba0a5fa4c5fb7e34da8621c8593 (DEFAULT_TABLE table=default.Table_83075bfe4fcb4d80b6a90c020b475e1b [id=b5f86a8836f749d5b8761878725da3a3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:59.541612 5619 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.620s user 0.084s sys 0.130s
I20260927 13:49:59.464862 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 8f0c532e0f064f40a1e2078b81fdc095 (DEFAULT_TABLE table=default.Table_3bd7d29894a24011b97fb7157002b917 [id=c2de98abee2849d9a2517bb6be800706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.465202 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 352aacd4c0984bc0bea7590fa2d7a95a (DEFAULT_TABLE table=default.Table_7925881f0cb44436964ec5d3a85ccb31 [id=a92416af3eac48e0b7a272bdc8bb83c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.465507 5364 tablet_service.cc:1511] Processing CreateTablet for tablet df74edb799ae4aa681072f2041e249fe (DEFAULT_TABLE table=default.Table_1e8d21fc0eb44229a3a03b14792918c7 [id=b20698fb30ef49d9932dd3635df4788e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.514269 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet b0d6a3af321049b099e72dbfeb6b7a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.441046 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 2885e0829d014765b54124a0eb23a4dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.546368 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_022283b66bf4471691348ed0a603a4c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.546960 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_022283b66bf4471691348ed0a603a4c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.547910 5619 tablet_bootstrap.cc:492] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
W20260927 13:49:59.555090 5319 leader_election.cc:343] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.556463 6682 raft_consensus.cc:493] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:59.556618 6682 raft_consensus.cc:515] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.557310 6682 leader_election.cc:290] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:59.568073 4926 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_761013ba2d1f4a3ebfb61cc1e4089f8a" } new_table_name: "default.Table_afbef315ef9c437c9391fe5b16eabe40" modify_external_catalogs: true
W20260927 13:49:59.576375 5628 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.667s user 0.066s sys 0.112s
W20260927 13:49:59.576496 5628 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.667s user 0.066s sys 0.112s
I20260927 13:49:59.581459 5628 tablet_bootstrap.cc:492] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:59.581645 5628 ts_tablet_manager.cc:1403] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.675s user 0.067s sys 0.112s
I20260927 13:49:59.582613 5628 raft_consensus.cc:359] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.582823 5628 raft_consensus.cc:385] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:59.582882 5628 raft_consensus.cc:740] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:59.583168 5628 consensus_queue.cc:260] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.495419 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d54e51b5c104c75b938aba55cecf890" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:59.540647 5185 leader_election.cc:304] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:59.588138 5185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 47513.2us
W20260927 13:49:59.588841 5044 leader_election.cc:343] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.589319 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:59.591249 5628 ts_tablet_manager.cc:1434] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260927 13:49:59.596837 5628 tablet_bootstrap.cc:492] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:59.599169 5628 tablet_bootstrap.cc:654] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:59.611161 5628 tablet_bootstrap.cc:492] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:59.611306 5628 ts_tablet_manager.cc:1403] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.004s
I20260927 13:49:59.612025 5628 raft_consensus.cc:359] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:59.612191 5628 raft_consensus.cc:385] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:59.612242 5628 raft_consensus.cc:740] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:59.612449 5628 consensus_queue.cc:260] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:59.613124 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet f75847513dcf4c84913a4073176f2507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.616797 5628 ts_tablet_manager.cc:1434] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:49:59.617799 4927 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet f46f45a0a13b4e05802a08880d7f6a01 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]). Expected version 1 got 0
I20260927 13:49:59.618459 5628 tablet_bootstrap.cc:492] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:49:59.618633 4927 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet f46f45a0a13b4e05802a08880d7f6a01 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f46f45a0a13b4e05802a08880d7f6a01 consensus state has no leader
I20260927 13:49:59.619925 5628 tablet_bootstrap.cc:654] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:59.625379 4927 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet f46f45a0a13b4e05802a08880d7f6a01 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]). Expected version 1 got 0
W20260927 13:49:59.628299 4929 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cbacda63c0d3427aabf3332b278576c5 consensus state has no leader
I20260927 13:49:59.589505 5249 raft_consensus.cc:2468] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:59.632937 5044 leader_election.cc:304] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:59.633023 5628 tablet_bootstrap.cc:492] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:59.633212 6695 raft_consensus.cc:2804] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:59.633299 6695 raft_consensus.cc:493] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:59.633370 6695 raft_consensus.cc:3060] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:59.635447 4929 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3e73c785e0d244c3ae23fc951d45174c" } modify_external_catalogs: true
I20260927 13:49:59.635699 4929 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_3e73c785e0d244c3ae23fc951d45174c" } modify_external_catalogs: true
I20260927 13:49:59.636708 6695 raft_consensus.cc:515] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.637681 6695 leader_election.cc:290] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:49:59.637897 5628 ts_tablet_manager.cc:1403] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.005s
I20260927 13:49:59.638180 4927 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5ca3c5799145419794585daecfa39d9b" } modify_external_catalogs: true
I20260927 13:49:59.639268 5628 raft_consensus.cc:359] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.639437 5628 raft_consensus.cc:385] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:59.639498 5628 raft_consensus.cc:740] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:59.639710 5628 consensus_queue.cc:260] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.640595 4927 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5ca3c5799145419794585daecfa39d9b" } modify_external_catalogs: true
I20260927 13:49:59.642063 5628 ts_tablet_manager.cc:1434] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260927 13:49:59.642357 5628 tablet_bootstrap.cc:492] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:59.643656 5628 tablet_bootstrap.cc:654] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:59.647850 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:59.648029 5249 raft_consensus.cc:3060] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:59.649017 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 2cc7301d09b245328a851a0734669965 (DEFAULT_TABLE table=default.Table_be21b5e424724df9868d8ded75617bdb [id=1f268483d3c7447abfe7a024dd0aec58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.649400 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cc7301d09b245328a851a0734669965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.666021 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e1acd618fc44be9169fa1d56fa510a with delete_type TABLET_DATA_DELETED (replaced by tablet 14f5479761f94ee0b339e125d06a808c) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.666361 4928 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_440adeb28a1147c9ae74c2fb6a476219" } modify_external_catalogs: true
I20260927 13:49:59.668550 4928 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_440adeb28a1147c9ae74c2fb6a476219" } modify_external_catalogs: true
I20260927 13:49:59.677284 5249 raft_consensus.cc:2468] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:59.678957 6757 raft_consensus.cc:493] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:59.679073 6757 raft_consensus.cc:515] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.679874 6757 leader_election.cc:290] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:59.679994 6757 raft_consensus.cc:2749] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:59.678865 5626 tablet_bootstrap.cc:654] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:59.682228 6703 leader_election.cc:290] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:59.683336 5619 ts_tablet_manager.cc:1403] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.630s user 0.085s sys 0.130s
I20260927 13:49:59.684512 5619 raft_consensus.cc:359] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.684916 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8c993214094940968aba3fcc38855c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.685184 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352aacd4c0984bc0bea7590fa2d7a95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.685148 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 65d5827b5ffd4ea1abbc94c0431709a8 (DEFAULT_TABLE table=default.Table_e73d23c994cc4762a1a69683c398766c [id=3c902c803fbf4be9a5a49f9f41ce2484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.685654 5619 raft_consensus.cc:385] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:59.685756 5619 raft_consensus.cc:740] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:59.686010 5619 consensus_queue.cc:260] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.686054 5084 tablet_service.cc:1511] Processing CreateTablet for tablet 65d5827b5ffd4ea1abbc94c0431709a8 (DEFAULT_TABLE table=default.Table_e73d23c994cc4762a1a69683c398766c [id=3c902c803fbf4be9a5a49f9f41ce2484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.686518 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d5827b5ffd4ea1abbc94c0431709a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.686697 5619 ts_tablet_manager.cc:1434] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:49:59.686781 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d5827b5ffd4ea1abbc94c0431709a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.687075 5619 tablet_bootstrap.cc:492] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:59.693289 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df74edb799ae4aa681072f2041e249fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.685524 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 2cc7301d09b245328a851a0734669965 (DEFAULT_TABLE table=default.Table_be21b5e424724df9868d8ded75617bdb [id=1f268483d3c7447abfe7a024dd0aec58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.695696 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cc7301d09b245328a851a0734669965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.698375 5084 tablet_service.cc:1511] Processing CreateTablet for tablet 78719428d7b34f28a99722b093f6ab54 (DEFAULT_TABLE table=default.Table_a4d76e32d0c349abafc8f800e4acb8c7 [id=ed8d36823c5c43eaa1e8b0447c7f32e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.698824 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78719428d7b34f28a99722b093f6ab54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.705608 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87802ba0a5fa4c5fb7e34da8621c8593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.706025 5619 tablet_bootstrap.cc:654] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:59.706611 5319 leader_election.cc:304] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:59.708063 6145 raft_consensus.cc:2749] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:59.709080 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 78719428d7b34f28a99722b093f6ab54 (DEFAULT_TABLE table=default.Table_a4d76e32d0c349abafc8f800e4acb8c7 [id=ed8d36823c5c43eaa1e8b0447c7f32e9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:49:59.711653 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 175864us
W20260927 13:49:59.712898 5319 leader_election.cc:343] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.712715 4930 catalog_manager.cc:5838] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:49:59.713091 5319 leader_election.cc:304] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:59.713521 4925 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 417b99e95ab4422d96b606fc76698324
I20260927 13:49:59.714443 4925 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_715d35be476d48169bb2b22804898cac" } new_table_name: "default.Table_16182f7e0f9048b885dc03d5a0f95f13" modify_external_catalogs: true
W20260927 13:49:59.715312 5319 raft_consensus.cc:2686] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:49:59.715850 5360 tablet_service.cc:1558] Processing DeleteTablet for tablet 417b99e95ab4422d96b606fc76698324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.716516 4930 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
I20260927 13:49:59.716596 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 417b99e95ab4422d96b606fc76698324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:59.716091 5319 leader_election.cc:343] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.717134 5319 leader_election.cc:304] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:59.717757 6145 raft_consensus.cc:2749] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:59.716516 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0c532e0f064f40a1e2078b81fdc095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.719839 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78719428d7b34f28a99722b093f6ab54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.728482 5606 ts_tablet_manager.cc:1929] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.728718 5606 log.cc:1199] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/f3e0e8d6bc744d69a9f41d45459d3b2b
I20260927 13:49:59.729106 5606 ts_tablet_manager.cc:1950] T f3e0e8d6bc744d69a9f41d45459d3b2b P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:49:59.730592 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet f3e0e8d6bc744d69a9f41d45459d3b2b (table default.Table_d294f0cb024e426592bf4bf7f261f4be [id=56da4ca311574a50af8ec358752e07a4]) successfully deleted
I20260927 13:49:59.735813 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 1539107b91604cabbd944ee973443137 (DEFAULT_TABLE table=default.Table_4b4079f348f74177a204289b41a9e534 [id=7d48c041dbd342ebb7cf97af67ae636f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.736220 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1539107b91604cabbd944ee973443137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.737251 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52050d7e35dc4fbab3c7c079d07478e8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:59.737594 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e30216e0487496f8efdb8a3b06deb5a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:59.737951 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d54e51b5c104c75b938aba55cecf890" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:59.739094 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 1539107b91604cabbd944ee973443137 (DEFAULT_TABLE table=default.Table_4b4079f348f74177a204289b41a9e534 [id=7d48c041dbd342ebb7cf97af67ae636f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.739506 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1539107b91604cabbd944ee973443137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.740072 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9698b0d8d04b29b73c471fdc5a38d0 (DEFAULT_TABLE table=default.Table_785ec15814b242ab835f0346e5d32b8d [id=0738d99d37cc4005935ac64dd8223c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.740432 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9698b0d8d04b29b73c471fdc5a38d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.742610 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:59.742784 5107 raft_consensus.cc:2468] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:59.747239 5184 leader_election.cc:304] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
W20260927 13:49:59.747753 5184 consensus_peers.cc:597] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b224b590e5c4a2ab26ea7eaeedd976c. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:59.748632 6756 raft_consensus.cc:2804] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260927 13:49:59.748812 6756 raft_consensus.cc:493] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:59.748971 6756 raft_consensus.cc:3060] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:49:59.749607 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 65d5827b5ffd4ea1abbc94c0431709a8 (DEFAULT_TABLE table=default.Table_e73d23c994cc4762a1a69683c398766c [id=3c902c803fbf4be9a5a49f9f41ce2484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.750053 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d5827b5ffd4ea1abbc94c0431709a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.753993 5623 ts_tablet_manager.cc:1929] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.756336 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:59.756561 5381 raft_consensus.cc:2468] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:49:59.770521 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet 417b99e95ab4422d96b606fc76698324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.771013 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 1539107b91604cabbd944ee973443137 (DEFAULT_TABLE table=default.Table_4b4079f348f74177a204289b41a9e534 [id=7d48c041dbd342ebb7cf97af67ae636f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.771411 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1539107b91604cabbd944ee973443137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.772845 5606 tablet_replica.cc:333] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:59.773103 5606 raft_consensus.cc:2243] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.773286 5606 raft_consensus.cc:2272] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.773777 5606 ts_tablet_manager.cc:1916] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.771013 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 78719428d7b34f28a99722b093f6ab54 (DEFAULT_TABLE table=default.Table_a4d76e32d0c349abafc8f800e4acb8c7 [id=ed8d36823c5c43eaa1e8b0447c7f32e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.774258 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78719428d7b34f28a99722b093f6ab54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.775409 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9698b0d8d04b29b73c471fdc5a38d0 (DEFAULT_TABLE table=default.Table_785ec15814b242ab835f0346e5d32b8d [id=0738d99d37cc4005935ac64dd8223c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.775709 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9698b0d8d04b29b73c471fdc5a38d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.778597 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:59.778769 5381 raft_consensus.cc:3060] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:59.781522 5381 raft_consensus.cc:2468] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:49:59.782438 6493 ts_tablet_manager.cc:1929] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.782563 6493 log.cc:1199] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/7dc140bba42a43758fa0c6540d728275
I20260927 13:49:59.782887 6493 ts_tablet_manager.cc:1950] T 7dc140bba42a43758fa0c6540d728275 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:49:59.783969 4916 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 7dc140bba42a43758fa0c6540d728275 (table default.Table_d19f692aecb1401a8f49d2595a038ce8 [id=b16ea2e5189e45a3a195694fdcd8d218]) successfully deleted
I20260927 13:49:59.784552 6756 raft_consensus.cc:515] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.785521 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9698b0d8d04b29b73c471fdc5a38d0 (DEFAULT_TABLE table=default.Table_785ec15814b242ab835f0346e5d32b8d [id=0738d99d37cc4005935ac64dd8223c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.785953 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9698b0d8d04b29b73c471fdc5a38d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.787140 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 (DEFAULT_TABLE table=default.Table_43e6c5c3e28d4a2e825ad7e4c9619888 [id=134a1e291fd642b59af6815b39325d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.787488 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb8dc5aadf243e6838a48f6219b9ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.788743 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 269cda0876e346149512e0b4985c6890 (DEFAULT_TABLE table=default.Table_4384df2328734676b60b16fe84947703 [id=b39f412819df4df0ba22acf8813e397a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.789065 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269cda0876e346149512e0b4985c6890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.810024 5619 tablet_bootstrap.cc:492] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:49:59.810305 5619 ts_tablet_manager.cc:1403] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.123s user 0.005s sys 0.004s
I20260927 13:49:59.811347 5619 raft_consensus.cc:359] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:59.811592 5619 raft_consensus.cc:385] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:59.811697 5619 raft_consensus.cc:740] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:49:59.811933 5619 consensus_queue.cc:260] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:59.812467 5619 ts_tablet_manager.cc:1434] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:59.812767 5619 tablet_bootstrap.cc:492] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:49:59.825678 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_6d74eaa4eb034485b7844e149cb6b14b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.826619 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d74eaa4eb034485b7844e149cb6b14b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.826545 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_36a0d6612db348268c1305cf46302992"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.827018 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36a0d6612db348268c1305cf46302992 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.827126 4921 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_162ac02f5d444371ad6d85becb6b16a0" } new_table_name: "default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1" modify_external_catalogs: true
W20260927 13:49:59.827975 4926 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb8c993214094940968aba3fcc38855c consensus state has no leader
I20260927 13:49:59.828251 4929 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet 7ef5969312044a2bab451841ec65aa84
I20260927 13:49:59.828357 4923 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_06b04cbe300b4373813df57694d32684" } modify_external_catalogs: true
I20260927 13:49:59.828492 4923 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_06b04cbe300b4373813df57694d32684" } modify_external_catalogs: true
I20260927 13:49:59.829015 4929 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_82abe0dde56e49ea9af2bb8ddcfa508d" } new_table_name: "default.Table_36609f3408124349b504ae9eb3275d87" modify_external_catalogs: true
I20260927 13:49:59.830297 4926 master_service.cc:960] ReplaceTablet: received request to replace tablet f04b3a942c404f3894fbbd6ece24a727 from {username='slave'} at 127.0.0.1:44072
I20260927 13:49:59.831588 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 329fa4c25cec48f9830a8eb19794ea72 (DEFAULT_TABLE table=default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.832082 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329fa4c25cec48f9830a8eb19794ea72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.832240 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ef5969312044a2bab451841ec65aa84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.832656 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:49:59.833132 5105 raft_consensus.cc:2393] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:49:59.833978 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ef5969312044a2bab451841ec65aa84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:59.842689 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet e26a3a50396940cf826442e4ba7356a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e26a3a50396940cf826442e4ba7356a8 already in progress: creating tablet
W20260927 13:49:59.843067 5045 leader_election.cc:343] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.843200 5045 leader_election.cc:304] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:59.843401 4916 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 50fb1288684c45f6a778d809a5e2c160 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50fb1288684c45f6a778d809a5e2c160 already in progress: creating tablet
I20260927 13:49:59.843583 6695 raft_consensus.cc:2749] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:59.843660 6493 tablet_replica.cc:333] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:49:59.843854 6493 raft_consensus.cc:2243] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.844018 6493 raft_consensus.cc:2272] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:49:59.844134 5045 leader_election.cc:343] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.844226 5045 leader_election.cc:304] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:49:59.844380 5045 raft_consensus.cc:2686] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:49:59.844520 4927 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a90d9bb192cf4e26812abb9c2ecc3682
W20260927 13:49:59.844841 5045 leader_election.cc:343] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.844947 6493 ts_tablet_manager.cc:1916] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.844937 5045 leader_election.cc:304] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:49:59.845351 6695 raft_consensus.cc:2749] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:49:59.845669 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet a90d9bb192cf4e26812abb9c2ecc3682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.846056 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet a90d9bb192cf4e26812abb9c2ecc3682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
I20260927 13:49:59.850595 4927 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a061fe9a0f414f838517412afe01641f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:49:59.851285 4927 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a061fe9a0f414f838517412afe01641f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.854792 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 269cda0876e346149512e0b4985c6890 (DEFAULT_TABLE table=default.Table_4384df2328734676b60b16fe84947703 [id=b39f412819df4df0ba22acf8813e397a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.855255 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269cda0876e346149512e0b4985c6890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.856894 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 329fa4c25cec48f9830a8eb19794ea72 (DEFAULT_TABLE table=default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.857271 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329fa4c25cec48f9830a8eb19794ea72. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:59.858907 5319 leader_election.cc:343] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: efd31e3dd142413c92fce2043e053d32
I20260927 13:49:59.860683 6145 consensus_queue.cc:1048] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:49:59.796254 5185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 148628us
I20260927 13:49:59.863332 5044 leader_election.cc:304] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:49:59.863624 6695 raft_consensus.cc:2804] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:49:59.863735 6695 raft_consensus.cc:697] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:49:59.863963 6695 consensus_queue.cc:237] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.864306 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:49:59.864482 5382 raft_consensus.cc:2468] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:49:59.865177 6756 leader_election.cc:290] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:49:59.865788 5185 consensus_peers.cc:597] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a -> Peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Couldn't send request to peer bb28c54312c94d7dafb1c2abf7870735. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b224b590e5c4a2ab26ea7eaeedd976c. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:59.804608 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 (DEFAULT_TABLE table=default.Table_43e6c5c3e28d4a2e825ad7e4c9619888 [id=134a1e291fd642b59af6815b39325d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.866779 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:49:59.867000 5382 raft_consensus.cc:3060] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:49:59.867132 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb8dc5aadf243e6838a48f6219b9ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.804998 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 269cda0876e346149512e0b4985c6890 (DEFAULT_TABLE table=default.Table_4384df2328734676b60b16fe84947703 [id=b39f412819df4df0ba22acf8813e397a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.870460 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269cda0876e346149512e0b4985c6890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.870687 5382 raft_consensus.cc:2468] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 2.
I20260927 13:49:59.871330 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:49:59.875104 6682 consensus_queue.cc:1048] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:59.875340 5628 tablet_bootstrap.cc:492] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:59.875449 5628 ts_tablet_manager.cc:1403] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.233s user 0.042s sys 0.068s
I20260927 13:49:59.875775 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 (DEFAULT_TABLE table=default.Table_43e6c5c3e28d4a2e825ad7e4c9619888 [id=134a1e291fd642b59af6815b39325d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.876204 5628 raft_consensus.cc:359] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.876358 5628 raft_consensus.cc:385] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:59.876410 5628 raft_consensus.cc:740] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:59.877012 5628 consensus_queue.cc:260] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.754083 5623 log.cc:1199] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/1efaf62692c545dcaa5175fcd826785a
I20260927 13:49:59.823149 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b0c74e3ff84cc2889de29106c43350" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:59.877454 5248 raft_consensus.cc:2368] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 for earlier term 1. Current term is 2.
I20260927 13:49:59.877482 5628 ts_tablet_manager.cc:1434] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:49:59.877753 5628 tablet_bootstrap.cc:492] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:59.830344 5219 tablet_service.cc:1511] Processing CreateTablet for tablet bad30e7310c842e6818471272f5d669e (DEFAULT_TABLE table=default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.878057 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad30e7310c842e6818471272f5d669e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.878134 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb8dc5aadf243e6838a48f6219b9ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.879140 5628 tablet_bootstrap.cc:654] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:59.880015 5362 tablet_service.cc:1511] Processing CreateTablet for tablet bad30e7310c842e6818471272f5d669e (DEFAULT_TABLE table=default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.880334 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad30e7310c842e6818471272f5d669e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.831193 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 329fa4c25cec48f9830a8eb19794ea72 (DEFAULT_TABLE table=default.Table_3d7781d4f12941689327daa8fc4c7ae0 [id=2ac4a43bb18f4487b18fd38762bee4d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.835045 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd31e3dd142413c92fce2043e053d32" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:59.883261 5249 raft_consensus.cc:2468] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:49:59.835381 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ef5969312044a2bab451841ec65aa84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.883636 6145 raft_consensus.cc:493] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:49:59.883769 6145 raft_consensus.cc:515] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:49:59.884068 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 3002129c9c744881b21da22ddee86589 (DEFAULT_TABLE table=default.Table_69a87aa5933f49eaaa3085e0b505f5ca [id=97c4d9da0cc54c3d842a2001313e9a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.846491 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet a90d9bb192cf4e26812abb9c2ecc3682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.884332 6145 leader_election.cc:290] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:49:59.884423 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3002129c9c744881b21da22ddee86589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.885720 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329fa4c25cec48f9830a8eb19794ea72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.887233 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a1f13b31934baa8ce18fc499e94806" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:49:59.888638 6145 consensus_queue.cc:1048] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:59.889552 6145 consensus_queue.cc:1048] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:49:59.890151 5319 leader_election.cc:343] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 03a1f13b31934baa8ce18fc499e94806
I20260927 13:49:59.890563 6145 consensus_queue.cc:1048] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:59.893193 5606 ts_tablet_manager.cc:1929] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:49:59.894481 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 3002129c9c744881b21da22ddee86589 (DEFAULT_TABLE table=default.Table_69a87aa5933f49eaaa3085e0b505f5ca [id=97c4d9da0cc54c3d842a2001313e9a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.897948 5606 log.cc:1199] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/2cec272546cb4373bf69e3ab344c46e1
I20260927 13:49:59.898207 5084 tablet_service.cc:1511] Processing CreateTablet for tablet bad30e7310c842e6818471272f5d669e (DEFAULT_TABLE table=default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.898614 5606 ts_tablet_manager.cc:1950] T 2cec272546cb4373bf69e3ab344c46e1 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:49:59.898500 4754 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 46013.1us
I20260927 13:49:59.900694 4917 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 2cec272546cb4373bf69e3ab344c46e1 (table default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]) successfully deleted
I20260927 13:49:59.895951 5319 leader_election.cc:400] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) with higher term. Message: Invalid argument: T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 for earlier term 1. Current term is 2.
I20260927 13:49:59.901101 5319 leader_election.cc:403] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260927 13:49:59.901371 6145 raft_consensus.cc:2749] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) with higher term. Message: Invalid argument: T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 for earlier term 1. Current term is 2.
W20260927 13:49:59.901909 5319 consensus_peers.cc:597] T 6aafbbdaa8ac48329ad422cb0c08e518 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:49:59.903018 5319 leader_election.cc:304] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:59.903463 6145 raft_consensus.cc:2804] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:49:59.903637 6145 raft_consensus.cc:493] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:49:59.903836 6145 raft_consensus.cc:3060] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:59.906493 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 6964f549d6214ad9a21cf213a9bfa3ce (DEFAULT_TABLE table=default.Table_11f8a65c84454dc4a2bbe62a385ba8ce [id=0d72a3c29ed24e3a99da4451db6a9fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.906627 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad30e7310c842e6818471272f5d669e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.910279 6145 raft_consensus.cc:515] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.911369 6145 leader_election.cc:290] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:49:59.911803 5364 tablet_service.cc:1511] Processing CreateTablet for tablet 6964f549d6214ad9a21cf213a9bfa3ce (DEFAULT_TABLE table=default.Table_11f8a65c84454dc4a2bbe62a385ba8ce [id=0d72a3c29ed24e3a99da4451db6a9fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.912108 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 3002129c9c744881b21da22ddee86589 (DEFAULT_TABLE table=default.Table_69a87aa5933f49eaaa3085e0b505f5ca [id=97c4d9da0cc54c3d842a2001313e9a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.912315 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6964f549d6214ad9a21cf213a9bfa3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.912724 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3002129c9c744881b21da22ddee86589. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:49:59.918407 5319 leader_election.cc:343] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:49:59.918846 5626 tablet_bootstrap.cc:492] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:49:59.918988 5319 leader_election.cc:304] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:49:59.919986 5626 ts_tablet_manager.cc:1403] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.437s user 0.010s sys 0.003s
I20260927 13:49:59.921839 5623 ts_tablet_manager.cc:1950] T 1efaf62692c545dcaa5175fcd826785a P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:49:59.923123 5606 tablet_replica.cc:333] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:49:59.924461 5628 tablet_bootstrap.cc:492] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:59.924620 5628 ts_tablet_manager.cc:1403] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.047s user 0.008s sys 0.012s
I20260927 13:49:59.925536 5628 raft_consensus.cc:359] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.925691 5628 raft_consensus.cc:385] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:59.925737 5628 raft_consensus.cc:740] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:59.926030 5628 consensus_queue.cc:260] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.926581 5628 ts_tablet_manager.cc:1434] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:49:59.926941 5628 tablet_bootstrap.cc:492] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:59.928206 5606 raft_consensus.cc:2243] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:49:59.928262 5628 tablet_bootstrap.cc:654] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:59.929225 5606 raft_consensus.cc:2272] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.929754 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 6964f549d6214ad9a21cf213a9bfa3ce (DEFAULT_TABLE table=default.Table_11f8a65c84454dc4a2bbe62a385ba8ce [id=0d72a3c29ed24e3a99da4451db6a9fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.929886 5606 ts_tablet_manager.cc:1916] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:49:59.930195 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6964f549d6214ad9a21cf213a9bfa3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:49:59.934446 5623 tablet_replica.cc:333] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:49:59.934773 5623 raft_consensus.cc:2243] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:49:59.936085 4916 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 1efaf62692c545dcaa5175fcd826785a (table default.Table_b76c0a83f3804d4fa4fab07460d3b61f [id=27d4534550fd49038bcf9101064bfeb6]) successfully deleted
I20260927 13:49:59.943326 5626 raft_consensus.cc:359] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.943620 5626 raft_consensus.cc:385] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:59.943737 5626 raft_consensus.cc:740] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:49:59.944152 5626 consensus_queue.cc:260] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.945199 5626 ts_tablet_manager.cc:1434] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260927 13:49:59.945683 5626 tablet_bootstrap.cc:492] T 20766b5a757e4a7e954c198f8c9ca41f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:49:59.932243 5185 leader_election.cc:304] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:49:59.949489 6752 raft_consensus.cc:2804] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Leader election won for term 2
I20260927 13:49:59.949605 6752 raft_consensus.cc:697] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [term 2 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:49:59.949829 6752 consensus_queue.cc:237] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.952040 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd31e3dd142413c92fce2043e053d32" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:49:59.952250 5249 raft_consensus.cc:3060] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:49:59.955283 6770 tablet.cc:1751] T c332b6ec9ca94ce398a71e82e20897d4 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:49:59.968953 4928 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Sending DeleteTablet for 3 replicas of tablet a003afa0fbb74d548cfaba51ea6cef58
I20260927 13:49:59.965584 5623 pending_rounds.cc:70] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:49:59.970584 5219 tablet_service.cc:1511] Processing CreateTablet for tablet eed08fbd918b4b78b6ab8f4099506e29 (DEFAULT_TABLE table=default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:49:59.972345 5628 tablet_bootstrap.cc:492] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:49:59.972484 5628 ts_tablet_manager.cc:1403] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.046s user 0.007s sys 0.001s
W20260927 13:49:59.972927 4925 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e3f7ded9d644d749532e0700844bd62 consensus state has no leader
I20260927 13:49:59.973258 5628 raft_consensus.cc:359] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:49:59.973415 5628 raft_consensus.cc:385] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:49:59.973456 5628 raft_consensus.cc:740] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:49:59.973323 4925 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_a70fd3b1b9fc480586fd49c1d4cc00c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:49:59.973618 5628 consensus_queue.cc:260] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:49:59.973968 4925 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a70fd3b1b9fc480586fd49c1d4cc00c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:49:59.974050 5628 ts_tablet_manager.cc:1434] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 13:49:59.974306 5628 tablet_bootstrap.cc:492] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:49:59.975543 5628 tablet_bootstrap.cc:654] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:49:59.976651 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet a003afa0fbb74d548cfaba51ea6cef58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:50216
I20260927 13:49:59.977566 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet a003afa0fbb74d548cfaba51ea6cef58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:55672
W20260927 13:49:59.978466 5319 leader_election.cc:343] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: efd31e3dd142413c92fce2043e053d32
I20260927 13:49:59.971825 5623 pending_rounds.cc:77] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957626535292928 op_type: NO_OP noop_request { }
I20260927 13:49:59.979632 4928 catalog_manager.cc:5838] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65). New cstate: current_term: 1 leader_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260927 13:49:59.980227 4749 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu pid 4896
I20260927 13:49:59.980474 6703 consensus_queue.cc:1048] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:49:59.981475 4928 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]). Expected version 1 got 0
I20260927 13:49:59.980057 5623 raft_consensus.cc:2889] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:49:59.983397 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet a003afa0fbb74d548cfaba51ea6cef58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39418
I20260927 13:49:59.985469 5623 raft_consensus.cc:2272] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:49:59.956157 5249 raft_consensus.cc:2468] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:49:59.996122 6145 raft_consensus.cc:2749] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.003036 5349 tablet_service.cc:1511] Processing CreateTablet for tablet eed08fbd918b4b78b6ab8f4099506e29 (DEFAULT_TABLE table=default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:00.006840 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 24bd9a95e2d24242aba890ee9d01c023 (DEFAULT_TABLE table=default.Table_e349439f77f540cd8fc369d3f4217757 [id=740644d5da164e1f99a37b02ab614292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:00.010392 5623 ts_tablet_manager.cc:1916] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:00.015563 5086 tablet_service.cc:1511] Processing CreateTablet for tablet eed08fbd918b4b78b6ab8f4099506e29 (DEFAULT_TABLE table=default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:00.016034 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed08fbd918b4b78b6ab8f4099506e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:00.018038 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 24bd9a95e2d24242aba890ee9d01c023 (DEFAULT_TABLE table=default.Table_e349439f77f540cd8fc369d3f4217757 [id=740644d5da164e1f99a37b02ab614292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:00.018415 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bd9a95e2d24242aba890ee9d01c023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:00.036854 4930 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44072:
table { table_name: "default.Table_5972ad040bd64ddda4bf22eac0f03998" } new_table_name: "default.Table_5b64a307e44a471598ef010e33a82fe3" modify_external_catalogs: true
I20260927 13:50:00.052520 4922 master_service.cc:960] ReplaceTablet: received request to replace tablet 12dd91ddaeff4f2a9d7a0761c08fc192 from {username='slave'} at 127.0.0.1:44072
W20260927 13:50:00.057439 5044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 81157.5us
I20260927 13:50:00.057902 6784 consensus_queue.cc:1048] T daeb2045e5d84ed2b51dd88e197e84cb P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:00.058660 5319 leader_election.cc:304] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:00.058866 5619 tablet_bootstrap.cc:654] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:00.062345 5319 raft_consensus.cc:2686] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:50:00.072992 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed08fbd918b4b78b6ab8f4099506e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:00.084717 4922 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_2ce0e4a2f8844a6e8c93e8e94551bd4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:00.085443 4922 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ce0e4a2f8844a6e8c93e8e94551bd4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:00.094720 6493 ts_tablet_manager.cc:1929] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:00.094862 6493 log.cc:1199] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/2e30216e0487496f8efdb8a3b06deb5a
I20260927 13:50:00.095204 6493 ts_tablet_manager.cc:1950] T 2e30216e0487496f8efdb8a3b06deb5a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:00.102248 6783 raft_consensus.cc:493] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.102294 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 5678703b72c8471583147786f49122a5 (DEFAULT_TABLE table=default.Table_2b8dc798fa334079a96ce21a0a5358a0 [id=0d85f9f0d28e43debda43f83a3e59637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:00.102571 6783 raft_consensus.cc:515] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.107048 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3513663de6724b108adcb46cc151163c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:00.112465 6787 raft_consensus.cc:493] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.112696 6787 raft_consensus.cc:515] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.118209 6695 raft_consensus.cc:493] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.118871 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 5678703b72c8471583147786f49122a5 (DEFAULT_TABLE table=default.Table_2b8dc798fa334079a96ce21a0a5358a0 [id=0d85f9f0d28e43debda43f83a3e59637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:00.118875 6695 raft_consensus.cc:515] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.121306 6695 leader_election.cc:290] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.121527 5628 tablet_bootstrap.cc:492] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.121690 5628 ts_tablet_manager.cc:1403] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.147s user 0.023s sys 0.024s
W20260927 13:50:00.113857 5044 leader_election.cc:343] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.123693 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730cd78c7b1a49d892a5ecb46fae0812" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:00.123788 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75847513dcf4c84913a4073176f2507" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:00.125102 6783 leader_election.cc:290] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.133091 6787 leader_election.cc:290] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.138487 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5678703b72c8471583147786f49122a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:00.146637 4924 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "default.Table_d6067ca7e0a04380a6629bf8edeb93d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:00.147559 4924 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6067ca7e0a04380a6629bf8edeb93d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:00.150494 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 24bd9a95e2d24242aba890ee9d01c023 (DEFAULT_TABLE table=default.Table_e349439f77f540cd8fc369d3f4217757 [id=740644d5da164e1f99a37b02ab614292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:00.151029 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bd9a95e2d24242aba890ee9d01c023. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:00.164376 4914 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7e3f7ded9d644d749532e0700844bd62 consensus state has no leader
W20260927 13:50:00.133471 5044 leader_election.cc:343] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:00.170552 5044 leader_election.cc:343] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.172155 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 4c63b0f83c764d179d00cdb8492fea11 (DEFAULT_TABLE table=default.Table_c241bde0378b4e4c9c963550525f9663 [id=dfe83376b8974bc4ba3140869ce88d76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:00.174238 4960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260927 13:50:00.204254 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 5678703b72c8471583147786f49122a5 (DEFAULT_TABLE table=default.Table_2b8dc798fa334079a96ce21a0a5358a0 [id=0d85f9f0d28e43debda43f83a3e59637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:00.204881 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5678703b72c8471583147786f49122a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:00.217968 5606 ts_tablet_manager.cc:1929] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:00.218152 5606 log.cc:1199] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/efd31e3dd142413c92fce2043e053d32
I20260927 13:50:00.223603 5628 raft_consensus.cc:359] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.223852 5628 raft_consensus.cc:385] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.223930 5628 raft_consensus.cc:740] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.224176 5628 consensus_queue.cc:260] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.224836 5628 ts_tablet_manager.cc:1434] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.103s user 0.001s sys 0.001s
I20260927 13:50:00.225190 5628 tablet_bootstrap.cc:492] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.226678 5628 tablet_bootstrap.cc:654] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.250325 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6964f549d6214ad9a21cf213a9bfa3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:00.250651 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bd9a95e2d24242aba890ee9d01c023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:00.250972 5628 tablet_bootstrap.cc:492] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.251145 5628 ts_tablet_manager.cc:1403] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.004s
I20260927 13:50:00.252043 5628 raft_consensus.cc:359] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.252269 5628 raft_consensus.cc:385] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.252345 5628 raft_consensus.cc:740] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.252580 5628 consensus_queue.cc:260] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.255694 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5678703b72c8471583147786f49122a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:00.258482 5628 ts_tablet_manager.cc:1434] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260927 13:50:00.258872 5628 tablet_bootstrap.cc:492] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.261260 5628 tablet_bootstrap.cc:654] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.271369 5606 ts_tablet_manager.cc:1950] T efd31e3dd142413c92fce2043e053d32 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:00.272464 5606 tablet_replica.cc:333] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:00.272475 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c63b0f83c764d179d00cdb8492fea11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:00.272648 5606 raft_consensus.cc:2243] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:00.272796 5606 raft_consensus.cc:2272] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:00.273299 5606 ts_tablet_manager.cc:1916] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:00.279628 5628 tablet_bootstrap.cc:492] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.279824 5628 ts_tablet_manager.cc:1403] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.000s
I20260927 13:50:00.280108 5626 tablet_bootstrap.cc:654] T 20766b5a757e4a7e954c198f8c9ca41f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.280758 5628 raft_consensus.cc:359] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.280992 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed08fbd918b4b78b6ab8f4099506e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:00.280989 5628 raft_consensus.cc:385] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.281050 5628 raft_consensus.cc:740] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.281325 5628 consensus_queue.cc:260] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.281965 5628 ts_tablet_manager.cc:1434] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:00.282344 5628 tablet_bootstrap.cc:492] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.284488 5628 tablet_bootstrap.cc:654] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.286247 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3002129c9c744881b21da22ddee86589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:00.295506 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 674) took 1106 ms. Trace:
I20260927 13:50:00.295619 6493 rpcz_store.cc:276] 0927 13:49:59.188657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.188823 (+ 166us) service_pool.cc:224] Handling call
0927 13:49:59.843616 (+654793us) ts_tablet_manager.cc:1151] Deleting tablet 2e30216e0487496f8efdb8a3b06deb5a
0927 13:49:59.843624 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:49:59.924672 (+ 81048us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.094641 (+169969us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.295477 (+200836us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":646538}
I20260927 13:50:00.296082 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 675) took 1069 ms. Trace:
I20260927 13:50:00.296154 6493 rpcz_store.cc:276] 0927 13:49:59.226654 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.237783 (+ 11129us) service_pool.cc:224] Handling call
0927 13:50:00.295956 (+1058173us) ts_tablet_manager.cc:1151] Deleting tablet 6964f549d6214ad9a21cf213a9bfa3ce
0927 13:50:00.295966 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.296064 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1057948}
I20260927 13:50:00.296882 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 676) took 1024 ms. Trace:
I20260927 13:50:00.296965 6493 rpcz_store.cc:276] 0927 13:49:59.272049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.285236 (+ 13187us) service_pool.cc:224] Handling call
0927 13:50:00.296787 (+1011551us) ts_tablet_manager.cc:1151] Deleting tablet 4bb8dc5aadf243e6838a48f6219b9ae2
0927 13:50:00.296796 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.296869 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1011303}
I20260927 13:50:00.297428 6493 tablet_replica.cc:333] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:00.297628 6493 raft_consensus.cc:2243] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:00.297771 6493 pending_rounds.cc:70] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: Trying to abort 1 pending ops.
I20260927 13:50:00.297818 6493 pending_rounds.cc:77] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957628098961408 op_type: NO_OP noop_request { }
I20260927 13:50:00.297914 6493 raft_consensus.cc:2889] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:00.297999 6493 raft_consensus.cc:2272] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:00.300244 5628 tablet_bootstrap.cc:492] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.300428 5628 ts_tablet_manager.cc:1403] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.004s
I20260927 13:50:00.301347 5628 raft_consensus.cc:359] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.301555 5628 raft_consensus.cc:385] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.301625 5628 raft_consensus.cc:740] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.301873 5628 consensus_queue.cc:260] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.302680 5628 ts_tablet_manager.cc:1434] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260927 13:50:00.303015 5628 tablet_bootstrap.cc:492] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.307734 5628 tablet_bootstrap.cc:654] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.313453 5626 tablet_bootstrap.cc:492] T 20766b5a757e4a7e954c198f8c9ca41f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.313683 5626 ts_tablet_manager.cc:1403] T 20766b5a757e4a7e954c198f8c9ca41f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.368s user 0.005s sys 0.009s
I20260927 13:50:00.314493 5626 raft_consensus.cc:359] T 20766b5a757e4a7e954c198f8c9ca41f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.314745 5626 raft_consensus.cc:385] T 20766b5a757e4a7e954c198f8c9ca41f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.314842 5626 raft_consensus.cc:740] T 20766b5a757e4a7e954c198f8c9ca41f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.315138 5626 consensus_queue.cc:260] T 20766b5a757e4a7e954c198f8c9ca41f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.321131 5626 ts_tablet_manager.cc:1434] T 20766b5a757e4a7e954c198f8c9ca41f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260927 13:50:00.325455 6787 raft_consensus.cc:493] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.326015 6787 raft_consensus.cc:515] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.326705 6787 leader_election.cc:290] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.329110 5626 tablet_bootstrap.cc:492] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.331597 5606 ts_tablet_manager.cc:1929] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:00.331789 5606 log.cc:1199] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b4f7512333e245c4b35018961a510efd
I20260927 13:50:00.332418 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fb1288684c45f6a778d809a5e2c160" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:00.335069 5044 leader_election.cc:343] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.335258 5623 ts_tablet_manager.cc:1929] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:00.335363 5623 log.cc:1199] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/5b224b590e5c4a2ab26ea7eaeedd976c
I20260927 13:50:00.335738 5623 ts_tablet_manager.cc:1950] T 5b224b590e5c4a2ab26ea7eaeedd976c P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:00.336584 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 673) took 1208 ms. Trace:
I20260927 13:50:00.336689 5623 rpcz_store.cc:276] 0927 13:49:59.128102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.128161 (+ 59us) service_pool.cc:224] Handling call
0927 13:49:59.934364 (+806203us) ts_tablet_manager.cc:1151] Deleting tablet 5b224b590e5c4a2ab26ea7eaeedd976c
0927 13:49:59.934374 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.294987 (+360613us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.335201 (+ 40214us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.336563 (+ 1362us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":805993}
I20260927 13:50:00.338405 5626 tablet_bootstrap.cc:654] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.338438 5606 ts_tablet_manager.cc:1950] T b4f7512333e245c4b35018961a510efd P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:50:00.339259 6785 log.cc:927] Time spent T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
W20260927 13:50:00.340536 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 272824us
I20260927 13:50:00.341214 6609 consensus_queue.cc:1048] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:00.342424 5623 tablet_replica.cc:333] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:00.342609 5623 raft_consensus.cc:2243] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:00.342737 5623 raft_consensus.cc:2272] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:00.343196 5623 ts_tablet_manager.cc:1916] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:00.345575 5606 tablet_replica.cc:333] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:00.345805 5606 raft_consensus.cc:2243] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:00.346004 5606 raft_consensus.cc:2272] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:00.346359 5628 tablet_bootstrap.cc:492] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.346511 5628 ts_tablet_manager.cc:1403] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.013s
I20260927 13:50:00.347333 5628 raft_consensus.cc:359] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.347558 5628 raft_consensus.cc:385] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.347607 5628 raft_consensus.cc:740] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.347926 5628 consensus_queue.cc:260] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.348726 5628 ts_tablet_manager.cc:1434] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:50:00.349015 5628 tablet_bootstrap.cc:492] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.351290 5628 tablet_bootstrap.cc:654] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.359117 5619 tablet_bootstrap.cc:492] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.359287 5619 ts_tablet_manager.cc:1403] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.547s user 0.004s sys 0.004s
I20260927 13:50:00.368592 5606 ts_tablet_manager.cc:1916] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:00.368827 5619 raft_consensus.cc:359] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.369020 5619 raft_consensus.cc:385] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.369076 5619 raft_consensus.cc:740] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.369271 5619 consensus_queue.cc:260] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.369747 5619 ts_tablet_manager.cc:1434] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260927 13:50:00.370039 5619 tablet_bootstrap.cc:492] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.371968 5628 tablet_bootstrap.cc:492] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.372196 5628 ts_tablet_manager.cc:1403] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.012s
I20260927 13:50:00.373381 5628 raft_consensus.cc:359] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.373667 5628 raft_consensus.cc:385] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.373791 5628 raft_consensus.cc:740] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.374161 5628 consensus_queue.cc:260] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.374960 5626 tablet_bootstrap.cc:492] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.375094 5626 ts_tablet_manager.cc:1403] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.000s
I20260927 13:50:00.375114 5628 ts_tablet_manager.cc:1434] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:00.375537 5628 tablet_bootstrap.cc:492] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.375825 5626 raft_consensus.cc:359] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.375976 5626 raft_consensus.cc:385] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.376022 5626 raft_consensus.cc:740] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.377651 5626 consensus_queue.cc:260] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.379051 6695 raft_consensus.cc:493] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.379182 6695 raft_consensus.cc:515] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.379524 5628 tablet_bootstrap.cc:654] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.379897 6695 leader_election.cc:290] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.381458 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e1acd618fc44be9169fa1d56fa510a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:00.381959 5044 leader_election.cc:343] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.382777 5626 ts_tablet_manager.cc:1434] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 13:50:00.383069 5626 tablet_bootstrap.cc:492] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:00.386577 5319 consensus_peers.cc:597] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:00.386940 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3513663de6724b108adcb46cc151163c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:00.387393 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730cd78c7b1a49d892a5ecb46fae0812" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:00.387763 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75847513dcf4c84913a4073176f2507" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:00.388160 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fb1288684c45f6a778d809a5e2c160" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:00.388870 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e1acd618fc44be9169fa1d56fa510a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:00.389025 6790 raft_consensus.cc:493] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.389271 6790 raft_consensus.cc:515] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.390054 6790 leader_election.cc:290] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:00.391317 5319 consensus_peers.cc:597] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:00.391873 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d3c47755c94148a488782dbc379011" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:00.392027 5045 leader_election.cc:343] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.392140 5045 leader_election.cc:304] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:00.392556 5045 leader_election.cc:343] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.392642 5045 leader_election.cc:304] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:00.392815 5319 leader_election.cc:343] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:00.392943 5045 leader_election.cc:343] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.393016 5045 leader_election.cc:304] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:00.393326 5045 leader_election.cc:343] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.393404 5045 leader_election.cc:304] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:00.393685 5045 leader_election.cc:343] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.393754 5045 leader_election.cc:304] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:00.394100 6783 raft_consensus.cc:2749] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.394268 6783 raft_consensus.cc:2749] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.394381 6783 raft_consensus.cc:2749] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.394390 5619 tablet_bootstrap.cc:654] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.394464 6783 raft_consensus.cc:2749] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.394541 6783 raft_consensus.cc:2749] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.396149 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d3c47755c94148a488782dbc379011" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:00.396322 5106 raft_consensus.cc:2468] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:00.399328 6493 ts_tablet_manager.cc:1916] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:00.421933 6752 raft_consensus.cc:493] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.422124 6752 raft_consensus.cc:515] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.422215 5319 leader_election.cc:304] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:00.422570 6740 raft_consensus.cc:2804] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:00.422693 6740 raft_consensus.cc:493] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:00.422765 6752 leader_election.cc:290] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:00.422822 6740 raft_consensus.cc:3060] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:00.423493 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aafbbdaa8ac48329ad422cb0c08e518" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:00.424196 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aafbbdaa8ac48329ad422cb0c08e518" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:00.424728 5184 leader_election.cc:304] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:00.425244 6752 raft_consensus.cc:2749] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.425628 6740 raft_consensus.cc:515] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.426244 6740 leader_election.cc:290] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:00.427042 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d3c47755c94148a488782dbc379011" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:00.427969 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d3c47755c94148a488782dbc379011" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:00.428180 5107 raft_consensus.cc:3060] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:00.431144 5107 raft_consensus.cc:2468] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:50:00.431762 5319 leader_election.cc:343] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.432191 5319 leader_election.cc:304] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:00.432468 6740 raft_consensus.cc:2804] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:00.432611 6740 raft_consensus.cc:697] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:00.433115 6740 consensus_queue.cc:237] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.438050 5248 raft_consensus.cc:3060] T 20766b5a757e4a7e954c198f8c9ca41f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:00.442239 4754 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 132530us
I20260927 13:50:00.446472 6740 consensus_queue.cc:1048] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:00.451200 6740 raft_consensus.cc:493] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.451354 6740 raft_consensus.cc:515] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.451927 6740 leader_election.cc:290] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:00.452739 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fa4870d5547a2bbffe1745b964504" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:00.454069 5319 leader_election.cc:343] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 5e3fa4870d5547a2bbffe1745b964504
W20260927 13:50:00.454276 5319 leader_election.cc:343] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.454375 5319 leader_election.cc:304] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:00.455299 6740 raft_consensus.cc:2749] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.458303 5626 tablet_bootstrap.cc:654] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.462792 5619 tablet_bootstrap.cc:492] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.462953 5619 ts_tablet_manager.cc:1403] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.093s user 0.028s sys 0.045s
I20260927 13:50:00.463549 5628 tablet_bootstrap.cc:492] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.463866 5628 ts_tablet_manager.cc:1403] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.088s user 0.022s sys 0.025s
I20260927 13:50:00.463752 5619 raft_consensus.cc:359] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.463971 5619 raft_consensus.cc:385] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.464041 5619 raft_consensus.cc:740] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.464268 5619 consensus_queue.cc:260] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.464666 5628 raft_consensus.cc:359] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.464823 5619 ts_tablet_manager.cc:1434] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:00.464830 5628 raft_consensus.cc:385] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.464890 5628 raft_consensus.cc:740] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.465154 5619 tablet_bootstrap.cc:492] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.466910 5619 tablet_bootstrap.cc:654] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.468673 5606 ts_tablet_manager.cc:1929] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:00.468767 5619 tablet_bootstrap.cc:492] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.468918 5619 ts_tablet_manager.cc:1403] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260927 13:50:00.468968 5606 log.cc:1199] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/03a1f13b31934baa8ce18fc499e94806
I20260927 13:50:00.469416 5606 ts_tablet_manager.cc:1950] T 03a1f13b31934baa8ce18fc499e94806 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:00.469759 5619 raft_consensus.cc:359] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.469956 5619 raft_consensus.cc:385] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.470019 5619 raft_consensus.cc:740] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.470270 5619 consensus_queue.cc:260] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.470945 5619 ts_tablet_manager.cc:1434] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:00.471223 5619 tablet_bootstrap.cc:492] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.473170 5619 tablet_bootstrap.cc:654] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.474274 5623 ts_tablet_manager.cc:1929] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:00.474455 5623 log.cc:1199] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b4f7512333e245c4b35018961a510efd
I20260927 13:50:00.474851 5623 ts_tablet_manager.cc:1950] T b4f7512333e245c4b35018961a510efd P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:00.475653 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 674) took 1345 ms. Trace:
I20260927 13:50:00.475805 5623 rpcz_store.cc:276] 0927 13:49:59.130540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.130592 (+ 52us) service_pool.cc:224] Handling call
0927 13:50:00.342379 (+1211787us) ts_tablet_manager.cc:1151] Deleting tablet b4f7512333e245c4b35018961a510efd
0927 13:50:00.342388 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.431324 (+ 88936us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.474206 (+ 42882us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.475634 (+ 1428us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1211627}
I20260927 13:50:00.476632 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 677) took 1288 ms. Trace:
I20260927 13:50:00.476780 5623 rpcz_store.cc:276] 0927 13:49:59.188459 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.188537 (+ 78us) service_pool.cc:224] Handling call
0927 13:50:00.476502 (+1287965us) ts_tablet_manager.cc:1151] Deleting tablet 2e30216e0487496f8efdb8a3b06deb5a
0927 13:50:00.476513 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.476616 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1222275}
I20260927 13:50:00.482697 5628 consensus_queue.cc:260] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.485512 5628 ts_tablet_manager.cc:1434] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260927 13:50:00.485971 5628 tablet_bootstrap.cc:492] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.487702 5628 tablet_bootstrap.cc:654] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.492851 6790 consensus_queue.cc:1048] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:00.500110 6695 raft_consensus.cc:493] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.500272 6695 raft_consensus.cc:515] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.500876 6695 leader_election.cc:290] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.503113 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46f45a0a13b4e05802a08880d7f6a01" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:00.506016 5045 leader_election.cc:343] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.511719 5619 tablet_bootstrap.cc:492] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.511890 5619 ts_tablet_manager.cc:1403] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.041s user 0.012s sys 0.022s
I20260927 13:50:00.512734 5619 raft_consensus.cc:359] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.512957 5619 raft_consensus.cc:385] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.513032 5619 raft_consensus.cc:740] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.513290 5619 consensus_queue.cc:260] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.516629 6493 ts_tablet_manager.cc:1929] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:00.516780 6493 log.cc:1199] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/46537e1b33f24d50b705d53f6978da3c
I20260927 13:50:00.521199 5619 ts_tablet_manager.cc:1434] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260927 13:50:00.525080 5619 tablet_bootstrap.cc:492] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.526993 5619 tablet_bootstrap.cc:654] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.530506 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 682) took 1089 ms. Trace:
I20260927 13:50:00.530606 5606 rpcz_store.cc:276] 0927 13:49:59.440869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.441268 (+ 399us) service_pool.cc:224] Handling call
0927 13:50:00.345530 (+904262us) ts_tablet_manager.cc:1151] Deleting tablet 03a1f13b31934baa8ce18fc499e94806
0927 13:50:00.345540 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.396126 (+ 50586us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.468615 (+ 72489us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.530484 (+ 61869us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":805909}
I20260927 13:50:00.530949 5606 tablet_replica.cc:333] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:00.501781 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46f45a0a13b4e05802a08880d7f6a01" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:00.531757 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 678) took 1305 ms. Trace:
I20260927 13:50:00.531838 5623 rpcz_store.cc:276] 0927 13:49:59.226542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.226606 (+ 64us) service_pool.cc:224] Handling call
0927 13:50:00.531642 (+1305036us) ts_tablet_manager.cc:1151] Deleting tablet 6964f549d6214ad9a21cf213a9bfa3ce
0927 13:50:00.531654 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.531739 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1276813}
I20260927 13:50:00.532306 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 675) took 1370 ms. Trace:
W20260927 13:50:00.532301 5044 leader_election.cc:343] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.532420 5044 leader_election.cc:304] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:00.532385 5623 rpcz_store.cc:276] 0927 13:49:59.161722 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.164549 (+ 2827us) service_pool.cc:224] Handling call
0927 13:50:00.532199 (+1367650us) ts_tablet_manager.cc:1151] Deleting tablet 50fb1288684c45f6a778d809a5e2c160
0927 13:50:00.532208 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.532291 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1273088}
I20260927 13:50:00.508699 5626 tablet_bootstrap.cc:492] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.532748 5626 ts_tablet_manager.cc:1403] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.150s user 0.003s sys 0.000s
I20260927 13:50:00.532951 6695 raft_consensus.cc:2749] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.533538 5626 raft_consensus.cc:359] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.533717 5626 raft_consensus.cc:385] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.533772 5626 raft_consensus.cc:740] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.534029 5626 consensus_queue.cc:260] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.534617 5606 raft_consensus.cc:2243] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:00.534940 5619 tablet_bootstrap.cc:492] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.534970 5606 raft_consensus.cc:2272] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:00.535089 5619 ts_tablet_manager.cc:1403] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260927 13:50:00.535774 5619 raft_consensus.cc:359] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.535928 5619 raft_consensus.cc:385] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.535986 5619 raft_consensus.cc:740] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.536165 5619 consensus_queue.cc:260] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.536500 5606 ts_tablet_manager.cc:1916] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:00.537638 5626 ts_tablet_manager.cc:1434] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:50:00.537925 5626 tablet_bootstrap.cc:492] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.541461 5626 tablet_bootstrap.cc:654] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.543192 5619 ts_tablet_manager.cc:1434] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 13:50:00.544917 6695 raft_consensus.cc:493] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.545083 6695 raft_consensus.cc:515] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.545677 6695 leader_election.cc:290] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.546471 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ca4b429294782a9e6ed496c6dfb72" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:00.546569 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ca4b429294782a9e6ed496c6dfb72" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:00.546881 5619 tablet_bootstrap.cc:492] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:50:00.547019 5045 leader_election.cc:343] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:00.547273 5044 leader_election.cc:343] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.547370 5044 leader_election.cc:304] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:00.547784 6695 raft_consensus.cc:2749] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.548472 5619 tablet_bootstrap.cc:654] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.551765 5606 ts_tablet_manager.cc:1929] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:00.553484 5606 log.cc:1199] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/46537e1b33f24d50b705d53f6978da3c
I20260927 13:50:00.554508 5628 tablet_bootstrap.cc:492] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.554682 5628 ts_tablet_manager.cc:1403] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.069s user 0.009s sys 0.035s
I20260927 13:50:00.555383 5628 raft_consensus.cc:359] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.555608 5628 raft_consensus.cc:385] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.555696 5628 raft_consensus.cc:740] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.556030 5628 consensus_queue.cc:260] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.557480 5619 tablet_bootstrap.cc:492] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.557598 5619 ts_tablet_manager.cc:1403] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260927 13:50:00.558197 5619 raft_consensus.cc:359] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.558341 5619 raft_consensus.cc:385] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.558403 5619 raft_consensus.cc:740] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.558581 5619 consensus_queue.cc:260] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.561110 6695 raft_consensus.cc:493] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.561225 6695 raft_consensus.cc:515] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.561792 6695 leader_election.cc:290] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.562388 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413d863d9a564e5d8325b4479346730d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:00.562373 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413d863d9a564e5d8325b4479346730d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:00.562690 5619 ts_tablet_manager.cc:1434] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:50:00.562673 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 679) took 1291 ms. Trace:
I20260927 13:50:00.562877 5606 ts_tablet_manager.cc:1950] T 46537e1b33f24d50b705d53f6978da3c P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:50:00.562901 5044 leader_election.cc:343] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:00.563090 5045 leader_election.cc:343] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.563167 5045 leader_election.cc:304] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:00.562755 5623 rpcz_store.cc:276] 0927 13:49:59.270918 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.291072 (+ 20154us) service_pool.cc:224] Handling call
0927 13:50:00.562549 (+1271477us) ts_tablet_manager.cc:1151] Deleting tablet 4bb8dc5aadf243e6838a48f6219b9ae2
0927 13:50:00.562560 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.562655 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1262476}
I20260927 13:50:00.563292 5619 tablet_bootstrap.cc:492] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.563510 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 682) took 1116 ms. Trace:
I20260927 13:50:00.563580 5623 rpcz_store.cc:276] 0927 13:49:59.446601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.446651 (+ 50us) service_pool.cc:224] Handling call
0927 13:50:00.563412 (+1116761us) ts_tablet_manager.cc:1151] Deleting tablet 46537e1b33f24d50b705d53f6978da3c
0927 13:50:00.563421 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.563494 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1116592}
I20260927 13:50:00.563692 6695 raft_consensus.cc:2749] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.563855 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 680) took 1121 ms. Trace:
I20260927 13:50:00.563937 5623 rpcz_store.cc:276] 0927 13:49:59.441985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.448036 (+ 6051us) service_pool.cc:224] Handling call
0927 13:50:00.563768 (+1115732us) ts_tablet_manager.cc:1151] Deleting tablet 26a8aca52f8c4566b274d13e6bb13ce5
0927 13:50:00.563776 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.563843 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1115577}
I20260927 13:50:00.564245 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 681) took 1121 ms. Trace:
I20260927 13:50:00.564323 5623 rpcz_store.cc:276] 0927 13:49:59.442614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.449178 (+ 6564us) service_pool.cc:224] Handling call
0927 13:50:00.564157 (+1114979us) ts_tablet_manager.cc:1151] Deleting tablet 329fa4c25cec48f9830a8eb19794ea72
0927 13:50:00.564166 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.564233 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1114838}
I20260927 13:50:00.564563 5623 tablet_replica.cc:333] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:00.564733 5623 raft_consensus.cc:2243] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:00.564900 5623 raft_consensus.cc:2272] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:00.564946 5619 tablet_bootstrap.cc:654] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.565443 5623 ts_tablet_manager.cc:1916] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:00.569067 5628 ts_tablet_manager.cc:1434] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.014s user 0.000s sys 0.001s
I20260927 13:50:00.571522 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 684) took 1125 ms. Trace:
I20260927 13:50:00.571666 5606 rpcz_store.cc:276] 0927 13:49:59.446042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.446095 (+ 53us) service_pool.cc:224] Handling call
0927 13:50:00.530900 (+1084805us) ts_tablet_manager.cc:1151] Deleting tablet 46537e1b33f24d50b705d53f6978da3c
0927 13:50:00.530910 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.540019 (+ 9109us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.551709 (+ 11690us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.571503 (+ 19794us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3483,"tablet-delete.queue_time_us":990753}
I20260927 13:50:00.572366 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 692) took 1058 ms. Trace:
I20260927 13:50:00.572496 5606 rpcz_store.cc:276] 0927 13:49:59.514156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.514215 (+ 59us) service_pool.cc:224] Handling call
0927 13:50:00.572207 (+1057992us) ts_tablet_manager.cc:1151] Deleting tablet b0d6a3af321049b099e72dbfeb6b7a24
0927 13:50:00.572217 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.572352 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1029364}
I20260927 13:50:00.573132 5606 tablet_replica.cc:333] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:00.573364 5606 raft_consensus.cc:2243] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:00.573549 5606 raft_consensus.cc:2272] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:00.573733 5628 tablet_bootstrap.cc:492] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.575383 5628 tablet_bootstrap.cc:654] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.576707 5606 ts_tablet_manager.cc:1916] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:00.577719 6493 ts_tablet_manager.cc:1950] T 46537e1b33f24d50b705d53f6978da3c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:00.578186 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 680) took 1129 ms. Trace:
I20260927 13:50:00.578292 6493 rpcz_store.cc:276] 0927 13:49:59.449030 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.449084 (+ 54us) service_pool.cc:224] Handling call
0927 13:50:00.297383 (+848299us) ts_tablet_manager.cc:1151] Deleting tablet 46537e1b33f24d50b705d53f6978da3c
0927 13:50:00.297390 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.456651 (+159261us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.516546 (+ 59895us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.578164 (+ 61618us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":847008}
I20260927 13:50:00.578996 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 678) took 1130 ms. Trace:
I20260927 13:50:00.579107 6493 rpcz_store.cc:276] 0927 13:49:59.448443 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.449361 (+ 918us) service_pool.cc:224] Handling call
0927 13:50:00.578834 (+1129473us) ts_tablet_manager.cc:1151] Deleting tablet 26a8aca52f8c4566b274d13e6bb13ce5
0927 13:50:00.578846 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.578977 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1081713}
I20260927 13:50:00.579710 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 687) took 1066 ms. Trace:
I20260927 13:50:00.579813 6493 rpcz_store.cc:276] 0927 13:49:59.513730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.513780 (+ 50us) service_pool.cc:224] Handling call
0927 13:50:00.579590 (+1065810us) ts_tablet_manager.cc:1151] Deleting tablet b0d6a3af321049b099e72dbfeb6b7a24
0927 13:50:00.579603 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.579693 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1065073}
I20260927 13:50:00.580354 6493 tablet_replica.cc:333] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:00.580663 6493 raft_consensus.cc:2243] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:00.580848 6493 raft_consensus.cc:2272] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:00.581493 6493 ts_tablet_manager.cc:1916] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:00.583640 5619 tablet_bootstrap.cc:492] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.583768 5619 ts_tablet_manager.cc:1403] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.011s
I20260927 13:50:00.584367 5619 raft_consensus.cc:359] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.584537 5619 raft_consensus.cc:385] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.584587 5619 raft_consensus.cc:740] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.584782 5619 consensus_queue.cc:260] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.585175 5619 ts_tablet_manager.cc:1434] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 13:50:00.585412 5619 tablet_bootstrap.cc:492] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.586997 5619 tablet_bootstrap.cc:654] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.594715 5619 tablet_bootstrap.cc:492] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.594853 5619 ts_tablet_manager.cc:1403] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260927 13:50:00.595561 5619 raft_consensus.cc:359] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.595722 5619 raft_consensus.cc:385] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.595773 5619 raft_consensus.cc:740] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.595966 5619 consensus_queue.cc:260] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.596464 5619 ts_tablet_manager.cc:1434] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:00.596863 5619 tablet_bootstrap.cc:492] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.598549 5619 tablet_bootstrap.cc:654] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.606366 5619 tablet_bootstrap.cc:492] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.606521 5619 ts_tablet_manager.cc:1403] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260927 13:50:00.607236 5619 raft_consensus.cc:359] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.607422 5619 raft_consensus.cc:385] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.607489 5619 raft_consensus.cc:740] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.607759 5619 consensus_queue.cc:260] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.608142 5626 tablet_bootstrap.cc:492] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.608278 5626 ts_tablet_manager.cc:1403] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.000s
I20260927 13:50:00.608299 5619 ts_tablet_manager.cc:1434] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:00.608559 5619 tablet_bootstrap.cc:492] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.608997 5626 raft_consensus.cc:359] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.609164 5626 raft_consensus.cc:385] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.609225 5626 raft_consensus.cc:740] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.609519 5626 consensus_queue.cc:260] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.610219 5619 tablet_bootstrap.cc:654] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.612946 5626 ts_tablet_manager.cc:1434] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:50:00.613294 5626 tablet_bootstrap.cc:492] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.615474 5626 tablet_bootstrap.cc:654] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.623170 5619 tablet_bootstrap.cc:492] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.623303 5619 ts_tablet_manager.cc:1403] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.008s
I20260927 13:50:00.623998 5619 raft_consensus.cc:359] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.624159 5619 raft_consensus.cc:385] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.624220 5619 raft_consensus.cc:740] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.624437 5619 consensus_queue.cc:260] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.624919 5619 ts_tablet_manager.cc:1434] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:00.625275 5619 tablet_bootstrap.cc:492] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.626919 5619 tablet_bootstrap.cc:654] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.631974 6827 raft_consensus.cc:493] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 802b83f09d3445359cfac825cd87c9de)
I20260927 13:50:00.634712 5619 tablet_bootstrap.cc:492] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.634829 5619 ts_tablet_manager.cc:1403] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260927 13:50:00.635924 5619 raft_consensus.cc:359] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.636070 5619 raft_consensus.cc:385] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.636117 5619 raft_consensus.cc:740] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.636294 5619 consensus_queue.cc:260] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.636705 5619 ts_tablet_manager.cc:1434] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:00.637094 5619 tablet_bootstrap.cc:492] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.638689 5619 tablet_bootstrap.cc:654] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.639742 6828 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 802b83f09d3445359cfac825cd87c9de)
I20260927 13:50:00.639827 6827 raft_consensus.cc:515] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:50:00.639997 6828 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:50:00.640900 5606 ts_tablet_manager.cc:1929] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:00.641216 5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 967 } } ignore_live_leader: false dest_uuid: "13a42ae8b95b495c9bcea85d6732cd77" is_pre_election: true
I20260927 13:50:00.641345 6827 leader_election.cc:290] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:50:00.641482 5809 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e421351a34d1463e9773dcebdeebae3c in term 3.
I20260927 13:50:00.642027 6424 leader_election.cc:304] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13a42ae8b95b495c9bcea85d6732cd77, e421351a34d1463e9773dcebdeebae3c; no voters:
I20260927 13:50:00.642377 6827 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260927 13:50:00.642529 6827 raft_consensus.cc:493] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 802b83f09d3445359cfac825cd87c9de)
I20260927 13:50:00.642663 6827 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 3 FOLLOWER]: Advancing to term 4
I20260927 13:50:00.642860 5628 tablet_bootstrap.cc:492] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.643006 5628 ts_tablet_manager.cc:1403] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.069s user 0.028s sys 0.009s
I20260927 13:50:00.643813 5628 raft_consensus.cc:359] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.643994 5628 raft_consensus.cc:385] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.644049 5628 raft_consensus.cc:740] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.644299 5628 consensus_queue.cc:260] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.644747 5628 ts_tablet_manager.cc:1434] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:00.645008 5628 tablet_bootstrap.cc:492] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.646718 5628 tablet_bootstrap.cc:654] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.648407 5606 log.cc:1199] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/2885e0829d014765b54124a0eb23a4dc
I20260927 13:50:00.648747 5606 ts_tablet_manager.cc:1950] T 2885e0829d014765b54124a0eb23a4dc P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:00.652490 5606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50216 (request call id 678) took 1212 ms. Trace:
I20260927 13:50:00.653090 5606 rpcz_store.cc:276] 0927 13:49:59.440445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.441002 (+ 557us) service_pool.cc:224] Handling call
0927 13:50:00.573089 (+1132087us) ts_tablet_manager.cc:1151] Deleting tablet 2885e0829d014765b54124a0eb23a4dc
0927 13:50:00.573097 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.637145 (+ 64048us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.640853 (+ 3708us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.652466 (+ 11613us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1030195}
I20260927 13:50:00.656103 6828 leader_election.cc:290] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:50:00.662015 5626 tablet_bootstrap.cc:492] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.662209 5626 ts_tablet_manager.cc:1403] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.000s
I20260927 13:50:00.662971 5626 raft_consensus.cc:359] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.663141 5626 raft_consensus.cc:385] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.663189 5626 raft_consensus.cc:740] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.663414 5626 consensus_queue.cc:260] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.664000 5626 ts_tablet_manager.cc:1434] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:00.664849 5626 tablet_bootstrap.cc:492] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.666656 5626 tablet_bootstrap.cc:654] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.638053 5623 ts_tablet_manager.cc:1929] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:00.667382 5623 log.cc:1199] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/efd31e3dd142413c92fce2043e053d32
I20260927 13:50:00.667722 5623 ts_tablet_manager.cc:1950] T efd31e3dd142413c92fce2043e053d32 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:00.671013 5626 tablet_bootstrap.cc:492] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.671132 5626 ts_tablet_manager.cc:1403] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260927 13:50:00.671790 5626 raft_consensus.cc:359] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.671947 5626 raft_consensus.cc:385] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.671994 5626 raft_consensus.cc:740] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.672176 5626 consensus_queue.cc:260] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.673035 6493 ts_tablet_manager.cc:1929] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:00.673095 5619 tablet_bootstrap.cc:492] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.673156 6493 log.cc:1199] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f75847513dcf4c84913a4073176f2507
I20260927 13:50:00.673218 5619 ts_tablet_manager.cc:1403] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.001s
I20260927 13:50:00.673470 6493 ts_tablet_manager.cc:1950] T f75847513dcf4c84913a4073176f2507 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:00.674049 5619 raft_consensus.cc:359] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.674266 5619 raft_consensus.cc:385] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.674316 5619 raft_consensus.cc:740] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.674522 5619 consensus_queue.cc:260] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.675015 5619 ts_tablet_manager.cc:1434] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:00.675271 5619 tablet_bootstrap.cc:492] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.680711 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 690) took 1182 ms. Trace:
I20260927 13:50:00.680815 5623 rpcz_store.cc:276] 0927 13:49:59.498432 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.498490 (+ 58us) service_pool.cc:224] Handling call
0927 13:50:00.564525 (+1066035us) ts_tablet_manager.cc:1151] Deleting tablet efd31e3dd142413c92fce2043e053d32
0927 13:50:00.564532 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.589958 (+ 25426us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.637997 (+ 48039us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.680688 (+ 42691us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1065868}
I20260927 13:50:00.681201 5623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39418 (request call id 691) took 1167 ms. Trace:
I20260927 13:50:00.681278 5623 rpcz_store.cc:276] 0927 13:49:59.513764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.513827 (+ 63us) service_pool.cc:224] Handling call
0927 13:50:00.681087 (+1167260us) ts_tablet_manager.cc:1151] Deleting tablet b0d6a3af321049b099e72dbfeb6b7a24
0927 13:50:00.681098 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.681189 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1167063}
I20260927 13:50:00.686769 5626 ts_tablet_manager.cc:1434] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260927 13:50:00.687083 5626 tablet_bootstrap.cc:492] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.688908 5626 tablet_bootstrap.cc:654] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.692878 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 688) took 1079 ms. Trace:
I20260927 13:50:00.693014 6493 rpcz_store.cc:276] 0927 13:49:59.612986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.613060 (+ 74us) service_pool.cc:224] Handling call
0927 13:50:00.580282 (+967222us) ts_tablet_manager.cc:1151] Deleting tablet f75847513dcf4c84913a4073176f2507
0927 13:50:00.580294 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.624562 (+ 44268us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.672978 (+ 48416us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.692846 (+ 19868us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":967010}
I20260927 13:50:00.693442 6493 tablet_replica.cc:333] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:00.693606 6493 raft_consensus.cc:2243] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:00.693755 6493 raft_consensus.cc:2272] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:00.694329 6493 ts_tablet_manager.cc:1916] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:00.699512 6791 raft_consensus.cc:493] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.699685 6791 raft_consensus.cc:515] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.700495 6791 leader_election.cc:290] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:00.703382 5628 tablet_bootstrap.cc:492] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.703534 5628 ts_tablet_manager.cc:1403] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.002s
I20260927 13:50:00.704396 5628 raft_consensus.cc:359] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.704556 5628 raft_consensus.cc:385] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.704612 5628 raft_consensus.cc:740] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.702314 6827 raft_consensus.cc:515] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:50:00.706671 5619 tablet_bootstrap.cc:654] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.708384 6827 leader_election.cc:290] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 4 election: Requested vote from peers 13a42ae8b95b495c9bcea85d6732cd77 (127.4.163.126:42985), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:50:00.708695 5628 consensus_queue.cc:260] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.709782 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f18e00af74e5c811f774d29422351" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:00.712029 5626 tablet_bootstrap.cc:492] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.712170 5626 ts_tablet_manager.cc:1403] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.007s
I20260927 13:50:00.712888 5626 raft_consensus.cc:359] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.713042 5626 raft_consensus.cc:385] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.713083 5626 raft_consensus.cc:740] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.714352 5628 ts_tablet_manager.cc:1434] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 13:50:00.714664 5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e421351a34d1463e9773dcebdeebae3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 967 } } ignore_live_leader: false dest_uuid: "13a42ae8b95b495c9bcea85d6732cd77"
I20260927 13:50:00.714897 5809 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 3 FOLLOWER]: Advancing to term 4
I20260927 13:50:00.715101 5626 consensus_queue.cc:260] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.716049 5626 ts_tablet_manager.cc:1434] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:50:00.716322 5626 tablet_bootstrap.cc:492] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.717927 5809 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e421351a34d1463e9773dcebdeebae3c in term 4.
I20260927 13:50:00.718008 5626 tablet_bootstrap.cc:654] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.721130 5628 tablet_bootstrap.cc:492] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.722400 5619 tablet_bootstrap.cc:492] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.722553 5619 ts_tablet_manager.cc:1403] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.007s
I20260927 13:50:00.723210 5628 tablet_bootstrap.cc:654] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.723299 5619 raft_consensus.cc:359] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.723464 5619 raft_consensus.cc:385] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.723513 5619 raft_consensus.cc:740] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.723798 5619 consensus_queue.cc:260] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:50:00.724699 5319 leader_election.cc:343] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 081f18e00af74e5c811f774d29422351
W20260927 13:50:00.724937 5319 leader_election.cc:343] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.725029 5319 leader_election.cc:304] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:00.729135 5619 ts_tablet_manager.cc:1434] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 13:50:00.731892 6695 raft_consensus.cc:493] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.732067 6695 raft_consensus.cc:515] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.732710 6695 leader_election.cc:290] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.733386 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ee31d13d1a4c3c99b9accb4e4f5cb6" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:00.733594 5619 tablet_bootstrap.cc:492] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.734354 5382 raft_consensus.cc:1240] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Rejecting Update request from peer 34fc5fe0a32d42ab83f4aa6d07341409 for earlier term 1. Current term is 2. Ops: []
I20260927 13:50:00.735381 5619 tablet_bootstrap.cc:654] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:00.735782 5044 leader_election.cc:343] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.737690 6791 raft_consensus.cc:2749] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.738291 6695 raft_consensus.cc:493] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.738386 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ee31d13d1a4c3c99b9accb4e4f5cb6" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:00.738425 6695 raft_consensus.cc:515] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.739063 6695 leader_election.cc:290] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.739187 6695 consensus_queue.cc:1059] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:00.739410 6695 raft_consensus.cc:3055] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Stepping down as leader of term 1
I20260927 13:50:00.739470 6695 raft_consensus.cc:740] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:50:00.739696 6695 consensus_queue.cc:260] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.739981 6695 raft_consensus.cc:3060] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Advancing to term 2
W20260927 13:50:00.742516 5045 leader_election.cc:343] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.742626 5045 leader_election.cc:304] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:00.742976 6784 raft_consensus.cc:2749] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.743650 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bc839e0fc54839a5d06c176760f618" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:00.744217 5045 leader_election.cc:343] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.744706 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bc839e0fc54839a5d06c176760f618" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:00.745179 5044 leader_election.cc:343] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.745311 5626 tablet_bootstrap.cc:492] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.745311 5044 leader_election.cc:304] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:00.745435 5626 ts_tablet_manager.cc:1403] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.001s
I20260927 13:50:00.745695 6784 raft_consensus.cc:2749] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.746225 5626 raft_consensus.cc:359] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.746379 5626 raft_consensus.cc:385] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.746424 5626 raft_consensus.cc:740] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.746615 5626 consensus_queue.cc:260] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.747205 5626 ts_tablet_manager.cc:1434] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:00.747598 5626 tablet_bootstrap.cc:492] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.749215 5626 tablet_bootstrap.cc:654] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.757172 5626 tablet_bootstrap.cc:492] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.757318 5626 ts_tablet_manager.cc:1403] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260927 13:50:00.758046 5626 raft_consensus.cc:359] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.758240 5626 raft_consensus.cc:385] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.758296 5626 raft_consensus.cc:740] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.759720 6493 ts_tablet_manager.cc:1929] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:00.759878 6493 log.cc:1199] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/51e1acd618fc44be9169fa1d56fa510a
I20260927 13:50:00.760236 6493 ts_tablet_manager.cc:1950] T 51e1acd618fc44be9169fa1d56fa510a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:00.760159 5626 consensus_queue.cc:260] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.761123 5626 ts_tablet_manager.cc:1434] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:50:00.761114 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 690) took 1095 ms. Trace:
I20260927 13:50:00.761195 6493 rpcz_store.cc:276] 0927 13:49:59.665875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.665950 (+ 75us) service_pool.cc:224] Handling call
0927 13:50:00.693397 (+1027447us) ts_tablet_manager.cc:1151] Deleting tablet 51e1acd618fc44be9169fa1d56fa510a
0927 13:50:00.693407 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.726440 (+ 33033us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.759616 (+ 33176us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:00.761092 (+ 1476us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1027197}
I20260927 13:50:00.761400 5626 tablet_bootstrap.cc:492] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.761823 6493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55672 (request call id 693) took 1045 ms. Trace:
I20260927 13:50:00.761907 6493 rpcz_store.cc:276] 0927 13:49:59.716311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:49:59.716527 (+ 216us) service_pool.cc:224] Handling call
0927 13:50:00.761695 (+1045168us) ts_tablet_manager.cc:1151] Deleting tablet 417b99e95ab4422d96b606fc76698324
0927 13:50:00.761705 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:00.761807 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1044932}
I20260927 13:50:00.764686 5626 tablet_bootstrap.cc:654] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.765452 6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13a42ae8b95b495c9bcea85d6732cd77" candidate_term: 4 candidate_status { last_received { term: 3 index: 967 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c" is_pre_election: true
I20260927 13:50:00.765993 6467 raft_consensus.cc:2393] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13a42ae8b95b495c9bcea85d6732cd77 in current term 4: Already voted for candidate e421351a34d1463e9773dcebdeebae3c in this term.
I20260927 13:50:00.769869 5619 tablet_bootstrap.cc:492] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.770030 5619 ts_tablet_manager.cc:1403] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.004s
I20260927 13:50:00.770852 5619 raft_consensus.cc:359] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.771021 5619 raft_consensus.cc:385] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.771075 5619 raft_consensus.cc:740] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.771274 5619 consensus_queue.cc:260] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.771382 6424 leader_election.cc:304] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13a42ae8b95b495c9bcea85d6732cd77, e421351a34d1463e9773dcebdeebae3c; no voters:
I20260927 13:50:00.771706 6827 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 4 FOLLOWER]: Leader election won for term 4
I20260927 13:50:00.775803 5619 ts_tablet_manager.cc:1434] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260927 13:50:00.777828 6791 raft_consensus.cc:493] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.777956 6791 raft_consensus.cc:515] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.778538 6791 leader_election.cc:290] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:00.780481 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbeeadecf3b40c28d0e4f63a22eb4f0" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:00.781109 5619 tablet_bootstrap.cc:492] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.783001 5619 tablet_bootstrap.cc:654] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:00.781069 5319 leader_election.cc:343] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:00.783684 5319 leader_election.cc:343] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3bbeeadecf3b40c28d0e4f63a22eb4f0
I20260927 13:50:00.783775 5319 leader_election.cc:304] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:00.784387 6791 raft_consensus.cc:2749] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.784514 5628 tablet_bootstrap.cc:492] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.784617 5626 tablet_bootstrap.cc:492] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.784652 5628 ts_tablet_manager.cc:1403] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.064s user 0.017s sys 0.018s
I20260927 13:50:00.784770 5626 ts_tablet_manager.cc:1403] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260927 13:50:00.785436 5628 raft_consensus.cc:359] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.785602 5628 raft_consensus.cc:385] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.785655 5628 raft_consensus.cc:740] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.785558 5626 raft_consensus.cc:359] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.785740 5626 raft_consensus.cc:385] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.785916 6752 raft_consensus.cc:493] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.786026 6752 raft_consensus.cc:515] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.786538 6752 leader_election.cc:290] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.785797 5626 raft_consensus.cc:740] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.787026 5626 consensus_queue.cc:260] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.787652 5626 ts_tablet_manager.cc:1434] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:00.787899 5626 tablet_bootstrap.cc:492] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:00.787994 5184 leader_election.cc:343] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 03a1f13b31934baa8ce18fc499e94806
I20260927 13:50:00.788084 5628 consensus_queue.cc:260] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:00.788259 5185 leader_election.cc:343] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 03a1f13b31934baa8ce18fc499e94806
I20260927 13:50:00.788385 5185 leader_election.cc:304] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:00.788784 6752 raft_consensus.cc:2749] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.789662 5626 tablet_bootstrap.cc:654] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.797698 5628 ts_tablet_manager.cc:1434] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260927 13:50:00.802440 5628 tablet_bootstrap.cc:492] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.803471 6827 raft_consensus.cc:697] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [term 4 LEADER]: Becoming Leader. State: Replica: e421351a34d1463e9773dcebdeebae3c, State: Running, Role: LEADER
I20260927 13:50:00.804080 6827 consensus_queue.cc:237] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 967, Committed index: 967, Last appended: 3.967, Last appended by leader: 967, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:50:00.807368 5619 tablet_bootstrap.cc:492] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.807513 5619 ts_tablet_manager.cc:1403] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.005s
I20260927 13:50:00.807777 6841 sys_catalog.cc:455] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e421351a34d1463e9773dcebdeebae3c. Latest consensus state: current_term: 4 leader_uuid: "e421351a34d1463e9773dcebdeebae3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:50:00.808192 6841 sys_catalog.cc:458] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: This master's current role is: LEADER
I20260927 13:50:00.808419 5619 raft_consensus.cc:359] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.808624 5619 raft_consensus.cc:385] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.808693 5619 raft_consensus.cc:740] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.808931 5619 consensus_queue.cc:260] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.809458 5619 ts_tablet_manager.cc:1434] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:00.810600 6791 raft_consensus.cc:493] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.810763 6791 raft_consensus.cc:515] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.811520 6791 leader_election.cc:290] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:00.815768 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e30216e0487496f8efdb8a3b06deb5a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:00.816788 5319 leader_election.cc:343] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:00.817035 5319 leader_election.cc:343] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2e30216e0487496f8efdb8a3b06deb5a
I20260927 13:50:00.817129 5319 leader_election.cc:304] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:00.817538 5619 tablet_bootstrap.cc:492] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.818045 6793 raft_consensus.cc:2749] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.819382 5619 tablet_bootstrap.cc:654] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.821012 5626 tablet_bootstrap.cc:492] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.821141 5626 ts_tablet_manager.cc:1403] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.006s
I20260927 13:50:00.821836 5626 raft_consensus.cc:359] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.821992 5626 raft_consensus.cc:385] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.822037 5626 raft_consensus.cc:740] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.822309 5626 consensus_queue.cc:260] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.822921 5626 ts_tablet_manager.cc:1434] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:00.823199 5626 tablet_bootstrap.cc:492] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.824870 5626 tablet_bootstrap.cc:654] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.828110 6695 raft_consensus.cc:493] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.828266 5619 tablet_bootstrap.cc:492] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.828245 6695 raft_consensus.cc:515] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.828388 5619 ts_tablet_manager.cc:1403] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
I20260927 13:50:00.828907 6695 leader_election.cc:290] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:00.829116 5619 raft_consensus.cc:359] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.829268 5619 raft_consensus.cc:385] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.829311 5619 raft_consensus.cc:740] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.829710 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c4bbb0512c4411916eb4c48731f32f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:00.830160 5044 leader_election.cc:343] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.830286 5619 consensus_queue.cc:260] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.834421 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c4bbb0512c4411916eb4c48731f32f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:00.834975 5045 leader_election.cc:343] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.835079 5045 leader_election.cc:304] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:00.835178 6844 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260927 13:50:00.835350 5619 ts_tablet_manager.cc:1434] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 13:50:00.835518 6695 raft_consensus.cc:2749] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.839624 5619 tablet_bootstrap.cc:492] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.842509 5248 raft_consensus.cc:3060] T 6aafbbdaa8ac48329ad422cb0c08e518 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:00.842664 5619 tablet_bootstrap.cc:654] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.844215 5626 tablet_bootstrap.cc:492] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.844355 5626 ts_tablet_manager.cc:1403] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.001s
I20260927 13:50:00.845058 5626 raft_consensus.cc:359] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.845209 5626 raft_consensus.cc:385] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.845259 5626 raft_consensus.cc:740] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.845479 5626 consensus_queue.cc:260] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.846051 5626 ts_tablet_manager.cc:1434] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:00.846349 5626 tablet_bootstrap.cc:492] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.848352 5626 tablet_bootstrap.cc:654] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.850467 5626 tablet_bootstrap.cc:492] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.850579 5626 ts_tablet_manager.cc:1403] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260927 13:50:00.851265 5626 raft_consensus.cc:359] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.851418 5626 raft_consensus.cc:385] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.851462 5626 raft_consensus.cc:740] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.851708 5626 consensus_queue.cc:260] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.852561 5619 tablet_bootstrap.cc:492] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.852689 5619 ts_tablet_manager.cc:1403] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.003s
I20260927 13:50:00.853368 5619 raft_consensus.cc:359] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.853528 5619 raft_consensus.cc:385] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.853577 5619 raft_consensus.cc:740] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.853753 5619 consensus_queue.cc:260] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.858809 5619 ts_tablet_manager.cc:1434] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 13:50:00.863034 5619 tablet_bootstrap.cc:492] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.864741 5619 tablet_bootstrap.cc:654] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.865743 5626 ts_tablet_manager.cc:1434] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20260927 13:50:00.866027 5626 tablet_bootstrap.cc:492] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.867231 5628 tablet_bootstrap.cc:654] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.867508 5626 tablet_bootstrap.cc:654] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.869005 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_85388904282441d09642d64019688c97 [id=00fdc87b0cbf4bc091a92db3004b4397]
I20260927 13:50:00.871374 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]
I20260927 13:50:00.872057 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]
I20260927 13:50:00.873836 5626 tablet_bootstrap.cc:492] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.873973 5626 ts_tablet_manager.cc:1403] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260927 13:50:00.874842 5626 raft_consensus.cc:359] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.875033 5626 raft_consensus.cc:385] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.875095 5626 raft_consensus.cc:740] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.875298 5626 consensus_queue.cc:260] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.876842 5619 tablet_bootstrap.cc:492] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.876973 5619 ts_tablet_manager.cc:1403] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260927 13:50:00.877164 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_65ed372bfab14cbd8ea34e25afdf59d7 [id=064c3328625f4e1faed6cd36616c9af1]
I20260927 13:50:00.877624 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_785ec15814b242ab835f0346e5d32b8d [id=0738d99d37cc4005935ac64dd8223c22]
I20260927 13:50:00.877744 5619 raft_consensus.cc:359] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.877899 5619 raft_consensus.cc:385] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.877949 5619 raft_consensus.cc:740] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.878213 5619 consensus_queue.cc:260] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.878752 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_57a1a48cec114fb98010ba314921320d [id=088c0f2f907244b383fb272aeda50e8d]
I20260927 13:50:00.882978 5619 ts_tablet_manager.cc:1434] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:50:00.883476 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_4f52702b62174d5a906804a02e82bea5 [id=090619527c7644578f4f12e2efcdfade]
I20260927 13:50:00.883963 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]
I20260927 13:50:00.887223 5628 tablet_bootstrap.cc:492] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.887341 5619 tablet_bootstrap.cc:492] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.887395 5628 ts_tablet_manager.cc:1403] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.085s user 0.008s sys 0.004s
I20260927 13:50:00.887835 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_ef6bb2dace3141688f83d3494419f619 [id=09f379b76b2f43c8853cd36c6b52e296]
I20260927 13:50:00.888161 5628 raft_consensus.cc:359] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.888335 5628 raft_consensus.cc:385] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.888403 5628 raft_consensus.cc:740] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.889148 5619 tablet_bootstrap.cc:654] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.889248 5628 consensus_queue.cc:260] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.890491 5626 ts_tablet_manager.cc:1434] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260927 13:50:00.890754 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_985a589956d74837978aa757b2b52b61 [id=0babbde1882745c7ac6712c82da30d17]
I20260927 13:50:00.890945 5626 tablet_bootstrap.cc:492] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.891294 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a02033f4b12c4cdd986cd855cb148309 [id=0c14f160c8ab4321b14a35fc5f8d3b56]
I20260927 13:50:00.892055 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f11cc18b15654825aa1a7da20c318f26 [id=0d0c63fb4b8d4675a1678a59012efe80]
I20260927 13:50:00.898382 5626 tablet_bootstrap.cc:654] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.899545 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_2b8dc798fa334079a96ce21a0a5358a0 [id=0d85f9f0d28e43debda43f83a3e59637]
I20260927 13:50:00.900269 5619 tablet_bootstrap.cc:492] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.900408 5619 ts_tablet_manager.cc:1403] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.001s
I20260927 13:50:00.900938 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_e03f455aec424b9fb05a1503d626ae3a [id=0f6fb382a33d46cc973e8a81ed234faf]
I20260927 13:50:00.901165 5619 raft_consensus.cc:359] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.901320 5619 raft_consensus.cc:385] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.901366 5619 raft_consensus.cc:740] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.901621 5619 consensus_queue.cc:260] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.904246 5619 ts_tablet_manager.cc:1434] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:50:00.904569 5619 tablet_bootstrap.cc:492] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.905772 6793 raft_consensus.cc:493] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.905915 6793 raft_consensus.cc:515] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.906284 5619 tablet_bootstrap.cc:654] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.906512 6793 leader_election.cc:290] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:00.906649 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_ee7a89c46e4f454fb0922cafbc796e8e [id=112cd821498b427fb3b0d517cd0d55f3]
I20260927 13:50:00.907250 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730cd78c7b1a49d892a5ecb46fae0812" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:00.908113 5319 leader_election.cc:343] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.908380 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]
I20260927 13:50:00.908630 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730cd78c7b1a49d892a5ecb46fae0812" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:00.908839 5107 raft_consensus.cc:2468] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:00.908964 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_0956a69da22a495691888f08a70b62dc [id=126aea719ed34308a0742ed1fe5d6970]
I20260927 13:50:00.909365 5319 leader_election.cc:304] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:00.909807 6752 raft_consensus.cc:493] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.909847 6793 raft_consensus.cc:2804] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:00.909919 6793 raft_consensus.cc:493] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:00.909973 6793 raft_consensus.cc:3060] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:00.909960 6752 raft_consensus.cc:515] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.910136 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]
I20260927 13:50:00.910519 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]
I20260927 13:50:00.910691 6752 leader_election.cc:290] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:00.911237 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f8cf2e1f9d84401897db63d0a884c6b1 [id=1828e2f519ae4cbc810509b126d740e7]
I20260927 13:50:00.912281 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_b24ebce499044fc5974be0e77bc778f6 [id=1a584f9450bb4b55aa73495c55b314f0]
I20260927 13:50:00.912665 6793 raft_consensus.cc:515] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.912741 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_fd6ee019e754408fab65109daeb90c0e [id=1ac22cd7afdf47b691add3ee5d043cb1]
I20260927 13:50:00.913175 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_789c5549472f4bf8ab1581eb3903953a [id=1af7add99a3441a5888daac021a65214]
I20260927 13:50:00.913370 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e30216e0487496f8efdb8a3b06deb5a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:00.913515 5382 raft_consensus.cc:2468] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:00.913741 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]
I20260927 13:50:00.914515 5628 ts_tablet_manager.cc:1434] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260927 13:50:00.914583 5185 leader_election.cc:304] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:00.914836 6752 raft_consensus.cc:2804] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:00.914892 6752 raft_consensus.cc:493] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:00.914943 6752 raft_consensus.cc:3060] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:00.915359 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730cd78c7b1a49d892a5ecb46fae0812" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:50:00.916397 5184 leader_election.cc:343] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2e30216e0487496f8efdb8a3b06deb5a
W20260927 13:50:00.916838 5319 leader_election.cc:343] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:00.917847 6752 raft_consensus.cc:515] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:00.919485 5184 leader_election.cc:343] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2e30216e0487496f8efdb8a3b06deb5a
I20260927 13:50:00.919457 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e30216e0487496f8efdb8a3b06deb5a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:00.919621 6752 leader_election.cc:290] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:00.919621 5382 raft_consensus.cc:3060] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:00.923384 5628 tablet_bootstrap.cc:492] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.925105 5382 raft_consensus.cc:2468] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:00.925552 5185 leader_election.cc:304] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:00.925926 6752 raft_consensus.cc:2804] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:00.926177 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730cd78c7b1a49d892a5ecb46fae0812" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:00.926347 5107 raft_consensus.cc:3060] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:00.927102 6793 leader_election.cc:290] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:00.932107 5626 tablet_bootstrap.cc:492] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.932236 5626 ts_tablet_manager.cc:1403] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.041s user 0.006s sys 0.003s
I20260927 13:50:00.932968 5626 raft_consensus.cc:359] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.933123 5626 raft_consensus.cc:385] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.933168 5626 raft_consensus.cc:740] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.933357 5626 consensus_queue.cc:260] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.936299 5626 ts_tablet_manager.cc:1434] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:50:00.936414 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_8d512449c471495286c66f025bfa4621 [id=1ee0716eaa60467ea085de14e7378c76]
I20260927 13:50:00.936609 5626 tablet_bootstrap.cc:492] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.936880 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_be21b5e424724df9868d8ded75617bdb [id=1f268483d3c7447abfe7a024dd0aec58]
I20260927 13:50:00.938326 5626 tablet_bootstrap.cc:654] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.939703 5628 tablet_bootstrap.cc:654] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.941054 5619 tablet_bootstrap.cc:492] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:00.941191 5619 ts_tablet_manager.cc:1403] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.006s
I20260927 13:50:00.941270 5107 raft_consensus.cc:2468] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:00.941931 5619 raft_consensus.cc:359] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.942082 5619 raft_consensus.cc:385] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.942145 5619 raft_consensus.cc:740] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.942233 5319 leader_election.cc:304] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:00.942315 5619 consensus_queue.cc:260] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.944401 6752 raft_consensus.cc:697] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:00.944705 6752 consensus_queue.cc:237] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.945906 6791 raft_consensus.cc:2804] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:00.946036 6791 raft_consensus.cc:697] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:00.946276 6791 consensus_queue.cc:237] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.955603 5628 tablet_bootstrap.cc:492] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:00.955762 5628 ts_tablet_manager.cc:1403] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.001s
I20260927 13:50:00.956470 5628 raft_consensus.cc:359] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.956645 5628 raft_consensus.cc:385] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.956692 5628 raft_consensus.cc:740] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.956935 5628 consensus_queue.cc:260] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.957585 5619 ts_tablet_manager.cc:1434] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260927 13:50:00.958395 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_22fb4180565648f68805c7c792bd8f1c [id=20fc9e9a5fdb48918650a29f68c18ac0]
I20260927 13:50:00.958794 5619 tablet_bootstrap.cc:492] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:00.959359 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_aa475363b82246bcbc00b2b60ce222ae [id=227e1333cf1e4ceeb6ecc6e09b014100]
I20260927 13:50:00.959815 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_c35f0f666c6d4a5ca35fbe71a9d02c70 [id=2308ec26e62146738552b7667770d5b2]
I20260927 13:50:00.960474 5619 tablet_bootstrap.cc:654] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.960480 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_b0b2ff4faec94fc9a83fc6271fd5ec6d [id=23ffbb0d3240465cb12a09ffec1f8163]
I20260927 13:50:00.961666 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]
I20260927 13:50:00.963886 6793 raft_consensus.cc:493] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.964031 6793 raft_consensus.cc:515] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.964385 5626 tablet_bootstrap.cc:492] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:00.964653 6793 leader_election.cc:290] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:00.965297 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a813939920244be781d546311fe8a33e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:00.965394 5626 ts_tablet_manager.cc:1403] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.003s
W20260927 13:50:00.965981 5319 leader_election.cc:343] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:00.966845 5319 leader_election.cc:343] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a813939920244be781d546311fe8a33e
I20260927 13:50:00.966966 5319 leader_election.cc:304] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:00.967447 6793 raft_consensus.cc:2749] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:00.971292 5628 ts_tablet_manager.cc:1434] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260927 13:50:00.974644 5626 raft_consensus.cc:359] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.974848 5626 raft_consensus.cc:385] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:00.974900 5626 raft_consensus.cc:740] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:00.975082 5626 consensus_queue.cc:260] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:00.975481 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_c8c6fcc62dfb4536957573f7a410a94a [id=27533fd9eddb45e5afc90177ac5e78a0]
I20260927 13:50:00.984416 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_28a47364bcdf40bf851bc99d3513ca99 [id=2760dc486ae9433682cee682308534f4]
I20260927 13:50:00.988226 5628 tablet_bootstrap.cc:492] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:00.989500 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f00ce7baf4f147e4bacf7c20efb9064b [id=28e5a27b58044d9ebcf9b33abfe878e0]
I20260927 13:50:00.990278 5628 tablet_bootstrap.cc:654] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.991760 5626 ts_tablet_manager.cc:1434] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260927 13:50:00.992046 5626 tablet_bootstrap.cc:492] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:00.993827 5626 tablet_bootstrap.cc:654] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:00.993819 6791 raft_consensus.cc:493] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:00.993942 6791 raft_consensus.cc:515] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:00.994591 6791 leader_election.cc:290] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:00.995333 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3700a1f40c0644848da62392cb0c297f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:00.995513 5248 raft_consensus.cc:2468] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:00.995983 5319 leader_election.cc:304] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:00.996579 6791 raft_consensus.cc:2804] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:00.996665 6791 raft_consensus.cc:493] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:00.996716 6791 raft_consensus.cc:3060] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:00.999312 6791 raft_consensus.cc:515] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.002689 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f76750964cba404fb197cc254b4ed32a [id=297e14783b0840c5864234841184e17e]
I20260927 13:50:01.003118 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3700a1f40c0644848da62392cb0c297f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:01.003299 5248 raft_consensus.cc:3060] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.004420 6695 raft_consensus.cc:493] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.004494 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_2f47a147309843cda12839d088afebef [id=2c1da9087ada46f083eaa9f1a170761f]
I20260927 13:50:01.004563 6695 raft_consensus.cc:515] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.005146 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_4155d438fc7c4d6cbe87e16451c6bbba [id=2d2e2254587f4832b7ad918724eeea64]
I20260927 13:50:01.005188 6695 leader_election.cc:290] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.005589 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_d6b9b32a54ed4746b880a4ae62ad9ba3 [id=2d2f55956ec141f0b2de4501fbc6c655]
I20260927 13:50:01.006055 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f702b0a6380543a8ac539125d4334cd5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.006630 5248 raft_consensus.cc:2468] T 3700a1f40c0644848da62392cb0c297f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:50:01.006706 5044 leader_election.cc:343] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.007205 5319 leader_election.cc:304] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:50:01.007668 5319 leader_election.cc:343] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3700a1f40c0644848da62392cb0c297f
I20260927 13:50:01.008009 6793 raft_consensus.cc:2804] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.008352 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f702b0a6380543a8ac539125d4334cd5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:01.008877 5045 leader_election.cc:343] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.008981 5045 leader_election.cc:304] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.009357 6695 raft_consensus.cc:2749] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.009814 5626 tablet_bootstrap.cc:492] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.009999 5626 ts_tablet_manager.cc:1403] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.008s
I20260927 13:50:01.010846 5626 raft_consensus.cc:359] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.011102 5626 raft_consensus.cc:385] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.011186 5626 raft_consensus.cc:740] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.011433 5626 consensus_queue.cc:260] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.011772 6695 raft_consensus.cc:493] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.011883 6695 raft_consensus.cc:515] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.012180 6791 leader_election.cc:290] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.012449 6695 leader_election.cc:290] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.013011 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e14fd01a9141cdb2df030ee0dd05db" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.013382 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e14fd01a9141cdb2df030ee0dd05db" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:01.014199 5319 leader_election.cc:343] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3700a1f40c0644848da62392cb0c297f
W20260927 13:50:01.014241 5044 leader_election.cc:343] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:01.018153 5045 leader_election.cc:343] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.018265 5045 leader_election.cc:304] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.018714 6695 raft_consensus.cc:2749] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.019896 5626 ts_tablet_manager.cc:1434] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260927 13:50:01.020263 5626 tablet_bootstrap.cc:492] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.025084 5628 tablet_bootstrap.cc:492] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.025316 5628 ts_tablet_manager.cc:1403] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.002s
I20260927 13:50:01.026412 5628 raft_consensus.cc:359] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.026631 5628 raft_consensus.cc:385] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.026721 5628 raft_consensus.cc:740] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.026988 5628 consensus_queue.cc:260] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.029718 5628 ts_tablet_manager.cc:1434] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 13:50:01.030049 5628 tablet_bootstrap.cc:492] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.031826 5628 tablet_bootstrap.cc:654] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.032590 5626 tablet_bootstrap.cc:654] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.034775 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]
I20260927 13:50:01.036434 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_9749d8dab54a412fb6dd1234772d3155 [id=31e674233f944706b5ad3362d0c2db06]
I20260927 13:50:01.037052 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_e512f6e2722c488da1df36462f461d3d [id=334c5498104b4128918d0830e469dc2e]
I20260927 13:50:01.038353 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_2d0fed5c3d8c43dba32fce20571132d1 [id=3583b63e50c74d4c9c8cb6c70ef685ab]
I20260927 13:50:01.038842 6793 raft_consensus.cc:697] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:01.039145 6793 consensus_queue.cc:237] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.040448 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_4683c7ce10d24c28964cc8268a92ce52 [id=378ab630e5534a0b9210c3a1d08ad912]
I20260927 13:50:01.041936 5619 tablet_bootstrap.cc:492] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.042075 5619 ts_tablet_manager.cc:1403] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.083s user 0.004s sys 0.015s
I20260927 13:50:01.042819 5619 raft_consensus.cc:359] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.042990 5619 raft_consensus.cc:385] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.043056 5619 raft_consensus.cc:740] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.043294 5619 consensus_queue.cc:260] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.044193 5619 ts_tablet_manager.cc:1434] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:01.044495 5619 tablet_bootstrap.cc:492] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.045897 5619 tablet_bootstrap.cc:654] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.050544 5382 raft_consensus.cc:1275] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Refusing update from remote peer 79c1646c9659434b9a659382d2eb1d8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260927 13:50:01.051160 6856 consensus_queue.cc:1048] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:01.055254 5628 tablet_bootstrap.cc:492] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.055411 5628 ts_tablet_manager.cc:1403] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.002s
I20260927 13:50:01.056023 5628 raft_consensus.cc:359] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.056182 5628 raft_consensus.cc:385] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.056231 5628 raft_consensus.cc:740] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.056816 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec]
I20260927 13:50:01.057284 5628 consensus_queue.cc:260] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.058049 5626 tablet_bootstrap.cc:492] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.058228 5626 ts_tablet_manager.cc:1403] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.004s
I20260927 13:50:01.059015 5626 raft_consensus.cc:359] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.059180 5626 raft_consensus.cc:385] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.059264 5626 raft_consensus.cc:740] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.059469 5626 consensus_queue.cc:260] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.059970 5626 ts_tablet_manager.cc:1434] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:01.060155 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82]
I20260927 13:50:01.060974 6793 raft_consensus.cc:493] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.061111 6793 raft_consensus.cc:515] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.061868 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_3787d49451114bc298d54d844cc68eaa [id=394868e5f3dc477d8825134327ccb4e9]
W20260927 13:50:01.064163 5319 leader_election.cc:343] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2657276c4b2f43c1ad64a8c1fd58ada9
I20260927 13:50:01.064481 6793 leader_election.cc:290] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.068586 5628 ts_tablet_manager.cc:1434] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260927 13:50:01.069303 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2657276c4b2f43c1ad64a8c1fd58ada9" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:01.069876 5319 leader_election.cc:343] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.069996 5319 leader_election.cc:304] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.070379 6866 raft_consensus.cc:2749] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.070801 5626 tablet_bootstrap.cc:492] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.072729 5626 tablet_bootstrap.cc:654] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.073319 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_72330b1053c147a48acac2e12df2dcc0 [id=3a103249799f4a5383c5091fda81153e]
I20260927 13:50:01.079278 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_e73d23c994cc4762a1a69683c398766c [id=3c902c803fbf4be9a5a49f9f41ce2484]
I20260927 13:50:01.082908 6695 raft_consensus.cc:493] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.083047 6695 raft_consensus.cc:515] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.083770 6695 leader_election.cc:290] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.084527 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cf4234fa5e42469ba6b9bdee1e793f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:01.085017 5044 leader_election.cc:343] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.085028 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cf4234fa5e42469ba6b9bdee1e793f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.085206 5382 raft_consensus.cc:2468] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:01.085641 5045 leader_election.cc:304] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.085680 6864 raft_consensus.cc:493] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.085848 6864 raft_consensus.cc:515] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.086134 6695 raft_consensus.cc:2804] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.086211 6695 raft_consensus.cc:493] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.086267 6695 raft_consensus.cc:3060] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.086824 6864 leader_election.cc:290] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.086827 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_74c7885b9da54e549b3e0207088d8fc2 [id=3f099f07c6384429bb435c7c9f363866]
I20260927 13:50:01.087234 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_52cd6f5926494db78b6f05c29b36d509 [id=3f11aa4dd2e5436b942c02b53621b04a]
I20260927 13:50:01.087603 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_3fb24892ee2347868762b8a77ed1f594 [id=40da0ef42c8a4519b9e6987b826e513b]
I20260927 13:50:01.087970 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_daa2858f5f994d1ba5432fa5506b2a44 [id=414bf9afb1d54d779d0324aff799dca9]
I20260927 13:50:01.088382 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_98a47a6f58fe457395c7f1accbac44eb [id=42bfb85e0c8f425ea04c34b94ec24c58]
I20260927 13:50:01.088757 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f33f22d6ee3f458694985ca9a9c3c488 [id=43db068fa4a04954b3638aa09347fe91]
I20260927 13:50:01.089313 6695 raft_consensus.cc:515] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.089622 5619 tablet_bootstrap.cc:492] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.089740 5619 ts_tablet_manager.cc:1403] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260927 13:50:01.089819 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_58f9b708528b4ba980888bbb033af8be [id=46389dd8c7dc4a719ab17a29c2259d74]
I20260927 13:50:01.090279 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cf4234fa5e42469ba6b9bdee1e793f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:01.090518 5619 raft_consensus.cc:359] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.090669 5619 raft_consensus.cc:385] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.090721 5619 raft_consensus.cc:740] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:50:01.091130 5044 leader_election.cc:343] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:01.091559 5185 leader_election.cc:343] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: f3e0e8d6bc744d69a9f41d45459d3b2b
I20260927 13:50:01.091560 5619 consensus_queue.cc:260] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:01.091675 5184 leader_election.cc:343] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f3e0e8d6bc744d69a9f41d45459d3b2b
I20260927 13:50:01.091773 5184 leader_election.cc:304] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.092475 5619 ts_tablet_manager.cc:1434] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:01.092708 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cf4234fa5e42469ba6b9bdee1e793f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:01.092916 5381 raft_consensus.cc:3060] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.094317 6695 leader_election.cc:290] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.094554 6856 raft_consensus.cc:2749] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.095662 5381 raft_consensus.cc:2468] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:50:01.096387 5045 leader_election.cc:304] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.100685 5628 tablet_bootstrap.cc:492] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.100898 6695 raft_consensus.cc:2804] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.101084 6695 raft_consensus.cc:697] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:50:01.101361 6695 consensus_queue.cc:237] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.092718 5619 tablet_bootstrap.cc:492] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.104985 5626 tablet_bootstrap.cc:492] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.105134 5626 ts_tablet_manager.cc:1403] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.004s
I20260927 13:50:01.105551 5107 raft_consensus.cc:1275] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 2 FOLLOWER]: Refusing update from remote peer 79c1646c9659434b9a659382d2eb1d8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260927 13:50:01.105638 5107 pending_rounds.cc:85] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting all ops after (but not including) 0
I20260927 13:50:01.105686 5107 pending_rounds.cc:107] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260927 13:50:01.105787 5107 raft_consensus.cc:2889] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260927 13:50:01.105896 5626 raft_consensus.cc:359] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.106034 5626 raft_consensus.cc:385] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.106087 5626 raft_consensus.cc:740] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.106398 5626 consensus_queue.cc:260] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.106884 5626 ts_tablet_manager.cc:1434] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:01.107492 5626 tablet_bootstrap.cc:492] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.108129 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_835ec246322b4927a1c94badce00f804 [id=47b130fed16142099cfe308ab98849f1]
I20260927 13:50:01.109196 5626 tablet_bootstrap.cc:654] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.110209 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_fef73c8f52d144b6ae2358a575f61151 [id=47cfa38d5dc84502b26ddc79a872d1a7]
I20260927 13:50:01.111063 6856 consensus_queue.cc:1048] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:01.112157 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_552cc54d365f49b1848f9806cae88e18 [id=4906565a0f5949f797472db5e4daa544]
I20260927 13:50:01.115331 6779 raft_consensus.cc:493] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.115469 6779 raft_consensus.cc:515] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.116032 6779 leader_election.cc:290] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.116799 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.116844 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.117244 6864 raft_consensus.cc:493] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:50:01.117357 5044 leader_election.cc:343] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.117359 6864 raft_consensus.cc:515] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:01.117951 5045 leader_election.cc:343] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.118047 5045 leader_election.cc:304] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.118081 6864 leader_election.cc:290] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.118201 6864 raft_consensus.cc:493] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.118287 6864 raft_consensus.cc:515] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.118500 6779 raft_consensus.cc:2749] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.118873 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_5dfc30791e4347db940f164882d547d7 [id=4999b783a5ec458a8af3fbd21cf3ea5e]
I20260927 13:50:01.118969 6866 raft_consensus.cc:493] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.119130 6866 raft_consensus.cc:515] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.119465 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fa4870d5547a2bbffe1745b964504" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.119504 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8bf79954c2429f886ac7afc9a8455f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.119685 5382 raft_consensus.cc:2468] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:01.119758 6866 leader_election.cc:290] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:01.119908 5383 raft_consensus.cc:2468] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:01.120119 5185 leader_election.cc:304] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.120362 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0361e3b244a1437b8e402dd8602528fe" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.120406 5185 leader_election.cc:304] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.120532 5248 raft_consensus.cc:2468] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:01.120646 6752 raft_consensus.cc:2804] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.120716 6752 raft_consensus.cc:493] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.120774 6752 raft_consensus.cc:3060] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.120949 5319 leader_election.cc:304] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.121205 6866 raft_consensus.cc:2804] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.121284 6866 raft_consensus.cc:493] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.121361 6866 raft_consensus.cc:3060] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.122733 5619 tablet_bootstrap.cc:654] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.123651 6752 raft_consensus.cc:515] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.123749 5628 tablet_bootstrap.cc:654] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.123981 6866 raft_consensus.cc:515] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.124620 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fa4870d5547a2bbffe1745b964504" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:01.124879 5383 raft_consensus.cc:3060] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.124150 6752 leader_election.cc:290] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.125372 6752 raft_consensus.cc:2804] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.125451 6752 raft_consensus.cc:493] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.125520 6752 raft_consensus.cc:3060] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:01.125730 5184 leader_election.cc:343] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 8e8bf79954c2429f886ac7afc9a8455f
W20260927 13:50:01.126520 5319 leader_election.cc:343] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 0361e3b244a1437b8e402dd8602528fe
W20260927 13:50:01.127018 5184 leader_election.cc:343] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 5e3fa4870d5547a2bbffe1745b964504
W20260927 13:50:01.127208 5184 leader_election.cc:343] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 5e3fa4870d5547a2bbffe1745b964504
W20260927 13:50:01.127542 5319 leader_election.cc:343] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 0361e3b244a1437b8e402dd8602528fe
I20260927 13:50:01.128126 5383 raft_consensus.cc:2468] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:01.128306 6752 raft_consensus.cc:515] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.128530 5185 leader_election.cc:304] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.128916 6752 leader_election.cc:290] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.129058 6752 raft_consensus.cc:2804] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.129176 6752 raft_consensus.cc:697] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:01.129315 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8bf79954c2429f886ac7afc9a8455f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:01.129420 6752 consensus_queue.cc:237] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.129504 5383 raft_consensus.cc:3060] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.130561 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_410ddd78682b4d2ebbfad8038609093b [id=49f63147052a489787f3a3935f3c9596]
I20260927 13:50:01.130713 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0361e3b244a1437b8e402dd8602528fe" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:01.130875 5248 raft_consensus.cc:3060] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.131832 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_e34a6db37cbf47d79d8f13cd46cc83fb [id=4d9779ad662542bda9207247226d34a3]
I20260927 13:50:01.132126 6793 raft_consensus.cc:493] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.133577 6793 raft_consensus.cc:515] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:50:01.133658 5184 leader_election.cc:343] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 8e8bf79954c2429f886ac7afc9a8455f
I20260927 13:50:01.134157 6793 leader_election.cc:290] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:01.134322 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_13294c9335de4fd3ad6c089efad19634 [id=4da4496b3f7b4dada56f6a6cb22f7569]
I20260927 13:50:01.134617 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd182d7cb414f07944072b0c00ee35c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.134810 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_94ba7a27252044beb2d23563d4092a8f [id=4de8c6767c5640f2ab7b54f6e8884709]
I20260927 13:50:01.134815 5249 raft_consensus.cc:2468] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:50:01.135484 5319 leader_election.cc:343] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 9bd182d7cb414f07944072b0c00ee35c
I20260927 13:50:01.135694 5319 leader_election.cc:304] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.135844 5248 raft_consensus.cc:2468] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:50:01.136202 4749 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu pid 4896: Timed out: CheckLeaks RPC to 127.4.163.124:37095 timed out after 1.000s (SENT)
I20260927 13:50:01.136307 5319 leader_election.cc:304] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.136435 4749 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu with pid 4896
I20260927 13:50:01.137040 6866 leader_election.cc:290] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:01.137239 6866 raft_consensus.cc:2804] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.137351 6866 raft_consensus.cc:493] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.137466 6866 raft_consensus.cc:3060] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.124451 6864 leader_election.cc:290] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.139724 5383 raft_consensus.cc:2468] T 8e8bf79954c2429f886ac7afc9a8455f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:01.142413 5185 leader_election.cc:304] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.140467 6866 raft_consensus.cc:515] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.143080 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f01116bdf8b644238db27fc1b3ae9fc6 [id=4e36bb70ef2942beaea498936148ac99]
I20260927 13:50:01.143360 6866 leader_election.cc:290] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:01.143548 6866 raft_consensus.cc:2804] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.143666 6866 raft_consensus.cc:697] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:01.143862 6864 raft_consensus.cc:2804] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.144001 6864 raft_consensus.cc:697] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:01.144003 6866 consensus_queue.cc:237] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.144232 6864 consensus_queue.cc:237] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.150699 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_68a7db0e7ab24bd9b8e401ef348959ca [id=4f3cc928d2114af692215b91d4377656]
I20260927 13:50:01.151705 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]
I20260927 13:50:01.160936 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a836a91c61ae4aa699a3e710b418f9cd [id=51e1c9946f8a4d46bfc5c2d135742f69]
I20260927 13:50:01.161516 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]
I20260927 13:50:01.162019 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_21196f9a14bf484fa4aef8a72ac91da6 [id=52db386a846540f58ea4588694b690f0]
I20260927 13:50:01.162487 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_aaa8c970b9124f9abcdb193f7539d309 [id=5308278b9daf4308a52aede42b353b64]
I20260927 13:50:01.162986 6779 raft_consensus.cc:493] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.163154 6779 raft_consensus.cc:515] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.163368 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]
I20260927 13:50:01.163964 6779 leader_election.cc:290] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.164803 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_cf41b07a629f42719692319b42490645 [id=57e451bbebf54b159621a6dd5ed08944]
I20260927 13:50:01.165438 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b044fbc166e848f39d17b63db69f63a4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.165680 5619 tablet_bootstrap.cc:492] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
W20260927 13:50:01.165989 5044 leader_election.cc:343] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.165829 5619 ts_tablet_manager.cc:1403] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.073s user 0.005s sys 0.009s
I20260927 13:50:01.167001 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]
I20260927 13:50:01.167460 5619 raft_consensus.cc:359] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.167629 5619 raft_consensus.cc:385] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.167692 5619 raft_consensus.cc:740] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.167866 6752 raft_consensus.cc:493] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.168013 6752 raft_consensus.cc:515] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:01.170158 5184 leader_election.cc:343] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2885e0829d014765b54124a0eb23a4dc
I20260927 13:50:01.170975 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_0b1ea5a791894bfebc59ed28e5506e20 [id=5b376d8103c148d195b730d58176db8b]
W20260927 13:50:01.171226 5185 leader_election.cc:343] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 2885e0829d014765b54124a0eb23a4dc
I20260927 13:50:01.171350 5185 leader_election.cc:304] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.171991 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]
I20260927 13:50:01.172209 6752 leader_election.cc:290] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.172748 6752 raft_consensus.cc:2749] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.174194 6866 raft_consensus.cc:493] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.174144 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b044fbc166e848f39d17b63db69f63a4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.174317 6866 raft_consensus.cc:515] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.174849 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]
I20260927 13:50:01.174854 6866 leader_election.cc:290] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:01.174150 5319 leader_election.cc:343] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 9bd182d7cb414f07944072b0c00ee35c
W20260927 13:50:01.175272 5045 leader_election.cc:343] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.175225 5619 consensus_queue.cc:260] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.175381 5045 leader_election.cc:304] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.175724 5619 ts_tablet_manager.cc:1434] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260927 13:50:01.175830 6779 raft_consensus.cc:2749] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.176064 5619 tablet_bootstrap.cc:492] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.176506 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c810fde988439c97a8445fc88626b3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.176668 5249 raft_consensus.cc:2468] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:01.177522 5619 tablet_bootstrap.cc:654] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.177898 6752 raft_consensus.cc:493] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.178020 6752 raft_consensus.cc:515] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.178376 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd182d7cb414f07944072b0c00ee35c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:01.178548 5248 raft_consensus.cc:3060] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.179186 6752 leader_election.cc:290] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.179710 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d3c47755c94148a488782dbc379011" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:01.179929 5107 raft_consensus.cc:2393] T 04d3c47755c94148a488782dbc379011 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
W20260927 13:50:01.177783 5319 leader_election.cc:343] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 06c810fde988439c97a8445fc88626b3
I20260927 13:50:01.178866 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d3c47755c94148a488782dbc379011" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.180775 5319 leader_election.cc:304] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.181030 5185 leader_election.cc:304] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.181470 6752 raft_consensus.cc:3060] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.181905 5628 tablet_bootstrap.cc:492] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.182042 5628 ts_tablet_manager.cc:1403] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.081s user 0.003s sys 0.011s
I20260927 13:50:01.182317 5248 raft_consensus.cc:2468] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:01.182780 5628 raft_consensus.cc:359] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.182958 5628 raft_consensus.cc:385] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.183017 5628 raft_consensus.cc:740] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.183265 5628 consensus_queue.cc:260] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.183779 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_4121f961061a429290fbb458b1059ba0 [id=609e0e0e929e47adacb63fee55390a6a]
I20260927 13:50:01.184633 5628 ts_tablet_manager.cc:1434] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:01.184762 6752 raft_consensus.cc:2749] T 04d3c47755c94148a488782dbc379011 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.185294 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_36a0d6612db348268c1305cf46302992 [id=61efed7929c1470a8463a5a99b493c6d]
I20260927 13:50:01.187361 5319 leader_election.cc:304] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.187778 6882 raft_consensus.cc:2804] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.187863 6882 raft_consensus.cc:493] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.187945 6882 raft_consensus.cc:3060] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.188880 5628 tablet_bootstrap.cc:492] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.189424 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_7881acf83e854c3d86e41bcea92e353d [id=61f811887e744ffe81d330661ab890f2]
I20260927 13:50:01.190708 5628 tablet_bootstrap.cc:654] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.190094 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_60e4fad358b94bf5a7dcf5632fabd19d [id=64bcf428240942d59593eb02e4843760]
I20260927 13:50:01.191274 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_83f977d77c3640b9b7c7c9ccfb96e327 [id=64d546b25be34918a7c80835c0ed7ac8]
I20260927 13:50:01.194963 6866 raft_consensus.cc:2804] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.195199 6866 raft_consensus.cc:697] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:01.195525 6866 consensus_queue.cc:237] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.196406 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_af1fdd99060c4fbcbd2e734ce850a4ad [id=671b833b30694e8ca3802d879a947f3b]
I20260927 13:50:01.197187 5626 tablet_bootstrap.cc:492] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.197332 5626 ts_tablet_manager.cc:1403] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.090s user 0.004s sys 0.002s
I20260927 13:50:01.198027 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_3ff54037c03446db8068c7bfd74ac465 [id=6a7df7bc6295417689c6b194556456ab]
I20260927 13:50:01.198571 5626 raft_consensus.cc:359] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.198755 5626 raft_consensus.cc:385] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.198843 5626 raft_consensus.cc:740] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.199851 6857 raft_consensus.cc:493] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.199982 6857 raft_consensus.cc:515] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.200534 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]
W20260927 13:50:01.201324 5184 leader_election.cc:343] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 081f18e00af74e5c811f774d29422351
I20260927 13:50:01.201642 6857 leader_election.cc:290] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.202023 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_8ad96efd2222495a89b4620b74fdc2e3 [id=6b95098ecd374cbf8614dc9197ffc0b6]
I20260927 13:50:01.204080 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f18e00af74e5c811f774d29422351" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.204257 5383 raft_consensus.cc:2468] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:01.205523 5185 leader_election.cc:304] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.209663 5628 tablet_bootstrap.cc:492] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.209824 5628 ts_tablet_manager.cc:1403] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260927 13:50:01.209996 6857 raft_consensus.cc:2804] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.210654 6857 raft_consensus.cc:493] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.210597 5628 raft_consensus.cc:359] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.210765 5628 raft_consensus.cc:385] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.210836 5628 raft_consensus.cc:740] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.210860 6857 raft_consensus.cc:3060] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.211058 5628 consensus_queue.cc:260] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.211565 5628 ts_tablet_manager.cc:1434] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:01.211860 5628 tablet_bootstrap.cc:492] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.212390 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_dcdd264dd7c84641aac8566bae2bf8b6 [id=6b9a7948d0b34aa89f9f7c58a2cd2a0e]
I20260927 13:50:01.213121 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_6c77468a637b4f33a5122599e6ad6d5f [id=6cb266614bb746468cf8f0972aed0da0]
I20260927 13:50:01.214250 5628 tablet_bootstrap.cc:654] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.214749 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_eaa1571598144afbb2bb374264f3f84a [id=6f2177bb5be94c0e99a15217b1c84169]
I20260927 13:50:01.215646 6882 raft_consensus.cc:515] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.216238 5619 tablet_bootstrap.cc:492] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.216274 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_e039138831b14ad6b5324ce5cb852dd0 [id=6f235bc80647461199bfced83f9b7827]
I20260927 13:50:01.216337 6882 leader_election.cc:290] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.216374 5619 ts_tablet_manager.cc:1403] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.040s user 0.013s sys 0.005s
I20260927 13:50:01.217028 5619 raft_consensus.cc:359] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.217185 5619 raft_consensus.cc:385] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.217235 5619 raft_consensus.cc:740] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.217406 5619 consensus_queue.cc:260] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.217876 5619 ts_tablet_manager.cc:1434] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260927 13:50:01.217124 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_ad5920def77f4a54aca3bcd967e12202 [id=6fa735ecdafb4f40b5f41de307eb13d0]
I20260927 13:50:01.218202 5619 tablet_bootstrap.cc:492] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.219607 5619 tablet_bootstrap.cc:654] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.220604 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_39166aa385de4916b3c9aaf6d9133e1c [id=70fa5cc937ef4ee4b6a8920a1e29c4e3]
I20260927 13:50:01.222543 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_35a9895ba749499586d31bae3003ffdf [id=724488630f4f462e85698b08da118551]
I20260927 13:50:01.223055 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_1b68a2cb5f1745e3833886667aa5314a [id=72fccb6fab244902b82b30724a723d45]
W20260927 13:50:01.228809 5711 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.163.124:37095 timed out after 0.573s (SENT)
I20260927 13:50:01.229322 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_114b4e4e5a834c1bb0468e42edf6cb6f [id=73340bb48c8e4ef890b4fab3a86e2e53]
I20260927 13:50:01.230490 5626 consensus_queue.cc:260] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:01.232805 6429 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.163.124:37095 timed out after 0.523s (SENT)
I20260927 13:50:01.237447 6857 raft_consensus.cc:515] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.238857 6857 leader_election.cc:290] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.239024 6857 raft_consensus.cc:493] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.239133 6857 raft_consensus.cc:515] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.240227 6857 leader_election.cc:290] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.240980 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f18e00af74e5c811f774d29422351" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:01.241158 5383 raft_consensus.cc:3060] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.244055 5383 raft_consensus.cc:2468] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:01.244453 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb4f42522e84964aeb19358ee02dfc2" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.244594 5382 raft_consensus.cc:2468] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:01.245285 5185 leader_election.cc:304] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.245774 5185 leader_election.cc:304] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.246025 6752 raft_consensus.cc:2804] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.246191 6752 raft_consensus.cc:697] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
W20260927 13:50:01.246196 5184 leader_election.cc:343] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 081f18e00af74e5c811f774d29422351
I20260927 13:50:01.246358 6856 raft_consensus.cc:2804] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.246418 6856 raft_consensus.cc:493] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.246479 6856 raft_consensus.cc:3060] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:01.246572 5184 leader_election.cc:343] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bbb4f42522e84964aeb19358ee02dfc2
I20260927 13:50:01.246534 6752 consensus_queue.cc:237] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.246968 5626 ts_tablet_manager.cc:1434] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.050s user 0.003s sys 0.000s
I20260927 13:50:01.247318 5626 tablet_bootstrap.cc:492] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.249413 5626 tablet_bootstrap.cc:654] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.250792 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]
I20260927 13:50:01.251266 6856 raft_consensus.cc:515] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.251358 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_e349439f77f540cd8fc369d3f4217757 [id=740644d5da164e1f99a37b02ab614292]
I20260927 13:50:01.251966 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f91817f1255d4f8fa48accfa3c7c842d [id=750521adcb384c75841d7e1ff89af83d]
I20260927 13:50:01.252333 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb4f42522e84964aeb19358ee02dfc2" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:01.252449 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]
I20260927 13:50:01.252593 5383 raft_consensus.cc:3060] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.253176 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_8bd375289d574bfeba1cc363b93ad32f [id=77004a3da7944e7a9b9a4d2fa36021c3]
I20260927 13:50:01.253908 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]
I20260927 13:50:01.255511 5383 raft_consensus.cc:2468] T bbb4f42522e84964aeb19358ee02dfc2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:01.256449 5185 leader_election.cc:304] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.257006 6857 raft_consensus.cc:2804] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.260185 5628 tablet_bootstrap.cc:492] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.260350 5628 ts_tablet_manager.cc:1403] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.049s user 0.006s sys 0.015s
I20260927 13:50:01.261209 5628 raft_consensus.cc:359] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.261423 5628 raft_consensus.cc:385] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.261472 5628 raft_consensus.cc:740] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.261734 5628 consensus_queue.cc:260] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.262334 5628 ts_tablet_manager.cc:1434] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:50:01.262630 5628 tablet_bootstrap.cc:492] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.264315 5628 tablet_bootstrap.cc:654] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.266023 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_27e66012e36e4417a0ff30c28955e58e [id=77f96d35f95b45f9972f1e5cf494031f]
I20260927 13:50:01.266570 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]
I20260927 13:50:01.267009 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_c422a4d620fb41f788588f45ad6e57ec [id=78d4b804a72047c3b65aea1d0c259d7a]
I20260927 13:50:01.267419 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]
I20260927 13:50:01.268738 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a06dc9d175614ec2b842ccbb93b0f739 [id=7b0aaddfe9ba428c9c84960df68aaecf]
I20260927 13:50:01.269162 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_8b6f31a00cb34848816c0655566a3bbc [id=7c6323b2512c48e9a41c28282e9327be]
I20260927 13:50:01.271824 5619 tablet_bootstrap.cc:492] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.271960 5619 ts_tablet_manager.cc:1403] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.054s user 0.011s sys 0.007s
I20260927 13:50:01.272459 5626 tablet_bootstrap.cc:492] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.272588 5626 ts_tablet_manager.cc:1403] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.003s
I20260927 13:50:01.272620 5619 raft_consensus.cc:359] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.272778 5619 raft_consensus.cc:385] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.272831 5619 raft_consensus.cc:740] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.273006 5619 consensus_queue.cc:260] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.273528 5619 ts_tablet_manager.cc:1434] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 13:50:01.273861 5619 tablet_bootstrap.cc:492] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.275751 6856 leader_election.cc:290] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:01.276678 5184 leader_election.cc:343] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bbb4f42522e84964aeb19358ee02dfc2
I20260927 13:50:01.277190 5619 tablet_bootstrap.cc:654] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.285478 5619 tablet_bootstrap.cc:492] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.285666 5619 ts_tablet_manager.cc:1403] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260927 13:50:01.286397 5619 raft_consensus.cc:359] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.286617 5619 raft_consensus.cc:385] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.286842 5619 raft_consensus.cc:740] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.287144 5619 consensus_queue.cc:260] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.287686 5619 ts_tablet_manager.cc:1434] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:01.287994 5619 tablet_bootstrap.cc:492] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.290153 5619 tablet_bootstrap.cc:654] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.294586 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_4b4079f348f74177a204289b41a9e534 [id=7d48c041dbd342ebb7cf97af67ae636f]
I20260927 13:50:01.294950 5628 tablet_bootstrap.cc:492] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.295083 5628 ts_tablet_manager.cc:1403] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.001s
I20260927 13:50:01.295783 5628 raft_consensus.cc:359] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.295856 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c810fde988439c97a8445fc88626b3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:01.295954 5628 raft_consensus.cc:385] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.296000 5628 raft_consensus.cc:740] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.296028 5248 raft_consensus.cc:3060] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.296214 5628 consensus_queue.cc:260] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.296316 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_6d1d864c184e45a194cc02929a81a980 [id=818f666fe18a42d499a28124b7c307b4]
I20260927 13:50:01.296856 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_0c9a96d72b0f43e5afec0d076cff390d [id=81cbbfa2b27445209873c0f322ebf64e]
I20260927 13:50:01.298632 5628 ts_tablet_manager.cc:1434] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:50:01.298906 5628 tablet_bootstrap.cc:492] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.298941 5248 raft_consensus.cc:2468] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:01.299584 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_01a57ba463c7433db27102851328ade7 [id=81d5856bf3614409aa1a141334159b59]
I20260927 13:50:01.300724 5628 tablet_bootstrap.cc:654] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.305794 5619 tablet_bootstrap.cc:492] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.305962 5619 ts_tablet_manager.cc:1403] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.002s
I20260927 13:50:01.306924 5809 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Refusing update from remote peer e421351a34d1463e9773dcebdeebae3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 967. Preceding OpId from leader: term: 4 index: 968. (index mismatch)
I20260927 13:50:01.307265 5619 raft_consensus.cc:359] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.307515 5619 raft_consensus.cc:385] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.307587 5619 raft_consensus.cc:740] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.307833 5619 consensus_queue.cc:260] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.307845 6841 consensus_queue.cc:1048] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 968, Last known committed idx: 967, Time since last communication: 0.000s
I20260927 13:50:01.308552 6791 raft_consensus.cc:493] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.308688 6791 raft_consensus.cc:515] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.309432 6791 leader_election.cc:290] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:01.309990 5619 ts_tablet_manager.cc:1434] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260927 13:50:01.310319 5619 tablet_bootstrap.cc:492] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.310303 6695 raft_consensus.cc:493] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.310437 6695 raft_consensus.cc:515] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.311021 6695 leader_election.cc:290] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.311699 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b04acc39f3436384fbb69cebdc35cd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:01.313110 5044 leader_election.cc:343] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.306764 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a7a5af7cfafc47a49d35f8a72e1d1ab5 [id=84210551dbfd4670b948ea3357d599e2]
I20260927 13:50:01.316164 5619 tablet_bootstrap.cc:654] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.325531 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_5de6d07207814569a0b1f42ac2e12c24 [id=87e80bd0bbe04f43b582390b45a522f7]
I20260927 13:50:01.327318 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]
I20260927 13:50:01.334915 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]
I20260927 13:50:01.339946 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3933c0a2fd6547f28528fae7d443a2c1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.341544 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b04acc39f3436384fbb69cebdc35cd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.343732 6695 raft_consensus.cc:493] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.343909 6695 raft_consensus.cc:515] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.344695 6695 leader_election.cc:290] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.345722 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e730a00ad2e646a4ba594ba9434c3b50" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:01.346419 5044 leader_election.cc:343] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:01.346886 5319 leader_election.cc:343] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 06c810fde988439c97a8445fc88626b3
I20260927 13:50:01.348313 6896 raft_consensus.cc:493] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.348511 6896 raft_consensus.cc:515] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.348568 6901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e421351a34d1463e9773dcebdeebae3c. Latest consensus state: current_term: 4 leader_uuid: "e421351a34d1463e9773dcebdeebae3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
W20260927 13:50:01.350023 5184 leader_election.cc:343] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3bbeeadecf3b40c28d0e4f63a22eb4f0
I20260927 13:50:01.351022 6896 leader_election.cc:290] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.350875 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbeeadecf3b40c28d0e4f63a22eb4f0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.351336 5383 raft_consensus.cc:2468] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:01.351761 5185 leader_election.cc:304] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.352298 6896 raft_consensus.cc:2804] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.352841 6896 raft_consensus.cc:493] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.352962 6896 raft_consensus.cc:3060] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:01.333806 6429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.124:37095, user_credentials={real_user=slave}} blocked reactor thread for 100973us
I20260927 13:50:01.355659 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]
W20260927 13:50:01.355962 5319 leader_election.cc:343] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3933c0a2fd6547f28528fae7d443a2c1
I20260927 13:50:01.356267 6901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 13:50:01.356766 6695 raft_consensus.cc:493] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.356890 6695 raft_consensus.cc:515] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.357441 6695 leader_election.cc:290] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.358237 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:01.358829 5044 leader_election.cc:343] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.360131 6857 raft_consensus.cc:697] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:01.360463 6857 consensus_queue.cc:237] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.361866 5319 leader_election.cc:304] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.362190 6882 raft_consensus.cc:2804] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.362318 6882 raft_consensus.cc:697] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:01.362546 6882 consensus_queue.cc:237] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.364645 6882 consensus_queue.cc:1048] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:01.365290 5319 leader_election.cc:343] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.365453 5319 leader_election.cc:304] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.365517 6901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "e421351a34d1463e9773dcebdeebae3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:50:01.365703 6882 raft_consensus.cc:2749] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.365823 6901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [sys.catalog]: This master's current role is: FOLLOWER
W20260927 13:50:01.366206 5045 leader_election.cc:343] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.366331 5045 leader_election.cc:304] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.366747 6695 raft_consensus.cc:2749] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.372897 5626 raft_consensus.cc:359] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.373126 5626 raft_consensus.cc:385] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.373178 5626 raft_consensus.cc:740] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.373368 5626 consensus_queue.cc:260] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.373646 6752 raft_consensus.cc:493] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.373809 6752 raft_consensus.cc:515] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.374604 6752 leader_election.cc:290] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.374795 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_8cda445237a34eac8407eedddae90d1e [id=8f547ebbb90047fabb7ff5a35a56c857]
I20260927 13:50:01.375197 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a635daf12a4a42d5b5ba20c5eb11daa5 [id=90ae08ac2494432c84e387c80c1c2ee6]
I20260927 13:50:01.375581 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_fdf2135656604c40956e676bc740ab08 [id=90be47669a104900ba8e9d2f12cdb8de]
W20260927 13:50:01.375707 5185 leader_election.cc:343] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 2cec272546cb4373bf69e3ab344c46e1
I20260927 13:50:01.376206 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee]
I20260927 13:50:01.376606 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]
I20260927 13:50:01.377004 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e]
I20260927 13:50:01.377893 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_69a87aa5933f49eaaa3085e0b505f5ca [id=97c4d9da0cc54c3d842a2001313e9a8a]
W20260927 13:50:01.378607 5184 leader_election.cc:343] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2cec272546cb4373bf69e3ab344c46e1
I20260927 13:50:01.378711 5184 leader_election.cc:304] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.378933 6752 raft_consensus.cc:2749] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.385218 5628 tablet_bootstrap.cc:492] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.385380 5628 ts_tablet_manager.cc:1403] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.087s user 0.017s sys 0.030s
I20260927 13:50:01.386070 5628 raft_consensus.cc:359] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.386276 5628 raft_consensus.cc:385] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.386346 5628 raft_consensus.cc:740] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.386555 5628 consensus_queue.cc:260] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.388034 6880 raft_consensus.cc:493] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.388165 6880 raft_consensus.cc:515] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.388708 6880 leader_election.cc:290] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.389716 6896 raft_consensus.cc:515] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.390767 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.391438 5628 ts_tablet_manager.cc:1434] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:50:01.391711 5628 tablet_bootstrap.cc:492] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.392669 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e730a00ad2e646a4ba594ba9434c3b50" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.393051 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0880140d99004eb1803d6b5dcf41af13" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.393373 5628 tablet_bootstrap.cc:654] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.393868 6880 raft_consensus.cc:493] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.393980 6880 raft_consensus.cc:515] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.394567 6880 leader_election.cc:290] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:01.397006 5045 leader_election.cc:343] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.397116 5045 leader_election.cc:304] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.397481 6695 raft_consensus.cc:2749] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.397866 6880 raft_consensus.cc:493] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.398032 6880 raft_consensus.cc:515] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.398723 6880 leader_election.cc:290] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:01.399112 5184 leader_election.cc:343] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3bbeeadecf3b40c28d0e4f63a22eb4f0
I20260927 13:50:01.401554 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbeeadecf3b40c28d0e4f63a22eb4f0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:01.401695 5383 raft_consensus.cc:3060] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.404604 5383 raft_consensus.cc:2468] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:01.405112 5185 leader_election.cc:304] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.405421 6752 raft_consensus.cc:2804] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.405597 6752 raft_consensus.cc:697] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:01.405932 6752 consensus_queue.cc:237] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:50:01.406350 5319 leader_election.cc:343] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.406545 6896 leader_election.cc:290] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.407884 5619 tablet_bootstrap.cc:492] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.408046 5619 ts_tablet_manager.cc:1403] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.098s user 0.010s sys 0.022s
I20260927 13:50:01.407650 6841 sys_catalog.cc:455] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "e421351a34d1463e9773dcebdeebae3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } } }
I20260927 13:50:01.408876 6841 sys_catalog.cc:458] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [sys.catalog]: This master's current role is: LEADER
I20260927 13:50:01.409075 6695 raft_consensus.cc:493] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.408984 5619 raft_consensus.cc:359] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.409179 5619 raft_consensus.cc:385] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.409241 5619 raft_consensus.cc:740] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.409205 6695 raft_consensus.cc:515] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.409473 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_2ffaaab1360041dcb71d30bd031dda41 [id=9822148965e74084941bcd0c04bfa009]
I20260927 13:50:01.409473 5619 consensus_queue.cc:260] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.409837 6695 leader_election.cc:290] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.410100 5619 ts_tablet_manager.cc:1434] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:01.410463 5619 tablet_bootstrap.cc:492] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.412631 5619 tablet_bootstrap.cc:654] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.418744 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b4f8a3b92e44cba7ea9e2b48aa70bb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:01.419512 5044 leader_election.cc:343] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:01.421577 5319 leader_election.cc:343] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 0880140d99004eb1803d6b5dcf41af13
I20260927 13:50:01.421788 5319 leader_election.cc:304] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.421967 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_e525c7913e584c6da2c8275732c10699 [id=98d21b12bfac44949111fe435052b88c]
I20260927 13:50:01.422060 6880 raft_consensus.cc:2749] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.422456 6896 raft_consensus.cc:493] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.422668 6896 raft_consensus.cc:515] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.422951 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_6b5cdd8077ed408991f25cc07e1cb24f [id=9a14d2729126450ca4dd7f68467662c4]
I20260927 13:50:01.423396 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]
I20260927 13:50:01.424108 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730cd78c7b1a49d892a5ecb46fae0812" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:01.424767 5045 leader_election.cc:343] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.424876 5045 leader_election.cc:304] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.425264 6695 raft_consensus.cc:2749] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.425918 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b082227264e442a8b1db7a68fb0c3eb" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.427484 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730cd78c7b1a49d892a5ecb46fae0812" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:01.427675 5106 raft_consensus.cc:2393] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:01.428311 5185 leader_election.cc:304] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.428545 6752 raft_consensus.cc:3060] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.429329 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36181512a94c4702ae0a417665919faa" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.430325 6896 leader_election.cc:290] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.430763 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36181512a94c4702ae0a417665919faa" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:01.430920 5106 raft_consensus.cc:2468] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:01.431260 6752 raft_consensus.cc:2749] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.431972 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]
I20260927 13:50:01.432530 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_5972ad040bd64ddda4bf22eac0f03998 [id=9c86bcdd37654832b7a92763aa42e6c4]
I20260927 13:50:01.373899 5626 ts_tablet_manager.cc:1434] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:01.432631 6695 raft_consensus.cc:493] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.432745 6695 raft_consensus.cc:515] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.433013 5626 tablet_bootstrap.cc:492] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.433298 6695 leader_election.cc:290] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.433400 6695 raft_consensus.cc:493] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.433485 6695 raft_consensus.cc:515] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.433992 6695 leader_election.cc:290] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.435772 5619 tablet_bootstrap.cc:492] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.435942 5619 ts_tablet_manager.cc:1403] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.000s
I20260927 13:50:01.436964 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a9f864e4274666a86baed43e1623cd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.436829 5619 raft_consensus.cc:359] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.437381 5619 raft_consensus.cc:385] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.437443 5619 raft_consensus.cc:740] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.437629 5619 consensus_queue.cc:260] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.438131 5619 ts_tablet_manager.cc:1434] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:01.438434 5619 tablet_bootstrap.cc:492] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.436964 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b0349bfaa4a9c8b7d280177f1ecae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:01.440096 5044 leader_election.cc:343] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.440172 5619 tablet_bootstrap.cc:654] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:01.440317 5044 leader_election.cc:343] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.441183 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]
I20260927 13:50:01.441743 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_db71c9d8deb14250b83d10519ab3af81 [id=9eee52296f51408c907b10227c9bd49d]
I20260927 13:50:01.443756 5626 tablet_bootstrap.cc:654] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.450639 6779 raft_consensus.cc:493] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.450789 6779 raft_consensus.cc:515] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.450958 5619 tablet_bootstrap.cc:492] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.451082 5619 ts_tablet_manager.cc:1403] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260927 13:50:01.451444 6779 leader_election.cc:290] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.451820 6880 raft_consensus.cc:493] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.451759 5619 raft_consensus.cc:359] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.451941 5619 raft_consensus.cc:385] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.451996 5619 raft_consensus.cc:740] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.451957 6880 raft_consensus.cc:515] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.452193 5619 consensus_queue.cc:260] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.452512 6880 leader_election.cc:290] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.452525 6882 raft_consensus.cc:493] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.452750 6882 raft_consensus.cc:515] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.452879 5619 ts_tablet_manager.cc:1434] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:01.453126 5619 tablet_bootstrap.cc:492] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.453316 6882 leader_election.cc:290] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.454902 5619 tablet_bootstrap.cc:654] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.458691 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b4f8a3b92e44cba7ea9e2b48aa70bb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.459169 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b0349bfaa4a9c8b7d280177f1ecae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.459587 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a9f864e4274666a86baed43e1623cd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.460405 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95726f690a71433ca63f95da4ee750e5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.460947 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_060df9c137224b90b29c16e43fce88ef [id=9f535502ed1745438ed8e3292ebec99d]
I20260927 13:50:01.453995 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95726f690a71433ca63f95da4ee750e5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.461990 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794da0992403462dbbce644134b8aab3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.462226 5249 raft_consensus.cc:2468] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:01.462399 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60de1c28618f4e478aae68ad07fbcf98" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.462577 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_ed2fe75361bf46b9ab3ed0222e2758f8 [id=a03980cccfd04c6ea5e1c487788d709c]
W20260927 13:50:01.462695 5044 leader_election.cc:343] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.462560 5248 raft_consensus.cc:2468] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:50:01.463258 5042 connection.cc:573] server connection from 127.0.0.1:55672 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:50:01.463244 6429 connection.cc:573] client connection to 127.4.163.124:37095 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:50:01.463531 5711 connection.cc:573] client connection to 127.4.163.124:37095 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:50:01.463514 6429 leader_election.cc:336] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:50:01.463709 5711 leader_election.cc:336] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 13:50:01.463868 5711 leader_election.cc:304] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13a42ae8b95b495c9bcea85d6732cd77; no voters: 802b83f09d3445359cfac825cd87c9de, e421351a34d1463e9773dcebdeebae3c
W20260927 13:50:01.463963 6429 leader_election.cc:336] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 13:50:01.464607 6901 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260927 13:50:01.464982 5320 connection.cc:573] client connection to 127.4.163.124:37095 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:50:01.465147 5443 connection.cc:573] client connection to 127.4.163.124:37095 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:50:01.465193 5320 connection.cc:573] server connection from 127.0.0.1:50216 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:50:01.465370 5045 connection.cc:573] client connection to 127.4.163.124:37095 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 13:50:01.463006 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]
W20260927 13:50:01.466260 5443 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.4.163.124:37095)
W20260927 13:50:01.466629 5443 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.4.163.124:37095)
W20260927 13:50:01.466946 5183 connection.cc:573] server connection from 127.0.0.1:39418 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 13:50:01.467095 5443 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.4.163.124:37095)
W20260927 13:50:01.467298 5443 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.4.163.124:37095)
W20260927 13:50:01.471323 5185 connection.cc:573] client connection to 127.4.163.124:37095 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 13:50:01.480194 6779 raft_consensus.cc:493] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.480417 6779 raft_consensus.cc:515] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.481194 6779 leader_election.cc:290] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.487510 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]
I20260927 13:50:01.488722 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]
I20260927 13:50:01.489272 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_8544e332ec664166b8e0096ab40a19d5 [id=a34447e359784bba9f7b44e0e2968a1f]
I20260927 13:50:01.492287 6779 raft_consensus.cc:493] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.492436 6779 raft_consensus.cc:515] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.493007 6779 leader_election.cc:290] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.493979 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60de1c28618f4e478aae68ad07fbcf98" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:01.494187 5106 raft_consensus.cc:2468] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:50:01.495108 5319 leader_election.cc:343] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2b082227264e442a8b1db7a68fb0c3eb
I20260927 13:50:01.495420 5319 leader_election.cc:304] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.495746 6882 raft_consensus.cc:2804] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.495827 6882 raft_consensus.cc:493] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.495898 6882 raft_consensus.cc:3060] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.499310 6882 raft_consensus.cc:515] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.500099 6882 leader_election.cc:290] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.500185 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe8af2068948c78feac4641a7525be" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.501832 5626 tablet_bootstrap.cc:492] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.501847 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbacda63c0d3427aabf3332b278576c5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.502002 5626 ts_tablet_manager.cc:1403] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.069s user 0.005s sys 0.001s
W20260927 13:50:01.502735 5044 leader_election.cc:343] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.502905 5626 raft_consensus.cc:359] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:50:01.502995 5044 leader_election.cc:343] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.503053 5626 raft_consensus.cc:385] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.503103 5626 raft_consensus.cc:740] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.504347 6882 consensus_queue.cc:1048] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:01.505654 5319 leader_election.cc:343] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 794da0992403462dbbce644134b8aab3
I20260927 13:50:01.505944 5319 leader_election.cc:304] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.506397 6882 raft_consensus.cc:2804] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.506515 6882 raft_consensus.cc:493] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.506616 6882 raft_consensus.cc:3060] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.509588 6882 raft_consensus.cc:515] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.510264 6882 leader_election.cc:290] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.510304 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a2b9f6b30ac74767998e48a73f5a97db [id=a5dc0b9da7754fefa0c4a95317bbb65b]
W20260927 13:50:01.512096 5319 leader_election.cc:343] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.512207 5319 leader_election.cc:304] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.512660 6880 raft_consensus.cc:2749] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.512804 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_0480d2e07b2843fdb6ea6e57d134ac20 [id=a61b65ac19e3422b8b6254c3753e02db]
I20260927 13:50:01.513214 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f2000b1332564779b99fef20acf75a9a [id=a6d3f0f894904a738cc54fe5d8631f06]
W20260927 13:50:01.513427 5319 leader_election.cc:343] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.513648 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]
I20260927 13:50:01.513890 5626 consensus_queue.cc:260] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.514371 5626 ts_tablet_manager.cc:1434] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260927 13:50:01.515780 5626 tablet_bootstrap.cc:492] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.518484 5626 tablet_bootstrap.cc:654] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.525954 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]
W20260927 13:50:01.525957 5045 leader_election.cc:343] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.526086 5045 leader_election.cc:304] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.526700 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_7925881f0cb44436964ec5d3a85ccb31 [id=a92416af3eac48e0b7a272bdc8bb83c4]
I20260927 13:50:01.527660 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_438c450d2fff477aaf6e67a530a1532a [id=aa804ddccaec408bbfca331d8b49125a]
I20260927 13:50:01.528038 5319 leader_election.cc:304] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.528488 6779 raft_consensus.cc:2749] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.528533 5619 tablet_bootstrap.cc:492] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.528666 5619 ts_tablet_manager.cc:1403] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.076s user 0.009s sys 0.026s
I20260927 13:50:01.528754 6882 raft_consensus.cc:2804] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.528843 6882 raft_consensus.cc:493] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.528929 6882 raft_consensus.cc:3060] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.529434 5619 raft_consensus.cc:359] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.529621 5619 raft_consensus.cc:385] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.529695 5619 raft_consensus.cc:740] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:50:01.529960 6923 negotiation.cc:336] Failed RPC negotiation. Trace:
0927 13:50:01.472664 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.4.163.124:37095 (local address 127.0.0.1:51822)
0927 13:50:01.529496 (+ 56832us) negotiation.cc:107] Waiting for socket to connect
0927 13:50:01.529637 (+ 141us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":56710,"threads_started":1}
I20260927 13:50:01.529942 5619 consensus_queue.cc:260] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.530467 5619 ts_tablet_manager.cc:1434] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:01.530748 5619 tablet_bootstrap.cc:492] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.532378 6779 raft_consensus.cc:493] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.532430 5619 tablet_bootstrap.cc:654] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.532496 6779 raft_consensus.cc:515] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.533115 6779 leader_election.cc:290] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.533865 6882 raft_consensus.cc:515] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.534447 6882 leader_election.cc:290] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.534448 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d9c94ee0af46e8aea12adac57829f7" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:01.535096 5044 leader_election.cc:343] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:01.536434 5045 leader_election.cc:343] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.536543 5045 leader_election.cc:304] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.536757 6779 raft_consensus.cc:2749] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:01.537117 5045 leader_election.cc:343] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.537205 5045 leader_election.cc:304] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.537391 6779 raft_consensus.cc:2749] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:01.538141 5045 leader_election.cc:343] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.538245 5045 leader_election.cc:304] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.538422 6779 raft_consensus.cc:2749] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.539687 6896 raft_consensus.cc:493] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.539819 6896 raft_consensus.cc:515] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:50:01.541035 5184 leader_election.cc:343] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a813939920244be781d546311fe8a33e
I20260927 13:50:01.541525 6896 leader_election.cc:290] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.542343 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36181512a94c4702ae0a417665919faa" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:01.544979 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a813939920244be781d546311fe8a33e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.545145 5383 raft_consensus.cc:2468] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:01.546360 5185 leader_election.cc:304] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.546442 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36181512a94c4702ae0a417665919faa" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:01.546542 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]
I20260927 13:50:01.546623 5106 raft_consensus.cc:3060] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.547379 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_010dd8cdd9ea470397aeff0f1235bf1e [id=ae14efb404dc420ca7b29717270210a9]
I20260927 13:50:01.547466 6896 raft_consensus.cc:2804] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.547616 6896 raft_consensus.cc:493] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.547760 6896 raft_consensus.cc:3060] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.547886 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a8cb85c2ad064149be57407ba25423d6 [id=ae170bbebc4e460fb58beb7f95f013a2]
I20260927 13:50:01.549616 5106 raft_consensus.cc:2468] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:01.550192 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]
I20260927 13:50:01.550940 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_800bad10399f4515acb401f9be49e957 [id=b0d2a5de33884946b95e67dffb65b617]
I20260927 13:50:01.551231 6896 raft_consensus.cc:515] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.551688 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_1e8d21fc0eb44229a3a03b14792918c7 [id=b20698fb30ef49d9932dd3635df4788e]
I20260927 13:50:01.552987 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a813939920244be781d546311fe8a33e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:01.553189 5383 raft_consensus.cc:3060] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:01.556433 5184 leader_election.cc:343] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a813939920244be781d546311fe8a33e
I20260927 13:50:01.557292 5383 raft_consensus.cc:2468] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:01.557806 6880 raft_consensus.cc:493] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.557952 6880 raft_consensus.cc:515] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.558074 5185 leader_election.cc:304] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.558385 6752 raft_consensus.cc:2804] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.558486 6880 leader_election.cc:290] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.558502 6752 raft_consensus.cc:697] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:01.558790 6752 consensus_queue.cc:237] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.559278 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60de1c28618f4e478aae68ad07fbcf98" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:01.559439 5249 raft_consensus.cc:3060] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.562322 5249 raft_consensus.cc:2468] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:50:01.557291 6429 consensus_peers.cc:597] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c -> Peer 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095): Couldn't send request to peer 802b83f09d3445359cfac825cd87c9de. Status: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:01.563681 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_4384df2328734676b60b16fe84947703 [id=b39f412819df4df0ba22acf8813e397a]
I20260927 13:50:01.563786 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60de1c28618f4e478aae68ad07fbcf98" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:01.563921 5628 tablet_bootstrap.cc:492] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.564113 5106 raft_consensus.cc:3060] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.564116 5628 ts_tablet_manager.cc:1403] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.172s user 0.031s sys 0.041s
I20260927 13:50:01.564939 5626 tablet_bootstrap.cc:492] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.564957 5628 raft_consensus.cc:359] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.565065 5626 ts_tablet_manager.cc:1403] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.000s
I20260927 13:50:01.565119 5628 raft_consensus.cc:385] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.565188 5628 raft_consensus.cc:740] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.565438 5628 consensus_queue.cc:260] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.565874 5626 raft_consensus.cc:359] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.566020 5626 raft_consensus.cc:385] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.566072 5626 raft_consensus.cc:740] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.566066 5628 ts_tablet_manager.cc:1434] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:01.566262 5626 consensus_queue.cc:260] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.566831 5626 ts_tablet_manager.cc:1434] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:01.566942 5628 tablet_bootstrap.cc:492] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.567070 5626 tablet_bootstrap.cc:492] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.568588 5628 tablet_bootstrap.cc:654] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.568614 5626 tablet_bootstrap.cc:654] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.569410 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_19de48446f02465ca170ad7a349da94d [id=b5a4301a2e1f45d2b20099589ede2b26]
I20260927 13:50:01.569845 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_83075bfe4fcb4d80b6a90c020b475e1b [id=b5f86a8836f749d5b8761878725da3a3]
I20260927 13:50:01.570257 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]
I20260927 13:50:01.570705 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_445d25d3eeb64eb3845dad47fa41f27d [id=b7649e0adc2e4b6c82afa8d846d54aa1]
I20260927 13:50:01.577407 5106 raft_consensus.cc:2468] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:01.579033 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794da0992403462dbbce644134b8aab3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:01.579228 5249 raft_consensus.cc:3060] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.579521 5628 tablet_bootstrap.cc:492] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.579679 5628 ts_tablet_manager.cc:1403] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260927 13:50:01.580338 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_74758221c71d4c799da6b76df7746ba3 [id=ba15fdb3f6d9461e85fbef90616b4b9e]
I20260927 13:50:01.580637 6882 raft_consensus.cc:493] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.580633 5628 raft_consensus.cc:359] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.580862 5628 raft_consensus.cc:385] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.580940 5628 raft_consensus.cc:740] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.580832 6882 raft_consensus.cc:515] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.581578 6882 leader_election.cc:290] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.581774 5628 consensus_queue.cc:260] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.582465 5628 ts_tablet_manager.cc:1434] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260927 13:50:01.582445 6896 leader_election.cc:290] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.581976 5249 raft_consensus.cc:2468] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:01.583091 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]
I20260927 13:50:01.583729 5628 tablet_bootstrap.cc:492] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.584187 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_32fe69927df64b76b1aefe941e9f4241 [id=baed5667f9254dd99700c6d185b44535]
I20260927 13:50:01.585355 5628 tablet_bootstrap.cc:654] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.586134 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]
I20260927 13:50:01.586611 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_06a788ecdc724adf92a6212315691a25 [id=bc423c24d7324498bbc47de81fd57135]
I20260927 13:50:01.590864 5628 tablet_bootstrap.cc:492] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.590986 5628 ts_tablet_manager.cc:1403] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20260927 13:50:01.591665 5626 tablet_bootstrap.cc:492] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.591859 5626 ts_tablet_manager.cc:1403] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260927 13:50:01.592640 5628 raft_consensus.cc:359] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.592629 5626 raft_consensus.cc:359] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.592806 5628 raft_consensus.cc:385] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.592871 5628 raft_consensus.cc:740] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.592908 5626 raft_consensus.cc:385] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.593044 5626 raft_consensus.cc:740] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.593271 5626 consensus_queue.cc:260] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.593783 5626 ts_tablet_manager.cc:1434] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:01.594132 5626 tablet_bootstrap.cc:492] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.594062 6880 raft_consensus.cc:493] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.594278 6882 raft_consensus.cc:493] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.594242 6880 raft_consensus.cc:515] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.594460 6793 raft_consensus.cc:493] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.593793 5628 consensus_queue.cc:260] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.594590 6793 raft_consensus.cc:515] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.594879 5628 ts_tablet_manager.cc:1434] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:50:01.594909 6880 leader_election.cc:290] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.595000 6793 leader_election.cc:290] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.595124 5628 tablet_bootstrap.cc:492] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.595227 6882 raft_consensus.cc:515] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.595775 6882 leader_election.cc:290] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.596264 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe8af2068948c78feac4641a7525be" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.597635 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbacda63c0d3427aabf3332b278576c5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.598161 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d9c94ee0af46e8aea12adac57829f7" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.598613 5628 tablet_bootstrap.cc:654] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.599903 5626 tablet_bootstrap.cc:654] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.600560 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860aa52d44ad494594c73707e6ef98e2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.590906 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]
I20260927 13:50:01.601383 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_9f53709861824b0591e1b8ce63a64393 [id=bd0f9079417b4b609bd68a7abb12e8d7]
I20260927 13:50:01.601747 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860aa52d44ad494594c73707e6ef98e2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:01.601955 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]
I20260927 13:50:01.602229 6857 raft_consensus.cc:493] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.602355 6857 raft_consensus.cc:515] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.602867 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_c759fc3bc488489a94e8a6193c491682 [id=bfc3d095064143c9b2adfd23049e64f7]
I20260927 13:50:01.602955 6857 leader_election.cc:290] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.603539 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f9afa72c04394383a22302115766399d [id=c073a79da0b440698186e6856c8c8c68]
W20260927 13:50:01.604058 5184 leader_election.cc:343] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 46537e1b33f24d50b705d53f6978da3c
I20260927 13:50:01.604295 5106 raft_consensus.cc:2468] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:50:01.605154 5185 leader_election.cc:343] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 46537e1b33f24d50b705d53f6978da3c
I20260927 13:50:01.605283 5185 leader_election.cc:304] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.605528 6857 raft_consensus.cc:2749] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.606700 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2f814bb9ff41ebab19e8c16cf4affa" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.610612 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb25bb5ee153494d803130f1ad4f7c2e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.611544 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_183e16824f194b1caa9327d0973f607b [id=c16d7a8a2339458b8c973cedf99c32bf]
I20260927 13:50:01.612309 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]
I20260927 13:50:01.612326 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b2b6f2ce1145a18c199bb37cc7e5b2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.614878 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_c4f4659ddd2a47c48ae7d545ac78f2cc [id=c2a8b1992a3a4410b6e0a53d5beb27bf]
I20260927 13:50:01.615720 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a07adcd33414d18ae9720e7a307548a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.616006 5626 tablet_bootstrap.cc:492] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.616179 5626 ts_tablet_manager.cc:1403] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260927 13:50:01.616951 5626 raft_consensus.cc:359] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.617173 5626 raft_consensus.cc:385] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.617276 5626 raft_consensus.cc:740] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.617566 5626 consensus_queue.cc:260] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.618265 5626 ts_tablet_manager.cc:1434] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260927 13:50:01.618252 5045 leader_election.cc:343] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.618413 5045 leader_election.cc:304] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.618566 5626 tablet_bootstrap.cc:492] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.618755 6779 raft_consensus.cc:2749] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:01.619287 5045 leader_election.cc:343] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.619450 5045 leader_election.cc:304] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.619827 6779 raft_consensus.cc:2749] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:01.620283 5045 leader_election.cc:343] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.618016 5319 leader_election.cc:304] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.620424 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_3bd7d29894a24011b97fb7157002b917 [id=c2de98abee2849d9a2517bb6be800706]
I20260927 13:50:01.620633 6882 raft_consensus.cc:2804] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.620736 5045 leader_election.cc:304] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.621133 6882 raft_consensus.cc:697] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:01.621380 6882 consensus_queue.cc:237] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.621735 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a212266119b14cedb7576aff1e810ca4 [id=c35db2ada8d742c3a967191a6f539cfd]
I20260927 13:50:01.622172 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_2159a2c74b9c4769be385712b34f41c3 [id=c386219cd45c4447b229c721951babeb]
I20260927 13:50:01.622570 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_8ccdfb70bd5f4ae9912dd1e5669a09e3 [id=c39aa424f92d4fc8bf69b9829737f61e]
I20260927 13:50:01.622965 6857 raft_consensus.cc:493] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.623183 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_7675c4eea2d04c06b01cf0466c4ed466 [id=c58f2a8e5acf483d89fb782663512587]
I20260927 13:50:01.623082 6857 raft_consensus.cc:515] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.623541 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_645d9205892845cdb661a97f3576207e [id=c5b8489d57cf4ceabd115dfec550c9ec]
I20260927 13:50:01.623706 6857 leader_election.cc:290] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.623968 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_6e893d08117849cea8b823b4d752b91b [id=c622333396e0438788c417822274dc41]
I20260927 13:50:01.624356 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_db70ad184fab4e5984d1777fecae5518 [id=c6230203df764e97a3fd3c8117177db2]
I20260927 13:50:01.624425 5626 tablet_bootstrap.cc:654] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.632151 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_5f348882b88d4bdc8b238f4794b07610 [id=c68169e25a9f43b08141799bc435b14c]
I20260927 13:50:01.632902 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_ac04cc7df4cf46dcbec9dbbe9c207d5c [id=c7bc7539f5b04e5a82ecb5f176b60a9f]
I20260927 13:50:01.633046 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cf4234fa5e42469ba6b9bdee1e793f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.633322 5383 raft_consensus.cc:2393] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:50:01.633471 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_2d7d460396774c7982b3391c3ad1827f [id=c81f7b3016144fd7a7329fbf31049d93]
I20260927 13:50:01.636376 5319 leader_election.cc:304] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.625051 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cf4234fa5e42469ba6b9bdee1e793f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:01.637465 6779 raft_consensus.cc:493] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.637509 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]
I20260927 13:50:01.637600 6779 raft_consensus.cc:515] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.638187 6779 leader_election.cc:290] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.638801 6779 raft_consensus.cc:2749] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.639901 6793 raft_consensus.cc:2804] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.640009 6793 raft_consensus.cc:697] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:01.640228 6793 consensus_queue.cc:237] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.645334 5184 leader_election.cc:304] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.639740 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e6bf85bf1434ab6ce42e751d31c6f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:01.646342 5044 leader_election.cc:343] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.646354 6896 raft_consensus.cc:3060] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.646821 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_7b9eaaab4c6149e09eb18425cb5c38a3 [id=c9012875ec134838a277ebcd347d754d]
I20260927 13:50:01.647310 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_7a4d7f5d2d204a5c8a42b30ae9b4623d [id=c920b19c5b2041dd915de732f5b0c640]
I20260927 13:50:01.648202 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a5b94f165eff40f3826437ed44404e55 [id=caf6214f83fd4d19b26a6f39ef349629]
I20260927 13:50:01.649039 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]
I20260927 13:50:01.649909 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]
I20260927 13:50:01.649912 6896 raft_consensus.cc:2749] T d0cf4234fa5e42469ba6b9bdee1e793f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.650519 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_82abe0dde56e49ea9af2bb8ddcfa508d [id=d088563f44224b01a3eba63ce70e5681]
I20260927 13:50:01.651064 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]
I20260927 13:50:01.651842 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3]
I20260927 13:50:01.653841 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_bdd9cd69a46646c09a795b8566ba23aa [id=d64611e8699c410c919a48b0c4441e63]
I20260927 13:50:01.658916 5619 tablet_bootstrap.cc:492] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.659111 5619 ts_tablet_manager.cc:1403] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.128s user 0.021s sys 0.036s
I20260927 13:50:01.660215 5619 raft_consensus.cc:359] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.660454 5619 raft_consensus.cc:385] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.660530 5619 raft_consensus.cc:740] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:50:01.660832 5319 leader_election.cc:343] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 794da0992403462dbbce644134b8aab3
I20260927 13:50:01.660869 5619 consensus_queue.cc:260] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.661041 5319 leader_election.cc:304] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.661553 5619 ts_tablet_manager.cc:1434] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:50:01.661917 5619 tablet_bootstrap.cc:492] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.663671 6779 raft_consensus.cc:493] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.663815 6779 raft_consensus.cc:515] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.664381 5619 tablet_bootstrap.cc:654] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.664420 6779 leader_election.cc:290] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.665135 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26a3a50396940cf826442e4ba7356a8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.665241 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_6d74eaa4eb034485b7844e149cb6b14b [id=d7573db0f99048ac84381b6b2e2d2c08]
I20260927 13:50:01.665658 6882 raft_consensus.cc:2804] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.665695 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_544497088a2047e8a6b190c4e23e3e1c [id=d7b1a5499c5f4f9784a8952f1e66c3f7]
W20260927 13:50:01.665971 5044 leader_election.cc:343] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.665797 6882 raft_consensus.cc:493] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.666273 6882 raft_consensus.cc:3060] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.669124 6882 raft_consensus.cc:515] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.669878 6882 leader_election.cc:290] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:01.670423 5319 leader_election.cc:343] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7c2f814bb9ff41ebab19e8c16cf4affa
W20260927 13:50:01.671175 5319 leader_election.cc:343] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bb25bb5ee153494d803130f1ad4f7c2e
W20260927 13:50:01.671627 5319 leader_election.cc:343] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f5b2b6f2ce1145a18c199bb37cc7e5b2
W20260927 13:50:01.672034 5319 leader_election.cc:343] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3a07adcd33414d18ae9720e7a307548a
W20260927 13:50:01.672482 5319 leader_election.cc:343] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.673142 5319 leader_election.cc:304] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.678668 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815]
I20260927 13:50:01.680828 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_ba46c52966764f5989cc55eed4059edf [id=db33cf0d6695498f8e5100abb2103d08]
I20260927 13:50:01.681703 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_22e17296fde940779eb9160306ff386d [id=db63359dda9d4b729446d6ddf78c30b8]
I20260927 13:50:01.683130 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_d930205241084c7b957ca0983bfb037f [id=dd996f6d5b764e799ed45890225b7670]
I20260927 13:50:01.684441 5626 tablet_bootstrap.cc:492] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.684652 5626 ts_tablet_manager.cc:1403] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.066s user 0.006s sys 0.000s
I20260927 13:50:01.685490 5626 raft_consensus.cc:359] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.685737 5626 raft_consensus.cc:385] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.685833 5626 raft_consensus.cc:740] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.686156 5626 consensus_queue.cc:260] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.686872 5626 ts_tablet_manager.cc:1434] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:01.687673 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_162ac02f5d444371ad6d85becb6b16a0 [id=de8b7ce50f8c4bb4a105d25f701d4d82]
I20260927 13:50:01.688030 5626 tablet_bootstrap.cc:492] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.689646 6880 raft_consensus.cc:2804] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.689785 6880 raft_consensus.cc:697] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:01.689931 5626 tablet_bootstrap.cc:654] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.690044 6880 consensus_queue.cc:237] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.691641 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]
W20260927 13:50:01.702292 5319 leader_election.cc:343] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:01.702643 5319 leader_election.cc:343] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.702751 5319 leader_election.cc:304] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.702690 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_c241bde0378b4e4c9c963550525f9663 [id=dfe83376b8974bc4ba3140869ce88d76]
I20260927 13:50:01.703380 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]
I20260927 13:50:01.703862 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe]
I20260927 13:50:01.704365 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_5fd18aaf3713418e96976bc82c39f6e0 [id=e1e98093dbf14930a10bbe17dfdf0fbe]
I20260927 13:50:01.704838 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_b81799f423864c5faf4b54c86e95aebc [id=e2566dade29042a897d2e1c91672787c]
I20260927 13:50:01.705526 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_74634e550bd54c0cb0f52004fa14c8af [id=e321368692d24c5a87884e0165ef89ac]
I20260927 13:50:01.706000 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_22c755d674734bbdaf00ff031dd35bde [id=e3b2f033f16b4d1185c45d1dc7e99515]
I20260927 13:50:01.707005 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_fbe3019feb804488bb1c921ca74d85d1 [id=e5a735cb67614ea3ab56e5557d544301]
I20260927 13:50:01.707458 6791 raft_consensus.cc:2749] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:01.708014 5319 leader_election.cc:343] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.708683 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]
I20260927 13:50:01.712096 5319 leader_election.cc:304] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.712725 6791 raft_consensus.cc:2749] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.713455 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_8e2e1621778d459a930d7f15ea30dd06 [id=e6cd27ae03884c518cebff6b8a7483d8]
I20260927 13:50:01.714675 5628 tablet_bootstrap.cc:492] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.714843 5628 ts_tablet_manager.cc:1403] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.120s user 0.018s sys 0.047s
I20260927 13:50:01.715229 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]
I20260927 13:50:01.715760 5628 raft_consensus.cc:359] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.715951 5628 raft_consensus.cc:385] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.716013 5628 raft_consensus.cc:740] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.716285 5628 consensus_queue.cc:260] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.716519 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_23ae01b278734a1e94187c6846ce8f26 [id=e802f65837444329b9932f23eba2db40]
W20260927 13:50:01.716966 5319 leader_election.cc:343] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.717080 5319 leader_election.cc:304] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.717020 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_c614391e114f4a7889ab500228e6318a [id=e84aa884563949dab840e102baec8988]
I20260927 13:50:01.718310 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_7db7dcae15a64ff4b308591077608880 [id=ea5c56db81904caab25d8b1a0c6d0fa1]
I20260927 13:50:01.718327 6791 raft_consensus.cc:2749] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:01.718775 5319 leader_election.cc:343] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.718895 5319 leader_election.cc:304] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.719637 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_75865dd4349e418896b4469e10a62252 [id=eaf034197b00472287e8218a4ecd41bc]
I20260927 13:50:01.720278 6791 raft_consensus.cc:2749] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.722020 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]
I20260927 13:50:01.723193 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_06b04cbe300b4373813df57694d32684 [id=ed3f5ac2c7fe4efeaa58e8a11100851b]
I20260927 13:50:01.724472 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_a4d76e32d0c349abafc8f800e4acb8c7 [id=ed8d36823c5c43eaa1e8b0447c7f32e9]
I20260927 13:50:01.725411 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_8e30f259d16146d18136753eb1805e15 [id=ee0789e9d1f34c3791d35794473e2246]
I20260927 13:50:01.727062 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_240f3492390b48428f555f3f2dbce154 [id=ef4c47103ab94117b1130306118f923f]
I20260927 13:50:01.728410 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_bf1d966c56b941bab74f8fe4cef3bbb6 [id=f07c60c3feb741e4b9dda75a2ab5660e]
I20260927 13:50:01.730223 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_3b716a51ffbe4613a958b62eef4cdcb6 [id=f4ff4dd6b47a4ce9a42f7b13a6a1ce34]
I20260927 13:50:01.731513 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_3905bc395f754c2d93037c9b56a09515 [id=f5627b57c0564716bd5a2011827bb666]
I20260927 13:50:01.731734 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860aa52d44ad494594c73707e6ef98e2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:01.732290 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860aa52d44ad494594c73707e6ef98e2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:01.732511 5106 raft_consensus.cc:3060] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.733189 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_479338a884a047389e0343ea71022b50 [id=f5e5dded0c5042adb7dce1d541d92e93]
I20260927 13:50:01.735024 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]
I20260927 13:50:01.735951 5106 raft_consensus.cc:2468] T 860aa52d44ad494594c73707e6ef98e2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:01.736038 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_022283b66bf4471691348ed0a603a4c3 [id=fca092c89d4e44cfbce954b0d0fd8400]
I20260927 13:50:01.737716 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_3656ebf9c8b64bff8f00bf1941a3aec4 [id=fd3d1f802598418a8d6f740db979940f]
I20260927 13:50:01.737399 5628 ts_tablet_manager.cc:1434] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260927 13:50:01.738927 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_c7e950edad044de5b910f91a80448895 [id=fde3e0efd65f4345b3fd64d141753ca6]
I20260927 13:50:01.739897 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_908235dbf46e4c6f9a13506c919c6492 [id=fe64adff124845c0b35692c8e48f8759]
I20260927 13:50:01.740816 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_51418e08551949709fa1cc76c3d6bd21 [id=ff0e6686b11541b09e78176361aca3b6]
I20260927 13:50:01.741709 6844 catalog_manager.cc:692] Loaded metadata for table default.Table_42796c54044b413f89d5ebc6ec7a1c42 [id=ff3a9590f545444884afaa56b305080d]
I20260927 13:50:01.747959 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e6bf85bf1434ab6ce42e751d31c6f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.748462 5628 tablet_bootstrap.cc:492] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.748907 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26a3a50396940cf826442e4ba7356a8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.750962 5626 tablet_bootstrap.cc:492] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.751113 5626 ts_tablet_manager.cc:1403] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.063s user 0.006s sys 0.012s
I20260927 13:50:01.751899 5626 raft_consensus.cc:359] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.752070 5626 raft_consensus.cc:385] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.752140 5626 raft_consensus.cc:740] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.752391 5626 consensus_queue.cc:260] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:01.752473 5045 leader_election.cc:343] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.752585 5045 leader_election.cc:304] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.752796 6779 raft_consensus.cc:2749] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.753501 5626 ts_tablet_manager.cc:1434] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260927 13:50:01.753588 5045 leader_election.cc:343] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.753675 5045 leader_election.cc:304] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.753756 5626 tablet_bootstrap.cc:492] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.753860 6779 raft_consensus.cc:2749] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.755576 5626 tablet_bootstrap.cc:654] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.755725 5319 leader_election.cc:304] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.756822 6880 raft_consensus.cc:2804] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.758419 6880 raft_consensus.cc:697] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:01.758836 6880 consensus_queue.cc:237] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:01.762265 5319 leader_election.cc:343] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.762802 5626 tablet_bootstrap.cc:492] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.762935 5626 ts_tablet_manager.cc:1403] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260927 13:50:01.763599 5626 raft_consensus.cc:359] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.763758 5626 raft_consensus.cc:385] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.763813 5626 raft_consensus.cc:740] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.764084 5626 consensus_queue.cc:260] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.764683 5626 ts_tablet_manager.cc:1434] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:50:01.764948 5626 tablet_bootstrap.cc:492] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.766587 5626 tablet_bootstrap.cc:654] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.766975 5628 tablet_bootstrap.cc:654] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.769587 6844 tablet_loader.cc:96] loaded metadata for tablet 0021dbaf7e8440479bcf24cce693b158 (table default.Table_1b68a2cb5f1745e3833886667aa5314a [id=72fccb6fab244902b82b30724a723d45])
I20260927 13:50:01.770305 6844 tablet_loader.cc:96] loaded metadata for tablet 0076228c3f224d1f9d76ccf2dd7064ae (table default.Table_bf1d966c56b941bab74f8fe4cef3bbb6 [id=f07c60c3feb741e4b9dda75a2ab5660e])
I20260927 13:50:01.771260 6844 tablet_loader.cc:96] loaded metadata for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335])
I20260927 13:50:01.772353 6844 tablet_loader.cc:96] loaded metadata for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419])
I20260927 13:50:01.773502 6844 tablet_loader.cc:96] loaded metadata for tablet 04d3c47755c94148a488782dbc379011 (table default.Table_fdf2135656604c40956e676bc740ab08 [id=90be47669a104900ba8e9d2f12cdb8de])
I20260927 13:50:01.774391 5626 tablet_bootstrap.cc:492] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.774612 5626 ts_tablet_manager.cc:1403] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260927 13:50:01.775624 5626 raft_consensus.cc:359] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.775879 5626 raft_consensus.cc:385] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.775988 5626 raft_consensus.cc:740] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.776465 5619 tablet_bootstrap.cc:492] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.776353 5626 consensus_queue.cc:260] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.776603 5619 ts_tablet_manager.cc:1403] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.115s user 0.033s sys 0.032s
I20260927 13:50:01.779701 5626 ts_tablet_manager.cc:1434] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:50:01.780063 5626 tablet_bootstrap.cc:492] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.781999 5626 tablet_bootstrap.cc:654] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.782455 6844 tablet_loader.cc:96] loaded metadata for tablet 04e16ca60020406fb46436fa68ea4b33 (table default.Table_2d0fed5c3d8c43dba32fce20571132d1 [id=3583b63e50c74d4c9c8cb6c70ef685ab])
I20260927 13:50:01.783401 6844 tablet_loader.cc:96] loaded metadata for tablet 05be51001e1747358b274326f84d67d4 (table default.Table_e525c7913e584c6da2c8275732c10699 [id=98d21b12bfac44949111fe435052b88c])
I20260927 13:50:01.784962 5628 tablet_bootstrap.cc:492] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.785182 5628 ts_tablet_manager.cc:1403] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.038s user 0.008s sys 0.000s
I20260927 13:50:01.785205 6844 tablet_loader.cc:96] loaded metadata for tablet 068d9666ee6c43cb9fe65db8a647602f (table default.Table_ac04cc7df4cf46dcbec9dbbe9c207d5c [id=c7bc7539f5b04e5a82ecb5f176b60a9f])
I20260927 13:50:01.785671 6844 tablet_loader.cc:96] loaded metadata for tablet 06b8d6958e6f44d3a98ed96d89d4c1b4 (table default.Table_27e66012e36e4417a0ff30c28955e58e [id=77f96d35f95b45f9972f1e5cf494031f])
I20260927 13:50:01.786819 6844 tablet_loader.cc:96] loaded metadata for tablet 0851e183315a45f4a85d68d698e74cb7 (table default.Table_d930205241084c7b957ca0983bfb037f [id=dd996f6d5b764e799ed45890225b7670])
I20260927 13:50:01.786619 5628 raft_consensus.cc:359] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.786935 5628 raft_consensus.cc:385] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.787024 5628 raft_consensus.cc:740] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.787533 5628 consensus_queue.cc:260] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.788406 6844 tablet_loader.cc:96] loaded metadata for tablet 0d1443441b444075ab502ccdfa355a80 (table default.Table_552cc54d365f49b1848f9806cae88e18 [id=4906565a0f5949f797472db5e4daa544])
I20260927 13:50:01.788826 6844 tablet_loader.cc:96] loaded metadata for tablet 0d54e51b5c104c75b938aba55cecf890 (table default.Table_a02033f4b12c4cdd986cd855cb148309 [id=0c14f160c8ab4321b14a35fc5f8d3b56])
I20260927 13:50:01.789292 6844 tablet_loader.cc:96] loaded metadata for tablet 0dc69551c99942b09862904266572471 (table default.Table_ad5920def77f4a54aca3bcd967e12202 [id=6fa735ecdafb4f40b5f41de307eb13d0])
I20260927 13:50:01.790354 6844 tablet_loader.cc:96] loaded metadata for tablet 0ee829874a0d4f54a516c947685de021 (table default.Table_3787d49451114bc298d54d844cc68eaa [id=394868e5f3dc477d8825134327ccb4e9])
I20260927 13:50:01.790601 5619 raft_consensus.cc:359] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.790786 5619 raft_consensus.cc:385] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.790856 5619 raft_consensus.cc:740] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.791090 5619 consensus_queue.cc:260] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.791792 6844 tablet_loader.cc:96] loaded metadata for tablet 0fe47041b75d492bbce62c95d90de021 (table default.Table_f2000b1332564779b99fef20acf75a9a [id=a6d3f0f894904a738cc54fe5d8631f06])
I20260927 13:50:01.792400 6844 tablet_loader.cc:96] loaded metadata for tablet 1055c50e7ffd4d12a7c4ed424aa13eea (table default.Table_28a47364bcdf40bf851bc99d3513ca99 [id=2760dc486ae9433682cee682308534f4])
I20260927 13:50:01.793104 6844 tablet_loader.cc:96] loaded metadata for tablet 1087ad60dade46bb9d38f52a94dd536b (table default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07])
I20260927 13:50:01.794901 6844 tablet_loader.cc:96] loaded metadata for tablet 11d48db9b20a41419d5be703190fadd8 (table default.Table_5dfc30791e4347db940f164882d547d7 [id=4999b783a5ec458a8af3fbd21cf3ea5e])
I20260927 13:50:01.796420 6844 tablet_loader.cc:96] loaded metadata for tablet 13ad5733322545f699d980df99ae0dff (table default.Table_af1fdd99060c4fbcbd2e734ce850a4ad [id=671b833b30694e8ca3802d879a947f3b])
I20260927 13:50:01.796705 5619 ts_tablet_manager.cc:1434] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260927 13:50:01.796996 5619 tablet_bootstrap.cc:492] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.798233 6844 tablet_loader.cc:96] loaded metadata for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4])
I20260927 13:50:01.799639 6844 tablet_loader.cc:96] loaded metadata for tablet 1539107b91604cabbd944ee973443137 (table default.Table_4b4079f348f74177a204289b41a9e534 [id=7d48c041dbd342ebb7cf97af67ae636f])
I20260927 13:50:01.801101 6844 tablet_loader.cc:96] loaded metadata for tablet 1575501a5d1f4b0d80f153cf5bde5fa9 (table default.Table_13294c9335de4fd3ad6c089efad19634 [id=4da4496b3f7b4dada56f6a6cb22f7569])
I20260927 13:50:01.801998 6844 tablet_loader.cc:96] loaded metadata for tablet 1636b9f2dbbc46b3a8e554ed220d2a38 (table default.Table_a635daf12a4a42d5b5ba20c5eb11daa5 [id=90ae08ac2494432c84e387c80c1c2ee6])
I20260927 13:50:01.802873 6844 tablet_loader.cc:96] loaded metadata for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf])
I20260927 13:50:01.804389 6844 tablet_loader.cc:96] loaded metadata for tablet 187b3ceeccb142c4b798947e584d6044 (table default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82])
I20260927 13:50:01.805879 5628 ts_tablet_manager.cc:1434] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260927 13:50:01.806877 6844 tablet_loader.cc:96] loaded metadata for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050])
I20260927 13:50:01.808287 6844 tablet_loader.cc:96] loaded metadata for tablet 1b4494b7e895454f81fef308950729ef (table default.Table_8e30f259d16146d18136753eb1805e15 [id=ee0789e9d1f34c3791d35794473e2246])
I20260927 13:50:01.809614 6844 tablet_loader.cc:96] loaded metadata for tablet 1cc174eab36b46fb8e276b3168fbfbcd (table default.Table_6c94b6fc356049de8f16c25b4cba8c43 [id=e0fbdd8436ba42fabce301642d17dabe])
I20260927 13:50:01.810647 6844 tablet_loader.cc:96] loaded metadata for tablet 1f1ff7efba2042588a05a461d6179813 (table default.Table_c4f4659ddd2a47c48ae7d545ac78f2cc [id=c2a8b1992a3a4410b6e0a53d5beb27bf])
I20260927 13:50:01.812098 6844 tablet_loader.cc:96] loaded metadata for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5])
I20260927 13:50:01.813625 6844 tablet_loader.cc:96] loaded metadata for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549])
I20260927 13:50:01.813961 5628 tablet_bootstrap.cc:492] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.815168 6844 tablet_loader.cc:96] loaded metadata for tablet 24bd9a95e2d24242aba890ee9d01c023 (table default.Table_e349439f77f540cd8fc369d3f4217757 [id=740644d5da164e1f99a37b02ab614292])
I20260927 13:50:01.815629 5619 tablet_bootstrap.cc:654] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.815928 5628 tablet_bootstrap.cc:654] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.816704 6844 tablet_loader.cc:96] loaded metadata for tablet 262cb3e5f847409993e1ca20c296bff3 (table default.Table_eaa1571598144afbb2bb374264f3f84a [id=6f2177bb5be94c0e99a15217b1c84169])
I20260927 13:50:01.817992 6844 tablet_loader.cc:96] loaded metadata for tablet 269cda0876e346149512e0b4985c6890 (table default.Table_4384df2328734676b60b16fe84947703 [id=b39f412819df4df0ba22acf8813e397a])
I20260927 13:50:01.819528 6844 tablet_loader.cc:96] loaded metadata for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349])
I20260927 13:50:01.820760 6844 tablet_loader.cc:96] loaded metadata for tablet 2753a2efb2094219bcb02825e9568d7e (table default.Table_e512f6e2722c488da1df36462f461d3d [id=334c5498104b4128918d0830e469dc2e])
I20260927 13:50:01.821633 6844 tablet_loader.cc:96] loaded metadata for tablet 277615c97d9945269ba94d9d7c1c0464 (table default.Table_5de6d07207814569a0b1f42ac2e12c24 [id=87e80bd0bbe04f43b582390b45a522f7])
I20260927 13:50:01.823460 6844 tablet_loader.cc:96] loaded metadata for tablet 28da0fdf9b4740d7ac461308de572306 (table default.Table_bdd9cd69a46646c09a795b8566ba23aa [id=d64611e8699c410c919a48b0c4441e63])
I20260927 13:50:01.825872 6844 tablet_loader.cc:96] loaded metadata for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62])
I20260927 13:50:01.827265 6844 tablet_loader.cc:96] loaded metadata for tablet 2a92a10032dd40008cdcffd0699e1874 (table default.Table_022283b66bf4471691348ed0a603a4c3 [id=fca092c89d4e44cfbce954b0d0fd8400])
I20260927 13:50:01.827798 5619 tablet_bootstrap.cc:492] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:01.827967 5619 ts_tablet_manager.cc:1403] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20260927 13:50:01.828966 5619 raft_consensus.cc:359] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.829177 5619 raft_consensus.cc:385] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.829254 5619 raft_consensus.cc:740] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.829617 6844 tablet_loader.cc:96] loaded metadata for tablet 2c7a90d0fc534ef792788886207b29d2 (table default.Table_32fe69927df64b76b1aefe941e9f4241 [id=baed5667f9254dd99700c6d185b44535])
I20260927 13:50:01.830077 5619 consensus_queue.cc:260] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.830622 5626 tablet_bootstrap.cc:492] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.830871 5626 ts_tablet_manager.cc:1403] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.018s
I20260927 13:50:01.831773 5626 raft_consensus.cc:359] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.832067 5626 raft_consensus.cc:385] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.832176 5626 raft_consensus.cc:740] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.832580 5628 tablet_bootstrap.cc:492] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.832494 5626 consensus_queue.cc:260] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.832732 5628 ts_tablet_manager.cc:1403] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260927 13:50:01.835659 5626 ts_tablet_manager.cc:1434] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:50:01.835860 5628 raft_consensus.cc:359] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.836089 5626 tablet_bootstrap.cc:492] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.836119 5628 raft_consensus.cc:385] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.836217 5628 raft_consensus.cc:740] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.836524 5628 consensus_queue.cc:260] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.838397 5626 tablet_bootstrap.cc:654] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.838734 6844 tablet_loader.cc:96] loaded metadata for tablet 2cc7301d09b245328a851a0734669965 (table default.Table_be21b5e424724df9868d8ded75617bdb [id=1f268483d3c7447abfe7a024dd0aec58])
I20260927 13:50:01.839769 6844 tablet_loader.cc:96] loaded metadata for tablet 2d9698b0d8d04b29b73c471fdc5a38d0 (table default.Table_785ec15814b242ab835f0346e5d32b8d [id=0738d99d37cc4005935ac64dd8223c22])
I20260927 13:50:01.840273 6844 tablet_loader.cc:96] loaded metadata for tablet 2dbb54cd2eb14f5c87775215e327a65b (table default.Table_8b6f31a00cb34848816c0655566a3bbc [id=7c6323b2512c48e9a41c28282e9327be])
I20260927 13:50:01.842485 6844 tablet_loader.cc:96] loaded metadata for tablet 2f7bb872f4c347e2a0b4ee4dc1c787ef (table default.Table_a7a5af7cfafc47a49d35f8a72e1d1ab5 [id=84210551dbfd4670b948ea3357d599e2])
I20260927 13:50:01.842965 6844 tablet_loader.cc:96] loaded metadata for tablet 3002129c9c744881b21da22ddee86589 (table default.Table_69a87aa5933f49eaaa3085e0b505f5ca [id=97c4d9da0cc54c3d842a2001313e9a8a])
I20260927 13:50:01.843858 6844 tablet_loader.cc:96] loaded metadata for tablet 319a788b7d9542f6a2ae11e21bc8af55 (table default.Table_74c7885b9da54e549b3e0207088d8fc2 [id=3f099f07c6384429bb435c7c9f363866])
I20260927 13:50:01.844266 5628 ts_tablet_manager.cc:1434] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260927 13:50:01.845592 5619 ts_tablet_manager.cc:1434] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260927 13:50:01.846076 5628 tablet_bootstrap.cc:492] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.848039 5628 tablet_bootstrap.cc:654] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.852304 6844 tablet_loader.cc:96] loaded metadata for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63])
I20260927 13:50:01.853216 5619 tablet_bootstrap.cc:492] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:01.853786 5626 tablet_bootstrap.cc:492] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.854027 5626 ts_tablet_manager.cc:1403] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260927 13:50:01.854921 5626 raft_consensus.cc:359] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.855165 5619 tablet_bootstrap.cc:654] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.855206 5626 raft_consensus.cc:385] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.855370 5626 raft_consensus.cc:740] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.855662 5626 consensus_queue.cc:260] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.856534 5626 ts_tablet_manager.cc:1434] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:01.856899 5626 tablet_bootstrap.cc:492] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.858300 6779 consensus_queue.cc:1048] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:01.859082 5626 tablet_bootstrap.cc:654] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.860529 6844 tablet_loader.cc:96] loaded metadata for tablet 351132ca12924a35910ca5473696a02f (table default.Table_060df9c137224b90b29c16e43fce88ef [id=9f535502ed1745438ed8e3292ebec99d])
I20260927 13:50:01.861124 6844 tablet_loader.cc:96] loaded metadata for tablet 3513663de6724b108adcb46cc151163c (table default.Table_dcdd264dd7c84641aac8566bae2bf8b6 [id=6b9a7948d0b34aa89f9f7c58a2cd2a0e])
I20260927 13:50:01.861766 6844 tablet_loader.cc:96] loaded metadata for tablet 352aacd4c0984bc0bea7590fa2d7a95a (table default.Table_7925881f0cb44436964ec5d3a85ccb31 [id=a92416af3eac48e0b7a272bdc8bb83c4])
I20260927 13:50:01.862411 6844 tablet_loader.cc:96] loaded metadata for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3])
I20260927 13:50:01.863059 6844 tablet_loader.cc:96] loaded metadata for tablet 36181512a94c4702ae0a417665919faa (table default.Table_06b04cbe300b4373813df57694d32684 [id=ed3f5ac2c7fe4efeaa58e8a11100851b])
I20260927 13:50:01.863653 6844 tablet_loader.cc:96] loaded metadata for tablet 362f660cac76436aba54bb707d8a991c (table default.Table_d6b9b32a54ed4746b880a4ae62ad9ba3 [id=2d2f55956ec141f0b2de4501fbc6c655])
I20260927 13:50:01.864550 6844 tablet_loader.cc:96] loaded metadata for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_f91817f1255d4f8fa48accfa3c7c842d [id=750521adcb384c75841d7e1ff89af83d])
I20260927 13:50:01.866297 6844 tablet_loader.cc:96] loaded metadata for tablet 383cdd68cd5544b399d57e32298bf9db (table default.Table_36a0d6612db348268c1305cf46302992 [id=61efed7929c1470a8463a5a99b493c6d])
I20260927 13:50:01.866701 6844 tablet_loader.cc:96] loaded metadata for tablet 38a34074d833424bae6035d9e437ad3e (table default.Table_a836a91c61ae4aa699a3e710b418f9cd [id=51e1c9946f8a4d46bfc5c2d135742f69])
I20260927 13:50:01.868505 6844 tablet_loader.cc:96] loaded metadata for tablet 3b26289ed050454d817c13159295ec37 (table default.Table_5972ad040bd64ddda4bf22eac0f03998 [id=9c86bcdd37654832b7a92763aa42e6c4])
I20260927 13:50:01.869472 6844 tablet_loader.cc:96] loaded metadata for tablet 3ca0a33f13a34ea6be915c5c88a04326 (table default.Table_ed2fe75361bf46b9ab3ed0222e2758f8 [id=a03980cccfd04c6ea5e1c487788d709c])
I20260927 13:50:01.870061 6844 tablet_loader.cc:96] loaded metadata for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71])
I20260927 13:50:01.870853 6880 raft_consensus.cc:493] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.870997 6880 raft_consensus.cc:515] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.871554 6880 leader_election.cc:290] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.872314 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3513663de6724b108adcb46cc151163c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.872447 6844 tablet_loader.cc:96] loaded metadata for tablet 445f0b64c0564670842aa582c998c2de (table default.Table_985a589956d74837978aa757b2b52b61 [id=0babbde1882745c7ac6712c82da30d17])
I20260927 13:50:01.872493 5248 raft_consensus.cc:2468] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:01.872886 6844 tablet_loader.cc:96] loaded metadata for tablet 449e6bf85bf1434ab6ce42e751d31c6f (table default.Table_4683c7ce10d24c28964cc8268a92ce52 [id=378ab630e5534a0b9210c3a1d08ad912])
I20260927 13:50:01.873099 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3513663de6724b108adcb46cc151163c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:01.873317 5106 raft_consensus.cc:2468] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:01.873832 5319 leader_election.cc:304] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.873903 5628 tablet_bootstrap.cc:492] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.874079 5628 ts_tablet_manager.cc:1403] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.002s
I20260927 13:50:01.874090 6791 raft_consensus.cc:493] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.874215 6791 raft_consensus.cc:515] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.874773 6791 leader_election.cc:290] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.874902 6791 raft_consensus.cc:2804] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.874948 6791 raft_consensus.cc:493] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.874997 6791 raft_consensus.cc:3060] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.875095 5628 raft_consensus.cc:359] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.875330 5628 raft_consensus.cc:385] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.875415 5628 raft_consensus.cc:740] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.875667 5628 consensus_queue.cc:260] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.876205 6844 tablet_loader.cc:96] loaded metadata for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e])
I20260927 13:50:01.876533 6844 tablet_loader.cc:96] loaded metadata for tablet 44d85213c05c465abda78cc49c70d36f (table default.Table_4155d438fc7c4d6cbe87e16451c6bbba [id=2d2e2254587f4832b7ad918724eeea64])
I20260927 13:50:01.877624 6844 tablet_loader.cc:96] loaded metadata for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 (table default.Table_94ba7a27252044beb2d23563d4092a8f [id=4de8c6767c5640f2ab7b54f6e8884709])
I20260927 13:50:01.877939 6844 tablet_loader.cc:96] loaded metadata for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65])
I20260927 13:50:01.877874 6791 raft_consensus.cc:515] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.879233 6844 tablet_loader.cc:96] loaded metadata for tablet 4b13c629908a47368846770c697aebd8 (table default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26])
I20260927 13:50:01.879359 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52050d7e35dc4fbab3c7c079d07478e8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.879942 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52050d7e35dc4fbab3c7c079d07478e8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:01.880122 5106 raft_consensus.cc:2468] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:01.880682 5628 ts_tablet_manager.cc:1434] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:50:01.880695 5319 leader_election.cc:304] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:50:01.880990 5319 leader_election.cc:343] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.881270 6880 raft_consensus.cc:2804] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.881361 6880 raft_consensus.cc:493] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.881428 6880 raft_consensus.cc:3060] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.884372 6880 raft_consensus.cc:515] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.885253 6880 leader_election.cc:290] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.886322 6791 leader_election.cc:290] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.886512 6791 raft_consensus.cc:493] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.886684 6791 raft_consensus.cc:515] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.887240 6791 leader_election.cc:290] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:01.888466 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3513663de6724b108adcb46cc151163c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:01.888628 5247 raft_consensus.cc:3060] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.888648 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4211f338c6a648c5b3e36c6df0b3c510" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:01.889335 5319 leader_election.cc:343] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.889657 6695 consensus_queue.cc:1048] T d0cf4234fa5e42469ba6b9bdee1e793f P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:01.890401 5626 tablet_bootstrap.cc:492] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.890516 5626 ts_tablet_manager.cc:1403] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.008s
I20260927 13:50:01.890898 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52050d7e35dc4fbab3c7c079d07478e8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:01.891067 5106 raft_consensus.cc:3060] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.891088 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3513663de6724b108adcb46cc151163c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:01.891276 5107 raft_consensus.cc:3060] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.891324 5247 raft_consensus.cc:2468] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:01.893814 5106 raft_consensus.cc:2468] T 52050d7e35dc4fbab3c7c079d07478e8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:50:01.894287 5319 leader_election.cc:343] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 4211f338c6a648c5b3e36c6df0b3c510
I20260927 13:50:01.894408 5319 leader_election.cc:304] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.893913 5107 raft_consensus.cc:2468] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:01.894724 6882 raft_consensus.cc:2749] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.895183 5628 tablet_bootstrap.cc:492] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.895242 5319 leader_election.cc:304] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.895496 6882 raft_consensus.cc:2804] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.895637 6882 raft_consensus.cc:697] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:01.891332 5626 raft_consensus.cc:359] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.895908 6882 consensus_queue.cc:237] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.896029 5626 raft_consensus.cc:385] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.896080 5626 raft_consensus.cc:740] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.896301 5626 consensus_queue.cc:260] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.897821 5626 ts_tablet_manager.cc:1434] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 13:50:01.898104 5626 tablet_bootstrap.cc:492] T 860aa52d44ad494594c73707e6ef98e2 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.897130 5319 leader_election.cc:304] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.898540 6844 tablet_loader.cc:96] loaded metadata for tablet 4c63b0f83c764d179d00cdb8492fea11 (table default.Table_c241bde0378b4e4c9c963550525f9663 [id=dfe83376b8974bc4ba3140869ce88d76])
I20260927 13:50:01.899032 5628 tablet_bootstrap.cc:654] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.899353 6793 raft_consensus.cc:2804] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.899477 6793 raft_consensus.cc:697] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:01.899732 6793 consensus_queue.cc:237] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.900285 6844 tablet_loader.cc:96] loaded metadata for tablet 4fe7d3f3a6ec49438d0a710b45163d0b (table default.Table_6d1d864c184e45a194cc02929a81a980 [id=818f666fe18a42d499a28124b7c307b4])
I20260927 13:50:01.900530 5626 tablet_bootstrap.cc:654] T 860aa52d44ad494594c73707e6ef98e2 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.900688 6844 tablet_loader.cc:96] loaded metadata for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a])
I20260927 13:50:01.902129 6844 tablet_loader.cc:96] loaded metadata for tablet 50c2661998134488a95b4750d0e653a6 (table default.Table_8ccdfb70bd5f4ae9912dd1e5669a09e3 [id=c39aa424f92d4fc8bf69b9829737f61e])
I20260927 13:50:01.903039 6844 tablet_loader.cc:96] loaded metadata for tablet 52050d7e35dc4fbab3c7c079d07478e8 (table default.Table_8bd375289d574bfeba1cc363b93ad32f [id=77004a3da7944e7a9b9a4d2fa36021c3])
I20260927 13:50:01.903656 6844 tablet_loader.cc:96] loaded metadata for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d])
I20260927 13:50:01.905045 6844 tablet_loader.cc:96] loaded metadata for tablet 564f5c92bf144fa1bfc2e1e07132dd69 (table default.Table_2d7d460396774c7982b3391c3ad1827f [id=c81f7b3016144fd7a7329fbf31049d93])
I20260927 13:50:01.906260 5626 tablet_bootstrap.cc:492] T 860aa52d44ad494594c73707e6ef98e2 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:01.906394 5626 ts_tablet_manager.cc:1403] T 860aa52d44ad494594c73707e6ef98e2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260927 13:50:01.906805 6844 tablet_loader.cc:96] loaded metadata for tablet 5678703b72c8471583147786f49122a5 (table default.Table_2b8dc798fa334079a96ce21a0a5358a0 [id=0d85f9f0d28e43debda43f83a3e59637])
I20260927 13:50:01.908846 6844 tablet_loader.cc:96] loaded metadata for tablet 5848740410d74e749ad6c44591ab0d24 (table default.Table_f33f22d6ee3f458694985ca9a9c3c488 [id=43db068fa4a04954b3638aa09347fe91])
I20260927 13:50:01.909605 6844 tablet_loader.cc:96] loaded metadata for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1])
I20260927 13:50:01.909991 6844 tablet_loader.cc:96] loaded metadata for tablet 58d9274ad0934f19a7c36325eee3dd59 (table default.Table_544497088a2047e8a6b190c4e23e3e1c [id=d7b1a5499c5f4f9784a8952f1e66c3f7])
I20260927 13:50:01.910360 6896 consensus_queue.cc:1048] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:01.911670 6844 tablet_loader.cc:96] loaded metadata for tablet 5c69163fb77442be9215f8f285b904ef (table default.Table_3905bc395f754c2d93037c9b56a09515 [id=f5627b57c0564716bd5a2011827bb666])
I20260927 13:50:01.912535 6844 tablet_loader.cc:96] loaded metadata for tablet 60de1c28618f4e478aae68ad07fbcf98 (table default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579])
I20260927 13:50:01.912603 6779 raft_consensus.cc:493] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.912766 6779 raft_consensus.cc:515] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.912984 6844 tablet_loader.cc:96] loaded metadata for tablet 60e3bee895c7405ba37d54ffc7a436b6 (table default.Table_9f53709861824b0591e1b8ce63a64393 [id=bd0f9079417b4b609bd68a7abb12e8d7])
I20260927 13:50:01.913348 6779 leader_election.cc:290] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.914047 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54cf8c485324f798d59edf65d52d7b5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.914536 6844 tablet_loader.cc:96] loaded metadata for tablet 65d5827b5ffd4ea1abbc94c0431709a8 (table default.Table_e73d23c994cc4762a1a69683c398766c [id=3c902c803fbf4be9a5a49f9f41ce2484])
W20260927 13:50:01.914601 5044 leader_election.cc:343] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.915031 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54cf8c485324f798d59edf65d52d7b5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:01.915524 5045 leader_election.cc:343] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.915659 5045 leader_election.cc:304] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.915978 6844 tablet_loader.cc:96] loaded metadata for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc])
I20260927 13:50:01.916052 6779 raft_consensus.cc:2749] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:01.916531 6844 tablet_loader.cc:96] loaded metadata for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3])
I20260927 13:50:01.916690 5626 raft_consensus.cc:359] T 860aa52d44ad494594c73707e6ef98e2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.916867 5626 raft_consensus.cc:385] T 860aa52d44ad494594c73707e6ef98e2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.916916 5626 raft_consensus.cc:740] T 860aa52d44ad494594c73707e6ef98e2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.918068 5628 tablet_bootstrap.cc:492] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.918232 5628 ts_tablet_manager.cc:1403] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.002s
I20260927 13:50:01.918190 5626 consensus_queue.cc:260] T 860aa52d44ad494594c73707e6ef98e2 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.919085 5628 raft_consensus.cc:359] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.919275 5628 raft_consensus.cc:385] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.919358 5628 raft_consensus.cc:740] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.919397 5626 ts_tablet_manager.cc:1434] T 860aa52d44ad494594c73707e6ef98e2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260927 13:50:01.919567 5628 consensus_queue.cc:260] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.919674 5626 tablet_bootstrap.cc:492] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:01.920040 5628 ts_tablet_manager.cc:1434] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:01.920338 5628 tablet_bootstrap.cc:492] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.922752 5628 tablet_bootstrap.cc:654] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.917304 6844 tablet_loader.cc:96] loaded metadata for tablet 67b921ed2ca0425b86cc2e679d0320cc (table default.Table_3efafc6b184f4f73bd2b6fad23d8991c [id=d6e13461272741bb8e15183f5bc473d2])
W20260927 13:50:01.924240 5184 consensus_peers.cc:597] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e3fa4870d5547a2bbffe1745b964504. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:01.924291 6844 tablet_loader.cc:96] loaded metadata for tablet 67bc77ee83784b11a74f94351fe2c616 (table default.Table_0b1ea5a791894bfebc59ed28e5506e20 [id=5b376d8103c148d195b730d58176db8b])
I20260927 13:50:01.924706 6844 tablet_loader.cc:96] loaded metadata for tablet 67d68e0b7b384412ad65f7252950f280 (table default.Table_0480d2e07b2843fdb6ea6e57d134ac20 [id=a61b65ac19e3422b8b6254c3753e02db])
I20260927 13:50:01.926374 6844 tablet_loader.cc:96] loaded metadata for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0])
I20260927 13:50:01.927898 6844 tablet_loader.cc:96] loaded metadata for tablet 6aafbbdaa8ac48329ad422cb0c08e518 (table default.Table_a212266119b14cedb7576aff1e810ca4 [id=c35db2ada8d742c3a967191a6f539cfd])
I20260927 13:50:01.930481 6844 tablet_loader.cc:96] loaded metadata for tablet 6c5029530585402ab0e8f3939160c093 (table default.Table_cf41b07a629f42719692319b42490645 [id=57e451bbebf54b159621a6dd5ed08944])
I20260927 13:50:01.931106 6844 tablet_loader.cc:96] loaded metadata for tablet 6c82fd138de14f218b4ec2c7d44723bf (table default.Table_60e4fad358b94bf5a7dcf5632fabd19d [id=64bcf428240942d59593eb02e4843760])
I20260927 13:50:01.930727 5626 tablet_bootstrap.cc:654] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.932329 6844 tablet_loader.cc:96] loaded metadata for tablet 6de346dcbaa7433db7ee0f23b6e7df45 (table default.Table_7a4d7f5d2d204a5c8a42b30ae9b4623d [id=c920b19c5b2041dd915de732f5b0c640])
W20260927 13:50:01.932607 5184 consensus_peers.cc:597] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e30216e0487496f8efdb8a3b06deb5a. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:01.933503 6844 tablet_loader.cc:96] loaded metadata for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_445d25d3eeb64eb3845dad47fa41f27d [id=b7649e0adc2e4b6c82afa8d846d54aa1])
I20260927 13:50:01.934070 6791 consensus_queue.cc:1048] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:01.934621 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52050d7e35dc4fbab3c7c079d07478e8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:01.936340 6844 tablet_loader.cc:96] loaded metadata for tablet 71299230399649d29444f30f94ad0f1b (table default.Table_f11cc18b15654825aa1a7da20c318f26 [id=0d0c63fb4b8d4675a1678a59012efe80])
I20260927 13:50:01.936972 6844 tablet_loader.cc:96] loaded metadata for tablet 71bd7f25c086418297db7f576f45f92d (table default.Table_835ec246322b4927a1c94badce00f804 [id=47b130fed16142099cfe308ab98849f1])
W20260927 13:50:01.936975 5319 leader_election.cc:343] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.942814 6779 raft_consensus.cc:493] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.942972 6779 raft_consensus.cc:515] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.943542 6779 leader_election.cc:290] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:01.945072 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae6b1e46bdc4c28a2d0a2633d40f92a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:01.945722 5044 leader_election.cc:343] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.948117 6752 raft_consensus.cc:493] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.948268 6752 raft_consensus.cc:515] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.948873 6752 leader_election.cc:290] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.949600 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc140bba42a43758fa0c6540d728275" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.949833 5382 raft_consensus.cc:2468] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:01.950413 5185 leader_election.cc:304] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.950874 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae6b1e46bdc4c28a2d0a2633d40f92a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.951277 6752 raft_consensus.cc:2804] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.951372 6752 raft_consensus.cc:493] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.951433 6752 raft_consensus.cc:3060] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:01.951457 5045 leader_election.cc:343] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.951602 5045 leader_election.cc:304] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:01.951946 6779 raft_consensus.cc:2749] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:01.955224 5184 leader_election.cc:343] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7dc140bba42a43758fa0c6540d728275
I20260927 13:50:01.957046 6752 raft_consensus.cc:515] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:01.958488 5184 leader_election.cc:343] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7dc140bba42a43758fa0c6540d728275
I20260927 13:50:01.959165 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc140bba42a43758fa0c6540d728275" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:01.959266 5628 tablet_bootstrap.cc:492] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.959404 5382 raft_consensus.cc:3060] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.959568 5628 ts_tablet_manager.cc:1403] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.004s
I20260927 13:50:01.960386 5628 raft_consensus.cc:359] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.960644 5628 raft_consensus.cc:385] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.960783 5628 raft_consensus.cc:740] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.961102 5628 consensus_queue.cc:260] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.961784 5628 ts_tablet_manager.cc:1434] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:01.962097 5628 tablet_bootstrap.cc:492] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:01.962905 5382 raft_consensus.cc:2468] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:01.963408 6752 leader_election.cc:290] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.964808 5628 tablet_bootstrap.cc:654] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:01.965695 5185 leader_election.cc:304] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.967900 6844 tablet_loader.cc:96] loaded metadata for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b])
I20260927 13:50:01.968472 6844 tablet_loader.cc:96] loaded metadata for tablet 740245532e274e2bab26dd84a68efa91 (table default.Table_6e893d08117849cea8b823b4d752b91b [id=c622333396e0438788c417822274dc41])
I20260927 13:50:01.973162 6882 raft_consensus.cc:493] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.973328 6882 raft_consensus.cc:515] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:01.973948 6882 leader_election.cc:290] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:01.974094 6882 raft_consensus.cc:493] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.974227 6882 raft_consensus.cc:515] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.974751 6882 leader_election.cc:290] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.975615 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afb800e7ff44aadaed8f8d85aa9efe2" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.975881 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413d863d9a564e5d8325b4479346730d" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:01.976608 6844 tablet_loader.cc:96] loaded metadata for tablet 7469927f3893494aa36b8f5b4d2d4146 (table default.Table_438c450d2fff477aaf6e67a530a1532a [id=aa804ddccaec408bbfca331d8b49125a])
W20260927 13:50:01.976778 5319 leader_election.cc:343] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:01.977020 5319 leader_election.cc:343] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:01.978166 6857 raft_consensus.cc:2804] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.978283 6857 raft_consensus.cc:697] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:01.978506 6857 consensus_queue.cc:237] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:01.978614 5319 leader_election.cc:343] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3afb800e7ff44aadaed8f8d85aa9efe2
I20260927 13:50:01.978756 5319 leader_election.cc:304] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:01.979089 6844 tablet_loader.cc:96] loaded metadata for tablet 76a3568681214fb1943b2c7e903288ea (table default.Table_35a9895ba749499586d31bae3003ffdf [id=724488630f4f462e85698b08da118551])
I20260927 13:50:01.979446 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413d863d9a564e5d8325b4479346730d" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:01.979642 5105 raft_consensus.cc:2468] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:01.979851 6896 raft_consensus.cc:493] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:01.979949 6844 tablet_loader.cc:96] loaded metadata for tablet 76cf11a5af384512b361a83487c8b117 (table default.Table_8d512449c471495286c66f025bfa4621 [id=1ee0716eaa60467ea085de14e7378c76])
I20260927 13:50:01.979951 6896 raft_consensus.cc:515] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.980437 6896 leader_election.cc:290] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:01.982263 6844 tablet_loader.cc:96] loaded metadata for tablet 78719428d7b34f28a99722b093f6ab54 (table default.Table_a4d76e32d0c349abafc8f800e4acb8c7 [id=ed8d36823c5c43eaa1e8b0447c7f32e9])
I20260927 13:50:01.986528 6844 tablet_loader.cc:96] loaded metadata for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb])
I20260927 13:50:01.987217 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2f814bb9ff41ebab19e8c16cf4affa" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:01.987416 5383 raft_consensus.cc:2468] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:01.987290 6844 tablet_loader.cc:96] loaded metadata for tablet 78e409e186a24070b3fb3087fd805aa6 (table default.Table_800bad10399f4515acb401f9be49e957 [id=b0d2a5de33884946b95e67dffb65b617])
I20260927 13:50:01.987813 5185 leader_election.cc:304] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:01.988076 6896 raft_consensus.cc:2804] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:01.988142 6896 raft_consensus.cc:493] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:01.988201 6896 raft_consensus.cc:3060] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.988582 5628 tablet_bootstrap.cc:492] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:01.988796 5628 ts_tablet_manager.cc:1403] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.004s
W20260927 13:50:01.988982 5184 leader_election.cc:343] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7c2f814bb9ff41ebab19e8c16cf4affa
I20260927 13:50:01.989329 6791 consensus_queue.cc:1048] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:01.989733 5628 raft_consensus.cc:359] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.989964 5628 raft_consensus.cc:385] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:01.990067 5628 raft_consensus.cc:740] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:01.990398 5628 consensus_queue.cc:260] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.991091 6896 raft_consensus.cc:515] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:01.992025 6896 leader_election.cc:290] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:01.992820 5184 leader_election.cc:343] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7c2f814bb9ff41ebab19e8c16cf4affa
I20260927 13:50:01.993091 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2f814bb9ff41ebab19e8c16cf4affa" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:01.993279 5382 raft_consensus.cc:3060] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:01.996237 5382 raft_consensus.cc:2468] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:01.996680 5185 leader_election.cc:304] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:01.997162 6896 raft_consensus.cc:2804] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:01.997313 6896 raft_consensus.cc:697] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:01.997579 6896 consensus_queue.cc:237] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.000259 5628 ts_tablet_manager.cc:1434] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260927 13:50:02.009037 5628 tablet_bootstrap.cc:492] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.011464 6844 tablet_loader.cc:96] loaded metadata for tablet 7b229676c51e42d8bdd473f5d5fb1464 (table default.Table_645d9205892845cdb661a97f3576207e [id=c5b8489d57cf4ceabd115dfec550c9ec])
I20260927 13:50:02.012730 5628 tablet_bootstrap.cc:654] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.016481 6844 tablet_loader.cc:96] loaded metadata for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda])
I20260927 13:50:02.017403 6752 consensus_queue.cc:1048] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.018088 6779 raft_consensus.cc:493] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.018252 6779 raft_consensus.cc:515] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.018851 6779 leader_election.cc:290] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.021523 6844 tablet_loader.cc:96] loaded metadata for tablet 80fe8af2068948c78feac4641a7525be (table default.Table_114b4e4e5a834c1bb0468e42edf6cb6f [id=73340bb48c8e4ef890b4fab3a86e2e53])
I20260927 13:50:02.021909 6844 tablet_loader.cc:96] loaded metadata for tablet 820a5574f2304cb7b34ebdbf1f0937f2 (table default.Table_22c755d674734bbdaf00ff031dd35bde [id=e3b2f033f16b4d1185c45d1dc7e99515])
I20260927 13:50:02.023288 6882 raft_consensus.cc:2749] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.024093 6844 tablet_loader.cc:96] loaded metadata for tablet 8437f48a0c4645fbbc205aca8def77b5 (table default.Table_75865dd4349e418896b4469e10a62252 [id=eaf034197b00472287e8218a4ecd41bc])
I20260927 13:50:02.024194 5626 tablet_bootstrap.cc:492] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:02.024356 5626 ts_tablet_manager.cc:1403] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.105s user 0.003s sys 0.003s
I20260927 13:50:02.025059 6844 tablet_loader.cc:96] loaded metadata for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_162ac02f5d444371ad6d85becb6b16a0 [id=de8b7ce50f8c4bb4a105d25f701d4d82])
I20260927 13:50:02.025097 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:02.025777 5044 leader_election.cc:343] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.027398 5626 raft_consensus.cc:359] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.027653 5626 raft_consensus.cc:385] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.027773 5626 raft_consensus.cc:740] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.027872 6844 tablet_loader.cc:96] loaded metadata for tablet 85debab98b0f42a5b50f1b0d132147d3 (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56])
I20260927 13:50:02.028199 5619 tablet_bootstrap.cc:492] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
W20260927 13:50:02.028584 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 50011.3us
I20260927 13:50:02.029067 5628 tablet_bootstrap.cc:492] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.029291 5628 ts_tablet_manager.cc:1403] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260927 13:50:02.029389 5319 leader_election.cc:304] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.029112 5619 ts_tablet_manager.cc:1403] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.176s user 0.004s sys 0.017s
I20260927 13:50:02.029424 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.030083 6882 raft_consensus.cc:2804] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.030191 6882 raft_consensus.cc:493] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.030252 6882 raft_consensus.cc:3060] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.030369 5628 raft_consensus.cc:359] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.030551 5628 raft_consensus.cc:385] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.030625 5628 raft_consensus.cc:740] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.030889 5628 consensus_queue.cc:260] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.032979 6882 raft_consensus.cc:515] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.033537 6882 leader_election.cc:290] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.033057 5619 raft_consensus.cc:359] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.034021 5619 raft_consensus.cc:385] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.034668 5619 raft_consensus.cc:740] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.035997 5619 consensus_queue.cc:260] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.039659 5619 ts_tablet_manager.cc:1434] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260927 13:50:02.041651 5619 tablet_bootstrap.cc:492] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:02.041930 5628 ts_tablet_manager.cc:1434] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
W20260927 13:50:02.045799 5045 leader_election.cc:343] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.045967 5045 leader_election.cc:304] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.028304 5626 consensus_queue.cc:260] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.046257 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413d863d9a564e5d8325b4479346730d" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:02.046442 5107 raft_consensus.cc:3060] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.046535 6779 raft_consensus.cc:2749] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.046587 5626 ts_tablet_manager.cc:1434] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.022s user 0.000s sys 0.001s
I20260927 13:50:02.046897 5626 tablet_bootstrap.cc:492] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:02.048722 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413d863d9a564e5d8325b4479346730d" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:02.052407 5628 tablet_bootstrap.cc:492] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.054037 5628 tablet_bootstrap.cc:654] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.055796 6844 tablet_loader.cc:96] loaded metadata for tablet 860598d598dd4373b44075a932c7df52 (table default.Table_7881acf83e854c3d86e41bcea92e353d [id=61f811887e744ffe81d330661ab890f2])
I20260927 13:50:02.057197 5626 tablet_bootstrap.cc:654] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.057761 6844 tablet_loader.cc:96] loaded metadata for tablet 860aa52d44ad494594c73707e6ef98e2 (table default.Table_68a7db0e7ab24bd9b8e401ef348959ca [id=4f3cc928d2114af692215b91d4377656])
W20260927 13:50:02.058416 5319 leader_election.cc:343] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.063476 5619 tablet_bootstrap.cc:654] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.064798 6844 tablet_loader.cc:96] loaded metadata for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_908235dbf46e4c6f9a13506c919c6492 [id=fe64adff124845c0b35692c8e48f8759])
I20260927 13:50:02.065325 6844 tablet_loader.cc:96] loaded metadata for tablet 87802ba0a5fa4c5fb7e34da8621c8593 (table default.Table_83075bfe4fcb4d80b6a90c020b475e1b [id=b5f86a8836f749d5b8761878725da3a3])
I20260927 13:50:02.065796 6844 tablet_loader.cc:96] loaded metadata for tablet 87bba86a18504fc1ae2a3aef7f7c5a39 (table default.Table_a06dc9d175614ec2b842ccbb93b0f739 [id=7b0aaddfe9ba428c9c84960df68aaecf])
I20260927 13:50:02.066253 6844 tablet_loader.cc:96] loaded metadata for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc])
I20260927 13:50:02.072069 6844 tablet_loader.cc:96] loaded metadata for tablet 8b4d5bf420004d1aae51563ec3263b9a (table default.Table_83f977d77c3640b9b7c7c9ccfb96e327 [id=64d546b25be34918a7c80835c0ed7ac8])
I20260927 13:50:02.072932 6844 tablet_loader.cc:96] loaded metadata for tablet 8bbe5432474049b7b44aaeaa7393b696 (table default.Table_0c9a96d72b0f43e5afec0d076cff390d [id=81cbbfa2b27445209873c0f322ebf64e])
I20260927 13:50:02.075177 6844 tablet_loader.cc:96] loaded metadata for tablet 8c14a6b95c1e460a8e7a299340f09498 (table default.Table_65ed372bfab14cbd8ea34e25afdf59d7 [id=064c3328625f4e1faed6cd36616c9af1])
I20260927 13:50:02.076149 5626 tablet_bootstrap.cc:492] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:02.076300 5626 ts_tablet_manager.cc:1403] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.002s
I20260927 13:50:02.077065 5626 raft_consensus.cc:359] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.077245 5626 raft_consensus.cc:385] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.077301 5626 raft_consensus.cc:740] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.077440 5107 raft_consensus.cc:2468] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:02.078874 5319 leader_election.cc:304] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.079239 6880 raft_consensus.cc:2804] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.079375 6880 raft_consensus.cc:697] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:02.079519 5626 consensus_queue.cc:260] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.079639 6880 consensus_queue.cc:237] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.080137 5626 ts_tablet_manager.cc:1434] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:50:02.080143 6844 tablet_loader.cc:96] loaded metadata for tablet 8ed33e78ee5448bcae633cc874c3e171 (table default.Table_f8cf2e1f9d84401897db63d0a884c6b1 [id=1828e2f519ae4cbc810509b126d740e7])
I20260927 13:50:02.080402 5626 tablet_bootstrap.cc:492] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:02.081715 5628 tablet_bootstrap.cc:492] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.081851 5628 ts_tablet_manager.cc:1403] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260927 13:50:02.082757 5628 raft_consensus.cc:359] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.082931 5628 raft_consensus.cc:385] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.082998 5628 raft_consensus.cc:740] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.086887 6844 tablet_loader.cc:96] loaded metadata for tablet 8f0c532e0f064f40a1e2078b81fdc095 (table default.Table_3bd7d29894a24011b97fb7157002b917 [id=c2de98abee2849d9a2517bb6be800706])
I20260927 13:50:02.087127 5628 consensus_queue.cc:260] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.087646 6844 tablet_loader.cc:96] loaded metadata for tablet 8f102cad945b42b5ba128637d213acca (table default.Table_daa2858f5f994d1ba5432fa5506b2a44 [id=414bf9afb1d54d779d0324aff799dca9])
I20260927 13:50:02.093888 5628 ts_tablet_manager.cc:1434] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260927 13:50:02.094590 6791 raft_consensus.cc:493] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.094707 6844 tablet_loader.cc:96] loaded metadata for tablet 8ff6a19af8ae4c84af4a8095eca4115e (table default.Table_b24ebce499044fc5974be0e77bc778f6 [id=1a584f9450bb4b55aa73495c55b314f0])
I20260927 13:50:02.095081 5628 tablet_bootstrap.cc:492] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.094841 6791 raft_consensus.cc:515] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.101294 6791 leader_election.cc:290] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:02.101831 6844 tablet_loader.cc:96] loaded metadata for tablet 90fb369fec2d43149080ab2ad94ecc57 (table default.Table_b0b2ff4faec94fc9a83fc6271fd5ec6d [id=23ffbb0d3240465cb12a09ffec1f8163])
I20260927 13:50:02.103825 5628 tablet_bootstrap.cc:654] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.107793 6844 tablet_loader.cc:96] loaded metadata for tablet 95726f690a71433ca63f95da4ee750e5 (table default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e])
I20260927 13:50:02.108560 6844 tablet_loader.cc:96] loaded metadata for tablet 960822bb4f984ad481cdac3be2d4cca3 (table default.Table_57a1a48cec114fb98010ba314921320d [id=088c0f2f907244b383fb272aeda50e8d])
I20260927 13:50:02.109817 6844 tablet_loader.cc:96] loaded metadata for tablet 9775c853381749ad89906b32d3adee23 (table default.Table_e34a6db37cbf47d79d8f13cd46cc83fb [id=4d9779ad662542bda9207247226d34a3])
I20260927 13:50:02.112228 6844 tablet_loader.cc:96] loaded metadata for tablet 97b46497d8254a248df8d421d0b09d8d (table default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815])
I20260927 13:50:02.112480 5626 tablet_bootstrap.cc:654] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.113610 6844 tablet_loader.cc:96] loaded metadata for tablet 9858d2c788f54e30b67c1235af8f51af (table default.Table_aaa8c970b9124f9abcdb193f7539d309 [id=5308278b9daf4308a52aede42b353b64])
I20260927 13:50:02.114069 6844 tablet_loader.cc:96] loaded metadata for tablet 9872d637765b4d719e2de63ae1eb3196 (table default.Table_c7e950edad044de5b910f91a80448895 [id=fde3e0efd65f4345b3fd64d141753ca6])
I20260927 13:50:02.114547 6844 tablet_loader.cc:96] loaded metadata for tablet 98b434884a3f4c63a9ba341e53703023 (table default.Table_0956a69da22a495691888f08a70b62dc [id=126aea719ed34308a0742ed1fe5d6970])
I20260927 13:50:02.115852 6844 tablet_loader.cc:96] loaded metadata for tablet 992bf643dee64bccaa993a08027aa5fc (table default.Table_85388904282441d09642d64019688c97 [id=00fdc87b0cbf4bc091a92db3004b4397])
I20260927 13:50:02.116268 6844 tablet_loader.cc:96] loaded metadata for tablet 9971bbea3ec2425db728f7832a93fe06 (table default.Table_9749d8dab54a412fb6dd1234772d3155 [id=31e674233f944706b5ad3362d0c2db06])
I20260927 13:50:02.116276 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57886cc11a2423983c2b7bac79150a0" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:02.116297 5184 consensus_peers.cc:597] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 081f18e00af74e5c811f774d29422351. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:02.118024 6844 tablet_loader.cc:96] loaded metadata for tablet 9a35fefc73c54d6c9b1907f55add7b92 (table default.Table_cae391ea25ba4087b408c0792f9fac13 [id=d1ef529f97514e258f430548ed8ed1b3])
I20260927 13:50:02.118803 6844 tablet_loader.cc:96] loaded metadata for tablet 9a45a33fe0ca43099924266f704d8c19 (table default.Table_410ddd78682b4d2ebbfad8038609093b [id=49f63147052a489787f3a3935f3c9596])
W20260927 13:50:02.118783 5319 leader_election.cc:343] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b57886cc11a2423983c2b7bac79150a0
I20260927 13:50:02.119151 6793 consensus_queue.cc:1048] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:02.120244 5319 leader_election.cc:343] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.120354 5319 leader_election.cc:304] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.120553 6793 raft_consensus.cc:2749] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:02.121054 5319 consensus_peers.cc:597] T 3700a1f40c0644848da62392cb0c297f P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3700a1f40c0644848da62392cb0c297f. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:02.122177 6857 raft_consensus.cc:493] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.122304 6857 raft_consensus.cc:515] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.122836 6857 leader_election.cc:290] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:02.124161 5184 leader_election.cc:343] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f5b2b6f2ce1145a18c199bb37cc7e5b2
I20260927 13:50:02.124586 5628 tablet_bootstrap.cc:492] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.124761 5628 ts_tablet_manager.cc:1403] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260927 13:50:02.125718 5628 raft_consensus.cc:359] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.125934 5628 raft_consensus.cc:385] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.126004 5628 raft_consensus.cc:740] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.126377 5628 consensus_queue.cc:260] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.131371 6779 raft_consensus.cc:493] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.131500 6779 raft_consensus.cc:515] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.132061 6779 leader_election.cc:290] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.132570 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13c629908a47368846770c697aebd8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:02.133065 5044 leader_election.cc:343] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.133339 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b2b6f2ce1145a18c199bb37cc7e5b2" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.133533 5382 raft_consensus.cc:2468] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:02.134856 6752 raft_consensus.cc:493] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.134979 6752 raft_consensus.cc:515] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.135425 5185 leader_election.cc:304] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:02.135581 6752 leader_election.cc:290] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.135722 6752 raft_consensus.cc:2804] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.135793 6752 raft_consensus.cc:493] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.135860 6752 raft_consensus.cc:3060] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:02.136788 5184 leader_election.cc:343] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 0880140d99004eb1803d6b5dcf41af13
I20260927 13:50:02.134683 5628 ts_tablet_manager.cc:1434] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260927 13:50:02.138010 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0880140d99004eb1803d6b5dcf41af13" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.138288 5382 raft_consensus.cc:2468] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:02.142462 5185 leader_election.cc:304] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:02.143383 5628 tablet_bootstrap.cc:492] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.143472 6973 raft_consensus.cc:2804] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.143563 6973 raft_consensus.cc:493] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.143656 6973 raft_consensus.cc:3060] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.145144 5628 tablet_bootstrap.cc:654] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.146198 6844 tablet_loader.cc:96] loaded metadata for tablet 9abb473dbb3d491c9d15a161541fe795 (table default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04])
I20260927 13:50:02.147949 6752 raft_consensus.cc:515] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.149362 6844 tablet_loader.cc:96] loaded metadata for tablet 9cb1d6091729498698924e6857ebfd6c (table default.Table_8cda445237a34eac8407eedddae90d1e [id=8f547ebbb90047fabb7ff5a35a56c857])
I20260927 13:50:02.149787 6844 tablet_loader.cc:96] loaded metadata for tablet 9e808336f5b746d486d375695536c052 (table default.Table_82abe0dde56e49ea9af2bb8ddcfa508d [id=d088563f44224b01a3eba63ce70e5681])
I20260927 13:50:02.150556 6844 tablet_loader.cc:96] loaded metadata for tablet 9f467925221b4cfdafeaa459b5c5adc0 (table default.Table_6c77468a637b4f33a5122599e6ad6d5f [id=6cb266614bb746468cf8f0972aed0da0])
I20260927 13:50:02.149507 6973 raft_consensus.cc:515] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.150480 5626 tablet_bootstrap.cc:492] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:02.151614 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b2b6f2ce1145a18c199bb37cc7e5b2" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:02.151767 5626 ts_tablet_manager.cc:1403] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.071s user 0.004s sys 0.007s
I20260927 13:50:02.151794 5383 raft_consensus.cc:3060] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.152606 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0880140d99004eb1803d6b5dcf41af13" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:02.152740 5381 raft_consensus.cc:3060] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.153190 6973 leader_election.cc:290] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:02.154573 5184 leader_election.cc:343] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f5b2b6f2ce1145a18c199bb37cc7e5b2
I20260927 13:50:02.154678 5383 raft_consensus.cc:2468] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:02.154767 6752 leader_election.cc:290] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.155043 5185 leader_election.cc:304] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:02.155252 5381 raft_consensus.cc:2468] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:02.155457 6844 tablet_loader.cc:96] loaded metadata for tablet 9fdef4f56d9647118afe83ac3cd364fd (table default.Table_f9afa72c04394383a22302115766399d [id=c073a79da0b440698186e6856c8c8c68])
I20260927 13:50:02.155730 5185 leader_election.cc:304] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:02.155844 5626 raft_consensus.cc:359] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.155987 5626 raft_consensus.cc:385] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.156029 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13c629908a47368846770c697aebd8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:02.156047 5184 leader_election.cc:343] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 0880140d99004eb1803d6b5dcf41af13
I20260927 13:50:02.156247 6973 raft_consensus.cc:2804] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
W20260927 13:50:02.151631 6971 log.cc:927] Time spent T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735: Append to log took a long time: real 0.069s user 0.000s sys 0.000s
I20260927 13:50:02.156479 6973 raft_consensus.cc:697] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
W20260927 13:50:02.156488 5045 leader_election.cc:343] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.156601 5045 leader_election.cc:304] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.156039 5626 raft_consensus.cc:740] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.156821 6779 raft_consensus.cc:2749] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.156610 6896 raft_consensus.cc:2804] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.157179 5626 consensus_queue.cc:260] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.157802 5626 ts_tablet_manager.cc:1434] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:50:02.158100 5626 tablet_bootstrap.cc:492] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:02.158394 6973 consensus_queue.cc:237] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.160269 5626 tablet_bootstrap.cc:654] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.162207 6857 consensus_queue.cc:1048] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:02.168393 5319 consensus_peers.cc:597] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9bd182d7cb414f07944072b0c00ee35c. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:02.170502 6844 tablet_loader.cc:96] loaded metadata for tablet a4099c41981f46758a8f478d7fdb4182 (table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020])
I20260927 13:50:02.175431 6857 consensus_queue.cc:1048] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.176731 6779 raft_consensus.cc:493] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.176901 6779 raft_consensus.cc:515] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.177565 6779 leader_election.cc:290] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.176559 6844 tablet_loader.cc:96] loaded metadata for tablet a49834518ff34b1981d44f3824c131f3 (table default.Table_db71c9d8deb14250b83d10519ab3af81 [id=9eee52296f51408c907b10227c9bd49d])
I20260927 13:50:02.178602 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf557ac29964453583f224b46178c7dd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.178843 6844 tablet_loader.cc:96] loaded metadata for tablet a4f4bc5cefef448d85ff31b7fafaca74 (table default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4])
I20260927 13:50:02.178752 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf557ac29964453583f224b46178c7dd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:02.179291 5044 leader_election.cc:343] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:02.179930 5045 leader_election.cc:343] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.180042 5045 leader_election.cc:304] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.180365 6844 tablet_loader.cc:96] loaded metadata for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96])
I20260927 13:50:02.180487 6779 raft_consensus.cc:2749] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.182149 6844 tablet_loader.cc:96] loaded metadata for tablet a6596ed8c4d44ad58a7ec495a665d1e9 (table default.Table_fbe3019feb804488bb1c921ca74d85d1 [id=e5a735cb67614ea3ab56e5557d544301])
I20260927 13:50:02.183985 6896 raft_consensus.cc:697] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:02.184310 6896 consensus_queue.cc:237] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.185526 6857 raft_consensus.cc:493] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.185658 6857 raft_consensus.cc:515] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.186316 6857 leader_election.cc:290] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.186918 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2657276c4b2f43c1ad64a8c1fd58ada9" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.187435 5382 raft_consensus.cc:2468] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:02.187944 5185 leader_election.cc:304] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:50:02.188112 5184 leader_election.cc:343] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2657276c4b2f43c1ad64a8c1fd58ada9
I20260927 13:50:02.188413 6857 raft_consensus.cc:2804] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.188486 6857 raft_consensus.cc:493] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.188552 6857 raft_consensus.cc:3060] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.187788 6844 tablet_loader.cc:96] loaded metadata for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0])
I20260927 13:50:02.190201 6844 tablet_loader.cc:96] loaded metadata for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2])
I20260927 13:50:02.191380 6857 raft_consensus.cc:515] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.192085 6844 tablet_loader.cc:96] loaded metadata for tablet a84aef91b62b4f3ca0356f34a4b97fb8 (table default.Table_a2b9f6b30ac74767998e48a73f5a97db [id=a5dc0b9da7754fefa0c4a95317bbb65b])
I20260927 13:50:02.192293 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2657276c4b2f43c1ad64a8c1fd58ada9" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:02.192449 5382 raft_consensus.cc:3060] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.194629 6844 tablet_loader.cc:96] loaded metadata for tablet a9b8029e9be945ca95db7cdb3b010b8e (table default.Table_6b5cdd8077ed408991f25cc07e1cb24f [id=9a14d2729126450ca4dd7f68467662c4])
I20260927 13:50:02.195079 6844 tablet_loader.cc:96] loaded metadata for tablet ab12ebc5fdcb44948ec5f53f26c18f20 (table default.Table_42796c54044b413f89d5ebc6ec7a1c42 [id=ff3a9590f545444884afaa56b305080d])
I20260927 13:50:02.195250 5382 raft_consensus.cc:2468] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:02.195748 6844 tablet_loader.cc:96] loaded metadata for tablet ac28d0072aa1455681d6fa0bfde68f7b (table default.Table_c759fc3bc488489a94e8a6193c491682 [id=bfc3d095064143c9b2adfd23049e64f7])
I20260927 13:50:02.195775 5185 leader_election.cc:304] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:50:02.197190 5184 leader_election.cc:343] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2657276c4b2f43c1ad64a8c1fd58ada9
I20260927 13:50:02.197337 6857 leader_election.cc:290] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.197579 6857 raft_consensus.cc:2804] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.197677 6857 raft_consensus.cc:697] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:02.197906 6857 consensus_queue.cc:237] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.202224 6844 tablet_loader.cc:96] loaded metadata for tablet aedb3114f3b34f5a8c9f9a55abb4c0a4 (table default.Table_21196f9a14bf484fa4aef8a72ac91da6 [id=52db386a846540f58ea4588694b690f0])
I20260927 13:50:02.204361 6844 tablet_loader.cc:96] loaded metadata for tablet afb1862777b94fed97c0b92fa2c5545d (table default.Table_f76750964cba404fb197cc254b4ed32a [id=297e14783b0840c5864234841184e17e])
I20260927 13:50:02.205770 6844 tablet_loader.cc:96] loaded metadata for tablet b02466d95c2a4ae880d61252b167f0c8 (table default.Table_39166aa385de4916b3c9aaf6d9133e1c [id=70fa5cc937ef4ee4b6a8920a1e29c4e3])
I20260927 13:50:02.207371 6844 tablet_loader.cc:96] loaded metadata for tablet b044fbc166e848f39d17b63db69f63a4 (table default.Table_8544e332ec664166b8e0096ab40a19d5 [id=a34447e359784bba9f7b44e0e2968a1f])
W20260927 13:50:02.208662 5319 consensus_peers.cc:597] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0361e3b244a1437b8e402dd8602528fe. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:02.210834 6844 tablet_loader.cc:96] loaded metadata for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228])
I20260927 13:50:02.213538 6844 tablet_loader.cc:96] loaded metadata for tablet b3cd09c466b8476891cc8b26d13e8701 (table default.Table_aa475363b82246bcbc00b2b60ce222ae [id=227e1333cf1e4ceeb6ecc6e09b014100])
I20260927 13:50:02.215862 6844 tablet_loader.cc:96] loaded metadata for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61])
I20260927 13:50:02.219592 6844 tablet_loader.cc:96] loaded metadata for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_a8cb85c2ad064149be57407ba25423d6 [id=ae170bbebc4e460fb58beb7f95f013a2])
I20260927 13:50:02.221527 6844 tablet_loader.cc:96] loaded metadata for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293])
I20260927 13:50:02.222930 6844 tablet_loader.cc:96] loaded metadata for tablet b6a36afae51e4aaeb61ed0010f4077e3 (table default.Table_51418e08551949709fa1cc76c3d6bd21 [id=ff0e6686b11541b09e78176361aca3b6])
I20260927 13:50:02.224267 6844 tablet_loader.cc:96] loaded metadata for tablet b6bf85c1c2254063a1ffc0b7bf97eb38 (table default.Table_183e16824f194b1caa9327d0973f607b [id=c16d7a8a2339458b8c973cedf99c32bf])
I20260927 13:50:02.225965 6844 tablet_loader.cc:96] loaded metadata for tablet b9a1193719e140beb9b492927adeb78c (table default.Table_789c5549472f4bf8ab1581eb3903953a [id=1af7add99a3441a5888daac021a65214])
I20260927 13:50:02.227982 6844 tablet_loader.cc:96] loaded metadata for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238])
I20260927 13:50:02.237993 6779 raft_consensus.cc:493] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.238260 6779 raft_consensus.cc:515] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.238883 6779 leader_election.cc:290] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.239822 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1087ad60dade46bb9d38f52a94dd536b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.240000 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1087ad60dade46bb9d38f52a94dd536b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:02.240523 5045 leader_election.cc:343] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:02.243651 5044 leader_election.cc:343] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.243799 5044 leader_election.cc:304] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.244248 6779 raft_consensus.cc:2749] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.244625 6844 tablet_loader.cc:96] loaded metadata for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979])
I20260927 13:50:02.244729 6752 raft_consensus.cc:493] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.244868 6752 raft_consensus.cc:515] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.245749 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7919f5076406186000cd4077aadaf" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.245873 6844 tablet_loader.cc:96] loaded metadata for tablet bef7b844a07b420faa115fdd22b0539e (table default.Table_fd6ee019e754408fab65109daeb90c0e [id=1ac22cd7afdf47b691add3ee5d043cb1])
I20260927 13:50:02.245926 5382 raft_consensus.cc:2468] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
W20260927 13:50:02.246085 5184 leader_election.cc:343] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 64c7919f5076406186000cd4077aadaf
I20260927 13:50:02.246217 6844 tablet_loader.cc:96] loaded metadata for tablet befeab68084b4e6d8e33c5434652c3db (table default.Table_19de48446f02465ca170ad7a349da94d [id=b5a4301a2e1f45d2b20099589ede2b26])
I20260927 13:50:02.246316 6752 leader_election.cc:290] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.246449 5185 leader_election.cc:304] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:02.247056 6857 raft_consensus.cc:2804] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.247155 6857 raft_consensus.cc:493] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.247232 6857 raft_consensus.cc:3060] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.247637 5619 tablet_bootstrap.cc:492] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:02.247766 5619 ts_tablet_manager.cc:1403] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.207s user 0.005s sys 0.001s
I20260927 13:50:02.247658 6844 tablet_loader.cc:96] loaded metadata for tablet bf052a0645154d4c837a372173b8f610 (table default.Table_010dd8cdd9ea470397aeff0f1235bf1e [id=ae14efb404dc420ca7b29717270210a9])
I20260927 13:50:02.248720 6844 tablet_loader.cc:96] loaded metadata for tablet bf7aac9972ba403d883e0c5e2f5c2666 (table default.Table_6d74eaa4eb034485b7844e149cb6b14b [id=d7573db0f99048ac84381b6b2e2d2c08])
I20260927 13:50:02.248632 5619 raft_consensus.cc:359] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.248929 5619 raft_consensus.cc:385] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.249017 5619 raft_consensus.cc:740] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.249383 5619 consensus_queue.cc:260] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.250131 6844 tablet_loader.cc:96] loaded metadata for tablet c0779fde1c55428fbf09ff46cf448387 (table default.Table_7db7dcae15a64ff4b308591077608880 [id=ea5c56db81904caab25d8b1a0c6d0fa1])
I20260927 13:50:02.250810 6844 tablet_loader.cc:96] loaded metadata for tablet c0d3e3f86440448a88404f0ac06e0c0c (table default.Table_7675c4eea2d04c06b01cf0466c4ed466 [id=c58f2a8e5acf483d89fb782663512587])
I20260927 13:50:02.251878 6844 tablet_loader.cc:96] loaded metadata for tablet c16673cfe45f4c81806f4dda3246d476 (table default.Table_74758221c71d4c799da6b76df7746ba3 [id=ba15fdb3f6d9461e85fbef90616b4b9e])
I20260927 13:50:02.254743 5628 tablet_bootstrap.cc:492] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.254789 6857 raft_consensus.cc:515] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.254895 5628 ts_tablet_manager.cc:1403] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.112s user 0.010s sys 0.009s
I20260927 13:50:02.255646 5628 raft_consensus.cc:359] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.255870 5628 raft_consensus.cc:385] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.255929 5628 raft_consensus.cc:740] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.256170 5628 consensus_queue.cc:260] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.256686 5628 ts_tablet_manager.cc:1434] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:02.258034 6857 leader_election.cc:290] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.258519 5628 tablet_bootstrap.cc:492] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.260187 5628 tablet_bootstrap.cc:654] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.260514 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7919f5076406186000cd4077aadaf" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:02.260664 5383 raft_consensus.cc:3060] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:02.261682 5184 leader_election.cc:343] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 64c7919f5076406186000cd4077aadaf
W20260927 13:50:02.269745 5184 consensus_peers.cc:597] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e8bf79954c2429f886ac7afc9a8455f. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:02.274747 5628 tablet_bootstrap.cc:492] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.274940 5628 ts_tablet_manager.cc:1403] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20260927 13:50:02.275658 6793 raft_consensus.cc:493] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.275789 6793 raft_consensus.cc:515] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.275894 5628 raft_consensus.cc:359] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.276103 5628 raft_consensus.cc:385] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.276163 5628 raft_consensus.cc:740] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.276382 6793 leader_election.cc:290] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:02.276397 5628 consensus_queue.cc:260] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.277346 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46f45a0a13b4e05802a08880d7f6a01" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.277509 6779 raft_consensus.cc:493] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.277619 6779 raft_consensus.cc:515] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:02.277959 5319 leader_election.cc:343] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.278061 5628 ts_tablet_manager.cc:1434] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260927 13:50:02.278168 6779 leader_election.cc:290] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.278467 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46f45a0a13b4e05802a08880d7f6a01" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:02.278628 5107 raft_consensus.cc:2468] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:02.278932 5628 tablet_bootstrap.cc:492] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.278893 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:02.279287 5044 leader_election.cc:343] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.279718 5319 leader_election.cc:304] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.279855 6844 tablet_loader.cc:96] loaded metadata for tablet c27872794fb24934b723c56935d94702 (table default.Table_a5b94f165eff40f3826437ed44404e55 [id=caf6214f83fd4d19b26a6f39ef349629])
I20260927 13:50:02.280336 6844 tablet_loader.cc:96] loaded metadata for tablet c2fc2734e88e431facdf72e9ef136106 (table default.Table_72330b1053c147a48acac2e12df2dcc0 [id=3a103249799f4a5383c5091fda81153e])
I20260927 13:50:02.280584 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.280783 6844 tablet_loader.cc:96] loaded metadata for tablet c332b6ec9ca94ce398a71e82e20897d4 (table default.Table_ba46c52966764f5989cc55eed4059edf [id=db33cf0d6695498f8e5100abb2103d08])
I20260927 13:50:02.281216 6844 tablet_loader.cc:96] loaded metadata for tablet c44dc61b4003469e8f404b73f22f7291 (table default.Table_c35f0f666c6d4a5ca35fbe71a9d02c70 [id=2308ec26e62146738552b7667770d5b2])
W20260927 13:50:02.281308 5045 leader_election.cc:343] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.281420 5045 leader_election.cc:304] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.281816 6779 raft_consensus.cc:2749] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.282050 6793 raft_consensus.cc:2804] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.282147 6793 raft_consensus.cc:493] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.282205 6793 raft_consensus.cc:3060] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.285218 6793 raft_consensus.cc:515] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.285482 5628 tablet_bootstrap.cc:654] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.286211 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46f45a0a13b4e05802a08880d7f6a01" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:02.286365 5107 raft_consensus.cc:3060] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.287010 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46f45a0a13b4e05802a08880d7f6a01" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:50:02.287483 5319 leader_election.cc:343] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.287611 6793 leader_election.cc:290] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:02.288246 4749 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
/tmp/dist-test-task8U_Rfw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.124:37095
--webserver_interface=127.4.163.124
--webserver_port=36383
--builtin_ntp_servers=127.4.163.84:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260927 13:50:02.289431 5107 raft_consensus.cc:2468] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:02.290279 5319 leader_election.cc:304] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.290663 6857 consensus_queue.cc:1048] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.291736 6791 raft_consensus.cc:2804] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.291864 6791 raft_consensus.cc:697] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:02.292110 6779 raft_consensus.cc:493] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.292094 6791 consensus_queue.cc:237] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.292207 6779 raft_consensus.cc:515] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.292747 6779 leader_election.cc:290] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.293393 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715b9af057f6425eb664e2399677890f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.293656 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715b9af057f6425eb664e2399677890f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:02.294278 5044 leader_election.cc:343] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:02.294709 5045 leader_election.cc:343] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.294840 5045 leader_election.cc:304] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.295274 6779 raft_consensus.cc:2749] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.300323 6844 tablet_loader.cc:96] loaded metadata for tablet c655651f9cb24310a5aa2e5b84c2a455 (table default.Table_22e17296fde940779eb9160306ff386d [id=db63359dda9d4b729446d6ddf78c30b8])
I20260927 13:50:02.301317 6844 tablet_loader.cc:96] loaded metadata for tablet c6b1ecb9afa14c859946549eea2677ac (table default.Table_74634e550bd54c0cb0f52004fa14c8af [id=e321368692d24c5a87884e0165ef89ac])
I20260927 13:50:02.304828 6844 tablet_loader.cc:96] loaded metadata for tablet c99bf2abdfc64f169a3937f3e4499f75 (table default.Table_52cd6f5926494db78b6f05c29b36d509 [id=3f11aa4dd2e5436b942c02b53621b04a])
I20260927 13:50:02.310648 6844 tablet_loader.cc:96] loaded metadata for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181])
I20260927 13:50:02.311162 6844 tablet_loader.cc:96] loaded metadata for tablet cc6af9b33f0c464683e40adc28037bc8 (table default.Table_9a5417c1ab5f43d6992184dd6aa999c5 [id=3900fb9af5fa424389f9826c320224ec])
I20260927 13:50:02.311589 6844 tablet_loader.cc:96] loaded metadata for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0])
I20260927 13:50:02.311837 6986 consensus_queue.cc:1048] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.312312 6844 tablet_loader.cc:96] loaded metadata for tablet cda5bf0471894a8da41c3a6520a1abc3 (table default.Table_3fb24892ee2347868762b8a77ed1f594 [id=40da0ef42c8a4519b9e6987b826e513b])
I20260927 13:50:02.314556 6844 tablet_loader.cc:96] loaded metadata for tablet cf7966f71a814eab918b0da2ddfc16c9 (table default.Table_b81799f423864c5faf4b54c86e95aebc [id=e2566dade29042a897d2e1c91672787c])
I20260927 13:50:02.315428 6844 tablet_loader.cc:96] loaded metadata for tablet d0a76346f33b4041b100bf2d736ae21c (table default.Table_5f348882b88d4bdc8b238f4794b07610 [id=c68169e25a9f43b08141799bc435b14c])
I20260927 13:50:02.316646 5628 tablet_bootstrap.cc:492] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.316916 5628 ts_tablet_manager.cc:1403] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.000s
I20260927 13:50:02.317035 5619 ts_tablet_manager.cc:1434] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.069s user 0.003s sys 0.000s
I20260927 13:50:02.318003 5628 raft_consensus.cc:359] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.318307 5628 raft_consensus.cc:385] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.318411 5628 raft_consensus.cc:740] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.318740 5628 consensus_queue.cc:260] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.319622 5628 ts_tablet_manager.cc:1434] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:02.320151 6844 tablet_loader.cc:96] loaded metadata for tablet d0cf4234fa5e42469ba6b9bdee1e793f (table default.Table_8ad96efd2222495a89b4620b74fdc2e3 [id=6b95098ecd374cbf8614dc9197ffc0b6])
I20260927 13:50:02.320469 5628 tablet_bootstrap.cc:492] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.322177 5628 tablet_bootstrap.cc:654] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.323257 6844 tablet_loader.cc:96] loaded metadata for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1])
I20260927 13:50:02.324579 6844 tablet_loader.cc:96] loaded metadata for tablet d23d0d77dfb548c0b77295f185894c7c (table default.Table_23ae01b278734a1e94187c6846ce8f26 [id=e802f65837444329b9932f23eba2db40])
I20260927 13:50:02.325738 6844 tablet_loader.cc:96] loaded metadata for tablet d2d8f69b4e964dc98db3809eecdf8ad7 (table default.Table_240f3492390b48428f555f3f2dbce154 [id=ef4c47103ab94117b1130306118f923f])
I20260927 13:50:02.329301 6793 consensus_queue.cc:1048] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.329946 6793 consensus_queue.cc:1048] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.338579 6791 raft_consensus.cc:493] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.338723 6791 raft_consensus.cc:515] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.339304 6791 leader_election.cc:290] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:02.347221 5184 consensus_peers.cc:597] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3bbeeadecf3b40c28d0e4f63a22eb4f0. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:50:02.347640 5184 consensus_peers.cc:597] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbb4f42522e84964aeb19358ee02dfc2. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:02.348929 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d54e51b5c104c75b938aba55cecf890" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.350618 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d54e51b5c104c75b938aba55cecf890" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
W20260927 13:50:02.350695 5319 leader_election.cc:343] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.350829 5107 raft_consensus.cc:2468] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:02.356602 5319 leader_election.cc:304] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.356907 6791 raft_consensus.cc:2804] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.356999 6791 raft_consensus.cc:493] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.357056 6791 raft_consensus.cc:3060] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.359907 6791 raft_consensus.cc:515] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.360559 6791 leader_election.cc:290] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.361202 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d54e51b5c104c75b938aba55cecf890" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:02.361331 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d54e51b5c104c75b938aba55cecf890" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:02.361487 5107 raft_consensus.cc:3060] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:02.362059 5319 leader_election.cc:343] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.364988 5107 raft_consensus.cc:2468] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:02.365578 5319 leader_election.cc:304] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.365895 6791 raft_consensus.cc:2804] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.366043 6791 raft_consensus.cc:697] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:02.366103 5619 tablet_bootstrap.cc:492] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:02.366365 6791 consensus_queue.cc:237] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.371042 5628 tablet_bootstrap.cc:492] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.371444 5628 ts_tablet_manager.cc:1403] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.000s
I20260927 13:50:02.372249 5628 raft_consensus.cc:359] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.372444 5628 raft_consensus.cc:385] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.372505 5628 raft_consensus.cc:740] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.372772 5628 consensus_queue.cc:260] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.373248 5628 ts_tablet_manager.cc:1434] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:02.373530 5628 tablet_bootstrap.cc:492] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.373586 5383 raft_consensus.cc:2468] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:02.374037 5185 leader_election.cc:304] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:02.374517 6896 raft_consensus.cc:2804] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.374652 6896 raft_consensus.cc:697] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:02.374887 6896 consensus_queue.cc:237] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.375211 5628 tablet_bootstrap.cc:654] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.384893 6973 raft_consensus.cc:493] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.385036 6973 raft_consensus.cc:515] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.385592 6973 leader_election.cc:290] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.386502 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36181512a94c4702ae0a417665919faa" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.390187 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36181512a94c4702ae0a417665919faa" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:02.390558 5107 raft_consensus.cc:2393] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:02.390944 6791 raft_consensus.cc:493] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.391070 6791 raft_consensus.cc:515] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.391397 5184 leader_election.cc:304] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.391631 6791 leader_election.cc:290] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.392050 6973 raft_consensus.cc:3060] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.392004 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26a3a50396940cf826442e4ba7356a8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:02.392865 5319 leader_election.cc:343] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.393424 6844 tablet_loader.cc:96] loaded metadata for tablet d7d8e7d09c424b5e81083b0b95a1b704 (table default.Table_3656ebf9c8b64bff8f00bf1941a3aec4 [id=fd3d1f802598418a8d6f740db979940f])
I20260927 13:50:02.394006 6844 tablet_loader.cc:96] loaded metadata for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f])
I20260927 13:50:02.394565 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26a3a50396940cf826442e4ba7356a8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:02.394806 5107 raft_consensus.cc:2468] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:02.395210 6844 tablet_loader.cc:96] loaded metadata for tablet d8ab05fcb5824893abfc6953fb28d6b4 (table default.Table_5fd18aaf3713418e96976bc82c39f6e0 [id=e1e98093dbf14930a10bbe17dfdf0fbe])
I20260927 13:50:02.395691 6973 raft_consensus.cc:2749] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.396136 5319 leader_election.cc:304] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.396555 6791 raft_consensus.cc:2804] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.396582 6844 tablet_loader.cc:96] loaded metadata for tablet d9ff32095a554784b91e74012ad8e020 (table default.Table_ee7a89c46e4f454fb0922cafbc796e8e [id=112cd821498b427fb3b0d517cd0d55f3])
I20260927 13:50:02.396646 6791 raft_consensus.cc:493] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.396708 6791 raft_consensus.cc:3060] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.396981 6844 tablet_loader.cc:96] loaded metadata for tablet da5d9bda857f467da6930a6c64266f3a (table default.Table_98a47a6f58fe457395c7f1accbac44eb [id=42bfb85e0c8f425ea04c34b94ec24c58])
I20260927 13:50:02.397779 6844 tablet_loader.cc:96] loaded metadata for tablet daeb2045e5d84ed2b51dd88e197e84cb (table default.Table_c614391e114f4a7889ab500228e6318a [id=e84aa884563949dab840e102baec8988])
I20260927 13:50:02.399577 6791 raft_consensus.cc:515] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.400038 5619 tablet_bootstrap.cc:654] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.401465 6791 leader_election.cc:290] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.402989 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26a3a50396940cf826442e4ba7356a8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:02.409241 6779 raft_consensus.cc:493] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.409396 6779 raft_consensus.cc:515] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:02.409591 5319 leader_election.cc:343] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.410036 6779 leader_election.cc:290] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.410578 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca5b5f9ca1e44eb8cc8bb9e1ff11102" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.411164 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26a3a50396940cf826442e4ba7356a8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
W20260927 13:50:02.411700 5044 leader_election.cc:343] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.411989 5107 raft_consensus.cc:3060] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.413021 6791 consensus_queue.cc:1048] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.413777 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca5b5f9ca1e44eb8cc8bb9e1ff11102" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.415838 5107 raft_consensus.cc:2468] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:02.416601 5319 leader_election.cc:304] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:50:02.416586 5045 leader_election.cc:343] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.416710 5045 leader_election.cc:304] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.417042 6880 raft_consensus.cc:2804] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.417150 6880 raft_consensus.cc:697] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:02.417362 6880 consensus_queue.cc:237] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.417826 6779 raft_consensus.cc:2749] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.417728 5626 tablet_bootstrap.cc:492] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:02.418820 5619 tablet_bootstrap.cc:492] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:02.418939 5619 ts_tablet_manager.cc:1403] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.000s
I20260927 13:50:02.418289 5626 ts_tablet_manager.cc:1403] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.260s user 0.051s sys 0.067s
I20260927 13:50:02.419734 5619 raft_consensus.cc:359] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.419890 5619 raft_consensus.cc:385] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.419955 5619 raft_consensus.cc:740] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.420145 5619 consensus_queue.cc:260] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.420748 5619 ts_tablet_manager.cc:1434] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:02.421001 5619 tablet_bootstrap.cc:492] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:02.423378 5619 tablet_bootstrap.cc:654] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.425239 5628 tablet_bootstrap.cc:492] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.425391 5628 ts_tablet_manager.cc:1403] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.052s user 0.007s sys 0.003s
I20260927 13:50:02.425398 5626 raft_consensus.cc:359] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.426137 5628 raft_consensus.cc:359] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.426321 5628 raft_consensus.cc:385] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.426383 5628 raft_consensus.cc:740] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.425993 5626 raft_consensus.cc:385] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.426608 5628 consensus_queue.cc:260] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.426628 5626 raft_consensus.cc:740] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.427280 5628 ts_tablet_manager.cc:1434] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:02.427582 5628 tablet_bootstrap.cc:492] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.427455 5626 consensus_queue.cc:260] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.429998 5626 ts_tablet_manager.cc:1434] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 13:50:02.431654 5626 tablet_bootstrap.cc:492] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:02.437500 6882 raft_consensus.cc:493] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.437674 6882 raft_consensus.cc:515] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.437779 5626 tablet_bootstrap.cc:654] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.438453 6882 leader_election.cc:290] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.439685 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75847513dcf4c84913a4073176f2507" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:02.441479 5319 leader_election.cc:343] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f75847513dcf4c84913a4073176f2507
W20260927 13:50:02.441677 5319 leader_election.cc:343] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.441780 5319 leader_election.cc:304] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.442003 6882 raft_consensus.cc:2749] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.442709 5619 tablet_bootstrap.cc:492] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:02.442852 5619 ts_tablet_manager.cc:1403] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260927 13:50:02.443724 5619 raft_consensus.cc:359] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.443907 5619 raft_consensus.cc:385] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.443972 5619 raft_consensus.cc:740] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.444181 5619 consensus_queue.cc:260] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.444715 5619 ts_tablet_manager.cc:1434] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:02.444986 5619 tablet_bootstrap.cc:492] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:02.446779 5619 tablet_bootstrap.cc:654] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.451184 5628 tablet_bootstrap.cc:654] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.461846 5626 tablet_bootstrap.cc:492] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:02.462050 5626 ts_tablet_manager.cc:1403] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.002s
I20260927 13:50:02.463498 5626 raft_consensus.cc:359] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.463761 5626 raft_consensus.cc:385] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.463903 5626 raft_consensus.cc:740] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.464259 5626 consensus_queue.cc:260] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:50:02.465134 5319 consensus_peers.cc:597] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06c810fde988439c97a8445fc88626b3. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:02.466943 5619 tablet_bootstrap.cc:492] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:02.467077 5619 ts_tablet_manager.cc:1403] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260927 13:50:02.467839 5626 ts_tablet_manager.cc:1434] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:50:02.467813 5619 raft_consensus.cc:359] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.467973 5619 raft_consensus.cc:385] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.468024 5619 raft_consensus.cc:740] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.468811 5628 tablet_bootstrap.cc:492] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.468964 5628 ts_tablet_manager.cc:1403] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.004s
I20260927 13:50:02.469800 5628 raft_consensus.cc:359] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.469992 5628 raft_consensus.cc:385] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.470067 5628 raft_consensus.cc:740] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.470337 5628 consensus_queue.cc:260] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.470347 5619 consensus_queue.cc:260] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.472074 5619 ts_tablet_manager.cc:1434] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:50:02.472751 5619 tablet_bootstrap.cc:492] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:02.481057 5628 ts_tablet_manager.cc:1434] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260927 13:50:02.483484 6844 tablet_loader.cc:96] loaded metadata for tablet db800a7002b04b79baf9f4ec61af764b (table default.Table_479338a884a047389e0343ea71022b50 [id=f5e5dded0c5042adb7dce1d541d92e93])
I20260927 13:50:02.483892 5628 tablet_bootstrap.cc:492] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.485189 6791 consensus_queue.cc:1048] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.485610 5628 tablet_bootstrap.cc:654] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.487540 5626 tablet_bootstrap.cc:492] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:02.489104 5626 tablet_bootstrap.cc:654] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.493443 5619 tablet_bootstrap.cc:654] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.494138 6844 tablet_loader.cc:96] loaded metadata for tablet dba5c22f515c4ad095d15a09a8f5e2dc (table default.Table_fef73c8f52d144b6ae2358a575f61151 [id=47cfa38d5dc84502b26ddc79a872d1a7])
I20260927 13:50:02.494270 6779 raft_consensus.cc:493] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.494458 6779 raft_consensus.cc:515] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.495224 6779 leader_election.cc:290] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.495951 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a397300cdd44eb899f2ef5b9fe8c09" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.495952 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a397300cdd44eb899f2ef5b9fe8c09" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:02.496553 5044 leader_election.cc:343] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:02.496806 5045 leader_election.cc:343] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.496914 5045 leader_election.cc:304] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.497315 6779 raft_consensus.cc:2749] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.505172 6844 tablet_loader.cc:96] loaded metadata for tablet dd4ddd064e2c415fb47b694732514582 (table default.Table_c422a4d620fb41f788588f45ad6e57ec [id=78d4b804a72047c3b65aea1d0c259d7a])
I20260927 13:50:02.508885 6973 raft_consensus.cc:493] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.509078 6973 raft_consensus.cc:515] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.509817 6973 leader_election.cc:290] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.510520 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57886cc11a2423983c2b7bac79150a0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.510700 5383 raft_consensus.cc:2468] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:02.511133 5185 leader_election.cc:304] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:02.511418 6973 raft_consensus.cc:2804] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.511415 6779 raft_consensus.cc:493] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.511489 6973 raft_consensus.cc:493] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.511545 6973 raft_consensus.cc:3060] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.511550 6779 raft_consensus.cc:515] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.511641 5626 tablet_bootstrap.cc:492] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:02.511844 5626 ts_tablet_manager.cc:1403] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.003s
I20260927 13:50:02.512200 6779 leader_election.cc:290] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.513469 5626 raft_consensus.cc:359] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.513736 5626 raft_consensus.cc:385] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.513859 5626 raft_consensus.cc:740] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.514214 5626 consensus_queue.cc:260] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.514693 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c69163fb77442be9215f8f285b904ef" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:02.514775 5184 leader_election.cc:343] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b57886cc11a2423983c2b7bac79150a0
I20260927 13:50:02.514751 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c69163fb77442be9215f8f285b904ef" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:02.515345 5045 leader_election.cc:343] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:02.515563 5044 leader_election.cc:343] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.515674 5044 leader_election.cc:304] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.516052 6779 raft_consensus.cc:2749] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.516261 6973 raft_consensus.cc:515] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.516631 5626 ts_tablet_manager.cc:1434] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:50:02.517400 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57886cc11a2423983c2b7bac79150a0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:02.517560 5383 raft_consensus.cc:3060] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.517907 5626 tablet_bootstrap.cc:492] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:02.518393 6779 raft_consensus.cc:493] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.518507 6779 raft_consensus.cc:515] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.519014 6779 leader_election.cc:290] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.519578 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008516a474cc40f2b9de77b2f3e762cf" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:02.520264 5045 leader_election.cc:343] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.520315 5383 raft_consensus.cc:2468] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
W20260927 13:50:02.521123 5184 leader_election.cc:343] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b57886cc11a2423983c2b7bac79150a0
I20260927 13:50:02.521754 5185 leader_election.cc:304] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:02.522202 6896 raft_consensus.cc:2804] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.522240 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008516a474cc40f2b9de77b2f3e762cf" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.522315 6896 raft_consensus.cc:697] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:02.522580 6896 consensus_queue.cc:237] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:50:02.524648 5044 leader_election.cc:343] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.524771 5044 leader_election.cc:304] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.525137 6779 raft_consensus.cc:2749] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.526958 6973 leader_election.cc:290] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:02.529191 5319 consensus_peers.cc:597] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 794da0992403462dbbce644134b8aab3. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:02.530161 6844 tablet_loader.cc:96] loaded metadata for tablet df74edb799ae4aa681072f2041e249fe (table default.Table_1e8d21fc0eb44229a3a03b14792918c7 [id=b20698fb30ef49d9932dd3635df4788e])
I20260927 13:50:02.530843 6844 tablet_loader.cc:96] loaded metadata for tablet df8ebcb238c846729e2c27e4449bfb47 (table default.Table_c8c6fcc62dfb4536957573f7a410a94a [id=27533fd9eddb45e5afc90177ac5e78a0])
I20260927 13:50:02.531538 6844 tablet_loader.cc:96] loaded metadata for tablet e016878296da44b9a7691a7fc7206cb9 (table default.Table_2f47a147309843cda12839d088afebef [id=2c1da9087ada46f083eaa9f1a170761f])
I20260927 13:50:02.532469 5626 tablet_bootstrap.cc:654] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.535498 6882 raft_consensus.cc:493] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.535627 6882 raft_consensus.cc:515] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.536303 6882 leader_election.cc:290] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.537083 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe8af2068948c78feac4641a7525be" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.537283 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe8af2068948c78feac4641a7525be" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:02.537468 5107 raft_consensus.cc:2468] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:50:02.537750 5319 leader_election.cc:343] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.538188 5319 leader_election.cc:304] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.538609 5628 tablet_bootstrap.cc:492] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.538702 6882 raft_consensus.cc:2804] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.538753 5628 ts_tablet_manager.cc:1403] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.055s user 0.009s sys 0.004s
I20260927 13:50:02.538780 6882 raft_consensus.cc:493] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.538864 6882 raft_consensus.cc:3060] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.539520 5628 raft_consensus.cc:359] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.539677 5628 raft_consensus.cc:385] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.539731 5628 raft_consensus.cc:740] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.539978 5628 consensus_queue.cc:260] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.541247 6844 tablet_loader.cc:96] loaded metadata for tablet e08e47480cf2482f83f2e32e3b706dc1 (table default.Table_4f52702b62174d5a906804a02e82bea5 [id=090619527c7644578f4f12e2efcdfade])
I20260927 13:50:02.541501 6882 raft_consensus.cc:515] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.541783 6844 tablet_loader.cc:96] loaded metadata for tablet e1e574bc8b544039b440a845966eb1d4 (table default.Table_2159a2c74b9c4769be385712b34f41c3 [id=c386219cd45c4447b229c721951babeb])
I20260927 13:50:02.542649 6844 tablet_loader.cc:96] loaded metadata for tablet e3765fe06c664e60a11acf76c825bc42 (table default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee])
I20260927 13:50:02.542697 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe8af2068948c78feac4641a7525be" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:02.542059 6882 leader_election.cc:290] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.542851 5107 raft_consensus.cc:3060] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.542894 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe8af2068948c78feac4641a7525be" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:50:02.543399 5319 leader_election.cc:343] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.544111 6844 tablet_loader.cc:96] loaded metadata for tablet e38aa46c6ab34ece89397d3940d847db (table default.Table_01a57ba463c7433db27102851328ade7 [id=81d5856bf3614409aa1a141334159b59])
I20260927 13:50:02.544705 6844 tablet_loader.cc:96] loaded metadata for tablet e54a83664397460399960a0f73966fef (table default.Table_8e2e1621778d459a930d7f15ea30dd06 [id=e6cd27ae03884c518cebff6b8a7483d8])
I20260927 13:50:02.545274 6844 tablet_loader.cc:96] loaded metadata for tablet e5b04acc39f3436384fbb69cebdc35cd (table default.Table_2ffaaab1360041dcb71d30bd031dda41 [id=9822148965e74084941bcd0c04bfa009])
I20260927 13:50:02.545644 5107 raft_consensus.cc:2468] T 80fe8af2068948c78feac4641a7525be P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:02.545917 6844 tablet_loader.cc:96] loaded metadata for tablet e761457384e54078933a07f5b0eca68b (table default.Table_e039138831b14ad6b5324ce5cb852dd0 [id=6f235bc80647461199bfced83f9b7827])
I20260927 13:50:02.546093 5319 leader_election.cc:304] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.546511 6844 tablet_loader.cc:96] loaded metadata for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20])
I20260927 13:50:02.546527 6882 raft_consensus.cc:2804] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.546849 6882 raft_consensus.cc:697] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:02.546891 6844 tablet_loader.cc:96] loaded metadata for tablet e9b73420c2074d10ab2e78c6f15df93c (table default.Table_ef6bb2dace3141688f83d3494419f619 [id=09f379b76b2f43c8853cd36c6b52e296])
I20260927 13:50:02.547195 6844 tablet_loader.cc:96] loaded metadata for tablet ead437e93bb14a73a820631b0be041aa (table default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845])
I20260927 13:50:02.548033 6844 tablet_loader.cc:96] loaded metadata for tablet ecb5cdc007074e0c8f44d963e527a955 (table default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7])
I20260927 13:50:02.549117 6880 consensus_queue.cc:1048] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.549337 6779 raft_consensus.cc:493] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.549377 6844 tablet_loader.cc:96] loaded metadata for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9])
I20260927 13:50:02.549453 6779 raft_consensus.cc:515] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.549710 6844 tablet_loader.cc:96] loaded metadata for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287])
I20260927 13:50:02.550019 6779 leader_election.cc:290] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.550536 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25f5898369f46fba32b7df27b334b28" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:02.551409 5044 leader_election.cc:343] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.551532 6880 consensus_queue.cc:1048] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.552062 5628 ts_tablet_manager.cc:1434] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260927 13:50:02.552366 5628 tablet_bootstrap.cc:492] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.550796 6882 consensus_queue.cc:237] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.554039 5628 tablet_bootstrap.cc:654] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.559145 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25f5898369f46fba32b7df27b334b28" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:02.559726 5045 leader_election.cc:343] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.559870 5045 leader_election.cc:304] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.560106 7016 raft_consensus.cc:2749] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.566551 5619 tablet_bootstrap.cc:492] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:02.566838 5619 ts_tablet_manager.cc:1403] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.094s user 0.011s sys 0.010s
I20260927 13:50:02.567281 6896 raft_consensus.cc:493] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.567451 6896 raft_consensus.cc:515] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.568070 6896 leader_election.cc:290] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.569283 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b082227264e442a8b1db7a68fb0c3eb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.569516 5381 raft_consensus.cc:2468] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:02.570178 5185 leader_election.cc:304] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:02.570223 6844 tablet_loader.cc:96] loaded metadata for tablet effce815011d47df960df2c79d41aa1f (table default.Table_e03f455aec424b9fb05a1503d626ae3a [id=0f6fb382a33d46cc973e8a81ed234faf])
I20260927 13:50:02.570628 6896 raft_consensus.cc:2804] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.570703 6896 raft_consensus.cc:493] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.570762 6896 raft_consensus.cc:3060] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.573330 6844 tablet_loader.cc:96] loaded metadata for tablet f04b3a942c404f3894fbbd6ece24a727 (table default.Table_db70ad184fab4e5984d1777fecae5518 [id=c6230203df764e97a3fd3c8117177db2])
I20260927 13:50:02.573977 6844 tablet_loader.cc:96] loaded metadata for tablet f33023a2b46d4e228337afe3244be534 (table default.Table_06a788ecdc724adf92a6212315691a25 [id=bc423c24d7324498bbc47de81fd57135])
I20260927 13:50:02.574277 6896 raft_consensus.cc:515] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.575850 5619 raft_consensus.cc:359] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:02.574872 5184 leader_election.cc:343] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2b082227264e442a8b1db7a68fb0c3eb
I20260927 13:50:02.576633 6844 tablet_loader.cc:96] loaded metadata for tablet f46f45a0a13b4e05802a08880d7f6a01 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a])
I20260927 13:50:02.577977 6896 leader_election.cc:290] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:02.578474 5184 leader_election.cc:343] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2b082227264e442a8b1db7a68fb0c3eb
I20260927 13:50:02.577225 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b082227264e442a8b1db7a68fb0c3eb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:02.578722 5381 raft_consensus.cc:3060] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.580394 6844 tablet_loader.cc:96] loaded metadata for tablet f551c48587df4681961234121507af1a (table default.Table_7b9eaaab4c6149e09eb18425cb5c38a3 [id=c9012875ec134838a277ebcd347d754d])
I20260927 13:50:02.581907 5381 raft_consensus.cc:2468] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:02.582495 5185 leader_election.cc:304] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:02.582996 5619 raft_consensus.cc:385] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.583170 6896 raft_consensus.cc:2804] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.583302 5619 raft_consensus.cc:740] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.583562 6844 tablet_loader.cc:96] loaded metadata for tablet f94b8a726790439ab382830be5fc92ed (table default.Table_3ff54037c03446db8068c7bfd74ac465 [id=6a7df7bc6295417689c6b194556456ab])
I20260927 13:50:02.583767 6896 raft_consensus.cc:697] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:02.583961 6844 tablet_loader.cc:96] loaded metadata for tablet f98a8d63149f4c3d84bc804ef5a14e00 (table default.Table_f01116bdf8b644238db27fc1b3ae9fc6 [id=4e36bb70ef2942beaea498936148ac99])
I20260927 13:50:02.584762 6844 tablet_loader.cc:96] loaded metadata for tablet fb1532f75f1c481696240b0016a646a9 (table default.Table_4121f961061a429290fbb458b1059ba0 [id=609e0e0e929e47adacb63fee55390a6a])
I20260927 13:50:02.585140 6844 tablet_loader.cc:96] loaded metadata for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382])
I20260927 13:50:02.585912 5626 tablet_bootstrap.cc:492] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:02.586511 5626 ts_tablet_manager.cc:1403] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.069s user 0.007s sys 0.003s
I20260927 13:50:02.589639 5628 tablet_bootstrap.cc:492] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.589780 5628 ts_tablet_manager.cc:1403] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.014s
I20260927 13:50:02.590579 5619 consensus_queue.cc:260] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.591154 5619 ts_tablet_manager.cc:1434] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260927 13:50:02.591835 5619 tablet_bootstrap.cc:492] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:02.593578 5619 tablet_bootstrap.cc:654] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.594538 6882 consensus_queue.cc:1048] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.597730 5628 raft_consensus.cc:359] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.597908 5628 raft_consensus.cc:385] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.597972 5628 raft_consensus.cc:740] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.599673 6844 tablet_loader.cc:96] loaded metadata for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2])
I20260927 13:50:02.598199 5628 consensus_queue.cc:260] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.600369 5628 ts_tablet_manager.cc:1434] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260927 13:50:02.600654 5628 tablet_bootstrap.cc:492] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.601454 6844 tablet_loader.cc:96] loaded metadata for tablet fd312b6587cc48a096fe68d63e69abc4 (table default.Table_58f9b708528b4ba980888bbb033af8be [id=46389dd8c7dc4a719ab17a29c2259d74])
I20260927 13:50:02.601845 6844 tablet_loader.cc:96] loaded metadata for tablet fd861e06085e4c7b8bdf1101432bdc31 (table default.Table_3b716a51ffbe4613a958b62eef4cdcb6 [id=f4ff4dd6b47a4ce9a42f7b13a6a1ce34])
I20260927 13:50:02.602283 6844 tablet_loader.cc:96] loaded metadata for tablet fe6a4cf5ee2b43158d8db4c7cdd4a42e (table default.Table_f00ce7baf4f147e4bacf7c20efb9064b [id=28e5a27b58044d9ebcf9b33abfe878e0])
I20260927 13:50:02.602397 5628 tablet_bootstrap.cc:654] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.602753 6844 tablet_loader.cc:96] loaded metadata for tablet fe7008e37ce74568943dca179b82f126 (table default.Table_22fb4180565648f68805c7c792bd8f1c [id=20fc9e9a5fdb48918650a29f68c18ac0])
W20260927 13:50:02.603621 6844 catalog_manager.cc:1525] Time spent T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Loading table and tablet metadata into memory: real 1.768s user 0.286s sys 0.061s
I20260927 13:50:02.603770 6844 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260927 13:50:02.609037 5247 raft_consensus.cc:3060] T 860aa52d44ad494594c73707e6ef98e2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.591420 6896 consensus_queue.cc:237] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.611061 6791 consensus_queue.cc:1048] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.612682 6791 consensus_queue.cc:1048] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.617727 6844 catalog_manager.cc:1308] Loaded cluster ID: 020f38d03ca7495283eb7628b4a1a71b
I20260927 13:50:02.622094 6844 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260927 13:50:02.631398 5619 tablet_bootstrap.cc:492] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:02.631554 5619 ts_tablet_manager.cc:1403] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.005s
I20260927 13:50:02.632741 7006 raft_consensus.cc:493] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.632823 6793 consensus_queue.cc:1048] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.632886 7006 raft_consensus.cc:515] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.633342 6973 raft_consensus.cc:493] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.633507 7006 leader_election.cc:290] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.633486 6973 raft_consensus.cc:515] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.634200 6973 leader_election.cc:290] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.635190 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae6b1e46bdc4c28a2d0a2633d40f92a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.635377 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3933c0a2fd6547f28528fae7d443a2c1" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.635648 5381 raft_consensus.cc:2468] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
W20260927 13:50:02.635730 5319 leader_election.cc:343] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.636178 5185 leader_election.cc:304] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:02.636296 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae6b1e46bdc4c28a2d0a2633d40f92a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:02.636477 5108 raft_consensus.cc:2468] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:02.636482 6973 raft_consensus.cc:2804] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.636565 6973 raft_consensus.cc:493] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.636622 6973 raft_consensus.cc:3060] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:02.637253 5184 leader_election.cc:343] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3933c0a2fd6547f28528fae7d443a2c1
I20260927 13:50:02.637598 5319 leader_election.cc:304] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.638003 7006 raft_consensus.cc:2804] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.638072 7006 raft_consensus.cc:493] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.638211 7006 raft_consensus.cc:3060] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.639359 6973 raft_consensus.cc:515] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.640072 6973 leader_election.cc:290] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.640762 7006 raft_consensus.cc:515] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.640975 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3933c0a2fd6547f28528fae7d443a2c1" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:02.641119 5381 raft_consensus.cc:3060] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.641280 7006 leader_election.cc:290] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.643810 5619 raft_consensus.cc:359] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.643976 5619 raft_consensus.cc:385] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.644022 5619 raft_consensus.cc:740] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.644273 6844 catalog_manager.cc:1553] Loading token signing keys...
I20260927 13:50:02.645587 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae6b1e46bdc4c28a2d0a2633d40f92a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:02.645764 5108 raft_consensus.cc:3060] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.646163 5619 consensus_queue.cc:260] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:02.647154 5184 leader_election.cc:343] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3933c0a2fd6547f28528fae7d443a2c1
I20260927 13:50:02.647897 5619 ts_tablet_manager.cc:1434] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260927 13:50:02.648236 5619 tablet_bootstrap.cc:492] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:02.648655 5108 raft_consensus.cc:2468] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:02.649070 5319 leader_election.cc:304] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:02.650489 6793 raft_consensus.cc:2804] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.650601 6793 raft_consensus.cc:697] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:02.650800 6793 consensus_queue.cc:237] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.652180 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae6b1e46bdc4c28a2d0a2633d40f92a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:02.654322 5619 tablet_bootstrap.cc:654] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:02.659072 5319 leader_election.cc:343] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.665369 6844 catalog_manager.cc:6230] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Loaded TSK: 0
I20260927 13:50:02.667725 6857 raft_consensus.cc:493] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.667855 6857 raft_consensus.cc:515] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.668464 6857 leader_election.cc:290] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.669947 6844 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260927 13:50:02.670157 5619 tablet_bootstrap.cc:492] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:02.670300 5619 ts_tablet_manager.cc:1403] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.005s
I20260927 13:50:02.670264 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413d863d9a564e5d8325b4479346730d" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.671057 5619 raft_consensus.cc:359] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.671221 5619 raft_consensus.cc:385] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.671288 5619 raft_consensus.cc:740] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.671928 6973 consensus_queue.cc:1048] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.674839 5619 consensus_queue.cc:260] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.678146 5619 ts_tablet_manager.cc:1434] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260927 13:50:02.679924 5619 tablet_bootstrap.cc:492] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:02.681839 5619 tablet_bootstrap.cc:654] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.685786 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413d863d9a564e5d8325b4479346730d" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:02.686331 5107 raft_consensus.cc:2393] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:02.687879 7016 raft_consensus.cc:493] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.688002 7016 raft_consensus.cc:515] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.688625 7016 leader_election.cc:290] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.688701 5184 leader_election.cc:304] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.688962 6752 raft_consensus.cc:3060] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.689754 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44dc61b4003469e8f404b73f22f7291" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:02.690243 5044 leader_election.cc:343] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.690619 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44dc61b4003469e8f404b73f22f7291" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:02.691045 5045 leader_election.cc:343] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.691177 5045 leader_election.cc:304] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.691674 7016 raft_consensus.cc:2749] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.691817 6752 raft_consensus.cc:2749] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.643893 5381 raft_consensus.cc:2468] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:02.692745 5185 leader_election.cc:304] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:02.693238 6752 raft_consensus.cc:2804] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:02.693409 6752 raft_consensus.cc:697] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:02.693500 5628 tablet_bootstrap.cc:492] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.693666 5628 ts_tablet_manager.cc:1403] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.093s user 0.012s sys 0.007s
I20260927 13:50:02.693847 6752 consensus_queue.cc:237] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.694638 5628 raft_consensus.cc:359] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.694861 5628 raft_consensus.cc:385] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.694936 5628 raft_consensus.cc:740] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.696213 5619 tablet_bootstrap.cc:492] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:02.696348 5619 ts_tablet_manager.cc:1403] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260927 13:50:02.697075 5619 raft_consensus.cc:359] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.697274 5619 raft_consensus.cc:385] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.697340 5619 raft_consensus.cc:740] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.697557 5619 consensus_queue.cc:260] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.698917 5619 ts_tablet_manager.cc:1434] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:02.699178 5619 tablet_bootstrap.cc:492] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:02.701712 6973 raft_consensus.cc:493] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.701906 6973 raft_consensus.cc:515] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.702078 5619 tablet_bootstrap.cc:654] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.702828 6973 leader_election.cc:290] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.704381 6449 master_service.cc:960] ReplaceTablet: received request to replace tablet c99bf2abdfc64f169a3937f3e4499f75 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:02.705739 5628 consensus_queue.cc:260] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.706456 5628 ts_tablet_manager.cc:1434] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260927 13:50:02.706718 5628 tablet_bootstrap.cc:492] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.708261 5628 tablet_bootstrap.cc:654] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.710320 6451 master_service.cc:960] ReplaceTablet: received request to replace tablet 24bd9a95e2d24242aba890ee9d01c023 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:02.713944 5247 raft_consensus.cc:3060] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.722738 6453 master_service.cc:960] ReplaceTablet: received request to replace tablet a4f4bc5cefef448d85ff31b7fafaca74 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:02.723454 6442 master_service.cc:960] ReplaceTablet: received request to replace tablet 9cb1d6091729498698924e6857ebfd6c from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:02.723765 5628 tablet_bootstrap.cc:492] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.723917 5628 ts_tablet_manager.cc:1403] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.009s
I20260927 13:50:02.724689 5628 raft_consensus.cc:359] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.724864 5628 raft_consensus.cc:385] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.724920 5628 raft_consensus.cc:740] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.725160 5628 consensus_queue.cc:260] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.725216 6793 consensus_queue.cc:1048] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.725952 5628 ts_tablet_manager.cc:1434] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:02.726384 5628 tablet_bootstrap.cc:492] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.724261 6441 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_57a1a48cec114fb98010ba314921320d" } modify_external_catalogs: true
I20260927 13:50:02.730544 6441 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_57a1a48cec114fb98010ba314921320d" } modify_external_catalogs: true
I20260927 13:50:02.732622 5628 tablet_bootstrap.cc:654] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.723204 6444 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_98a47a6f58fe457395c7f1accbac44eb" } modify_external_catalogs: true
I20260927 13:50:02.733397 6444 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_98a47a6f58fe457395c7f1accbac44eb" } modify_external_catalogs: true
I20260927 13:50:02.719063 6447 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_b952c6ebeaf8497899bffc38582cb9cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:02.722774 6445 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_f91817f1255d4f8fa48accfa3c7c842d" } new_table_name: "default.Table_954f47d3ef8846b8ade030d87002460e" modify_external_catalogs: true
I20260927 13:50:02.740680 5628 tablet_bootstrap.cc:492] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.740815 5628 ts_tablet_manager.cc:1403] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20260927 13:50:02.741473 5628 raft_consensus.cc:359] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.741642 5628 raft_consensus.cc:385] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.741684 5628 raft_consensus.cc:740] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:50:02.738093 6447 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b952c6ebeaf8497899bffc38582cb9cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:02.741917 5628 consensus_queue.cc:260] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.742544 5628 ts_tablet_manager.cc:1434] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:02.742805 5628 tablet_bootstrap.cc:492] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.744509 5628 tablet_bootstrap.cc:654] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.747869 5628 tablet_bootstrap.cc:492] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.747992 5628 ts_tablet_manager.cc:1403] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 13:50:02.748668 5628 raft_consensus.cc:359] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.748824 5628 raft_consensus.cc:385] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.748871 5628 raft_consensus.cc:740] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.749042 5628 consensus_queue.cc:260] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.749629 5628 ts_tablet_manager.cc:1434] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:02.749890 5628 tablet_bootstrap.cc:492] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.751505 5628 tablet_bootstrap.cc:654] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.704716 6454 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_cd89222a85234585a71b762f7e592e9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:02.754698 5628 tablet_bootstrap.cc:492] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.754813 5628 ts_tablet_manager.cc:1403] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 13:50:02.755441 5628 raft_consensus.cc:359] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.755594 5628 raft_consensus.cc:385] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.755645 5628 raft_consensus.cc:740] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.755863 5628 consensus_queue.cc:260] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.756431 5628 ts_tablet_manager.cc:1434] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:02.756683 5628 tablet_bootstrap.cc:492] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.758272 5628 tablet_bootstrap.cc:654] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:02.764361 5184 consensus_peers.cc:597] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a813939920244be781d546311fe8a33e. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:50:02.765045 5184 leader_election.cc:343] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bb25bb5ee153494d803130f1ad4f7c2e
W20260927 13:50:02.766096 6454 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd89222a85234585a71b762f7e592e9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:02.766247 5628 tablet_bootstrap.cc:492] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.766392 5628 ts_tablet_manager.cc:1403] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260927 13:50:02.767038 5628 raft_consensus.cc:359] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.767203 5628 raft_consensus.cc:385] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.767254 5628 raft_consensus.cc:740] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.767498 5628 consensus_queue.cc:260] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.768075 5628 ts_tablet_manager.cc:1434] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:02.768321 5628 tablet_bootstrap.cc:492] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.768846 6793 consensus_queue.cc:1048] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.769896 5628 tablet_bootstrap.cc:654] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.773268 5628 tablet_bootstrap.cc:492] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.773531 5628 ts_tablet_manager.cc:1403] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.004s
I20260927 13:50:02.774242 5628 raft_consensus.cc:359] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.774403 5628 raft_consensus.cc:385] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.774453 5628 raft_consensus.cc:740] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.774686 5628 consensus_queue.cc:260] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.775233 5628 ts_tablet_manager.cc:1434] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:02.775488 5628 tablet_bootstrap.cc:492] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.777019 5628 tablet_bootstrap.cc:654] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.780311 5628 tablet_bootstrap.cc:492] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.780457 5628 ts_tablet_manager.cc:1403] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260927 13:50:02.781128 5628 raft_consensus.cc:359] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.781281 5628 raft_consensus.cc:385] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.781337 5628 raft_consensus.cc:740] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.781509 5628 consensus_queue.cc:260] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.782060 5628 ts_tablet_manager.cc:1434] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:02.782315 5628 tablet_bootstrap.cc:492] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.784005 5628 tablet_bootstrap.cc:654] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.788908 6973 raft_consensus.cc:493] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.789050 6973 raft_consensus.cc:515] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.789821 6973 leader_election.cc:290] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.789899 6880 consensus_queue.cc:1048] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.792994 5628 tablet_bootstrap.cc:492] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.793123 5628 ts_tablet_manager.cc:1403] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260927 13:50:02.793763 5628 raft_consensus.cc:359] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.793921 5628 raft_consensus.cc:385] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.793974 5628 raft_consensus.cc:740] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.794231 5628 consensus_queue.cc:260] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.794800 5628 ts_tablet_manager.cc:1434] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:02.795046 5628 tablet_bootstrap.cc:492] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.796764 5628 tablet_bootstrap.cc:654] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.803853 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb25bb5ee153494d803130f1ad4f7c2e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.804250 5381 raft_consensus.cc:2468] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:02.805373 5628 tablet_bootstrap.cc:492] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.805500 5628 ts_tablet_manager.cc:1403] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260927 13:50:02.806154 5628 raft_consensus.cc:359] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.806303 5628 raft_consensus.cc:385] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.806361 5628 raft_consensus.cc:740] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.806587 5628 consensus_queue.cc:260] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.807112 5628 ts_tablet_manager.cc:1434] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:02.807407 5628 tablet_bootstrap.cc:492] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.809016 5628 tablet_bootstrap.cc:654] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.815109 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afb800e7ff44aadaed8f8d85aa9efe2" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.815316 5382 raft_consensus.cc:2468] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
W20260927 13:50:02.816872 5184 leader_election.cc:343] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3afb800e7ff44aadaed8f8d85aa9efe2
I20260927 13:50:02.819391 5628 tablet_bootstrap.cc:492] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.819561 5628 ts_tablet_manager.cc:1403] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.003s
I20260927 13:50:02.820686 5628 raft_consensus.cc:359] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.820912 5628 raft_consensus.cc:385] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.820983 5628 raft_consensus.cc:740] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.821209 5628 consensus_queue.cc:260] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.821823 5628 ts_tablet_manager.cc:1434] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:02.824777 5628 tablet_bootstrap.cc:492] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.826983 5628 tablet_bootstrap.cc:654] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.591212 5626 raft_consensus.cc:359] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.830358 5626 raft_consensus.cc:385] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.830482 5626 raft_consensus.cc:740] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.830828 5626 consensus_queue.cc:260] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.831585 5626 ts_tablet_manager.cc:1434] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.245s user 0.002s sys 0.000s
I20260927 13:50:02.831936 5626 tablet_bootstrap.cc:492] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:02.835439 5185 leader_election.cc:304] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:02.835927 5628 tablet_bootstrap.cc:492] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:02.836081 5628 ts_tablet_manager.cc:1403] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260927 13:50:02.836086 5185 leader_election.cc:304] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:02.837000 6973 raft_consensus.cc:2804] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.837122 6973 raft_consensus.cc:493] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.837239 6973 raft_consensus.cc:3060] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.840435 6973 raft_consensus.cc:515] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.841379 6973 leader_election.cc:290] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.841576 6973 raft_consensus.cc:2804] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:02.841693 6973 raft_consensus.cc:493] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:02.841825 6973 raft_consensus.cc:3060] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.843992 7016 raft_consensus.cc:493] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.844121 7016 raft_consensus.cc:515] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.844696 7016 leader_election.cc:290] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:02.846081 5184 leader_election.cc:343] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bb25bb5ee153494d803130f1ad4f7c2e
I20260927 13:50:02.846763 5628 raft_consensus.cc:359] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.846948 5628 raft_consensus.cc:385] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:02.847038 5628 raft_consensus.cc:740] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:02.847282 5628 consensus_queue.cc:260] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:02.847926 5628 ts_tablet_manager.cc:1434] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260927 13:50:02.848220 5628 tablet_bootstrap.cc:492] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:02.849314 7016 raft_consensus.cc:493] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.849453 7016 raft_consensus.cc:515] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.849985 5628 tablet_bootstrap.cc:654] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:02.850015 7016 leader_election.cc:290] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.852062 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f6a9c5e4be480796f433a68945dd72" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.863720 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9503dd46ccf472581d1a667eea300ed" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.865434 6779 raft_consensus.cc:493] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.865682 6779 raft_consensus.cc:515] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.866505 6779 leader_election.cc:290] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.872872 6455 catalog_manager.cc:5838] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260927 13:50:02.877053 6896 consensus_queue.cc:1048] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.877795 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb25bb5ee153494d803130f1ad4f7c2e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:02.878048 5381 raft_consensus.cc:3060] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:02.881152 5381 raft_consensus.cc:2468] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
W20260927 13:50:02.883225 5045 leader_election.cc:343] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:02.884717 5045 leader_election.cc:343] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.888394 6779 raft_consensus.cc:493] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.888602 6779 raft_consensus.cc:515] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.889493 6779 leader_election.cc:290] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.914103 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9503dd46ccf472581d1a667eea300ed" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.914999 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f6a9c5e4be480796f433a68945dd72" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.915622 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff7d501f7704e69b696053cb1b1ffe5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.916301 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992bf643dee64bccaa993a08027aa5fc" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.928702 5626 tablet_bootstrap.cc:654] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:02.929847 5044 leader_election.cc:343] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.930020 5044 leader_election.cc:304] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.931231 6779 raft_consensus.cc:2749] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:02.933954 5044 leader_election.cc:343] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.934082 5044 leader_election.cc:304] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.934540 6779 raft_consensus.cc:2749] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:02.936467 5044 leader_election.cc:343] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:02.937212 5044 leader_election.cc:343] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.954581 6779 raft_consensus.cc:493] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.954800 6779 raft_consensus.cc:515] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.955538 6779 leader_election.cc:290] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:02.958932 5184 consensus_peers.cc:597] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5b2b6f2ce1145a18c199bb37cc7e5b2. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:02.959798 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb0c2c2be04a598e011a9d99c5492a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:02.961606 6973 raft_consensus.cc:515] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:50:02.963035 5184 leader_election.cc:343] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3afb800e7ff44aadaed8f8d85aa9efe2
I20260927 13:50:02.885612 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff7d501f7704e69b696053cb1b1ffe5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.903733 7006 raft_consensus.cc:493] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.965372 7006 raft_consensus.cc:515] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:02.965535 5045 leader_election.cc:343] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.965678 5045 leader_election.cc:304] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.965962 6779 raft_consensus.cc:2749] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:02.965968 7006 leader_election.cc:290] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:02.926841 6882 consensus_queue.cc:1048] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:02.928649 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992bf643dee64bccaa993a08027aa5fc" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.960215 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb0c2c2be04a598e011a9d99c5492a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:02.966765 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da75a470ec0c4ec9afa7c18a51cd7276" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:02.969664 5319 leader_election.cc:343] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.980692 6779 raft_consensus.cc:493] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.980890 6779 raft_consensus.cc:515] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.981786 6779 leader_election.cc:290] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:02.984179 5319 leader_election.cc:343] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: da75a470ec0c4ec9afa7c18a51cd7276
I20260927 13:50:02.984391 5319 leader_election.cc:304] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:02.985080 7006 raft_consensus.cc:2749] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:02.987227 5044 leader_election.cc:343] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.989202 5185 leader_election.cc:304] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:02.991611 6779 raft_consensus.cc:493] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:02.991835 6779 raft_consensus.cc:515] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:02.992882 6779 leader_election.cc:290] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:02.996630 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a98e712fb3492f9e4ebccfd489c16f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:02.996754 5045 leader_election.cc:343] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.996872 5045 leader_election.cc:304] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:02.997491 6779 raft_consensus.cc:2749] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:02.998011 5045 leader_election.cc:343] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:02.998167 5045 leader_election.cc:304] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.002666 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82284e3fd1f4a2f95c7e47320abb30c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:02.990698 5184 consensus_peers.cc:597] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0880140d99004eb1803d6b5dcf41af13. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:03.007931 5626 tablet_bootstrap.cc:492] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.010023 6896 raft_consensus.cc:2804] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.010218 6896 raft_consensus.cc:697] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:03.010269 5626 ts_tablet_manager.cc:1403] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.178s user 0.001s sys 0.003s
I20260927 13:50:03.010474 6896 consensus_queue.cc:237] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.011629 5626 raft_consensus.cc:359] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.012737 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82284e3fd1f4a2f95c7e47320abb30c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.013785 5626 raft_consensus.cc:385] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.013863 5626 raft_consensus.cc:740] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.012928 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a98e712fb3492f9e4ebccfd489c16f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.015187 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 3513663de6724b108adcb46cc151163c (table default.Table_dcdd264dd7c84641aac8566bae2bf8b6 [id=6b9a7948d0b34aa89f9f7c58a2cd2a0e]). Expected version 2 got 0
I20260927 13:50:03.015866 5619 tablet_bootstrap.cc:492] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.016036 5619 ts_tablet_manager.cc:1403] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.317s user 0.036s sys 0.072s
I20260927 13:50:03.015828 6455 catalog_manager.cc:5838] T 860aa52d44ad494594c73707e6ef98e2 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:50:03.016891 5619 raft_consensus.cc:359] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.017083 5619 raft_consensus.cc:385] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.017155 5619 raft_consensus.cc:740] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.017491 5619 consensus_queue.cc:260] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.018203 5619 ts_tablet_manager.cc:1434] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:03.018427 5626 consensus_queue.cc:260] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.019555 6896 consensus_queue.cc:1048] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.020059 6973 leader_election.cc:290] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.021502 6779 raft_consensus.cc:2749] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:03.021745 5045 leader_election.cc:343] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.021844 5044 leader_election.cc:343] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.021966 5045 leader_election.cc:343] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.022042 5044 leader_election.cc:343] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.022178 5044 leader_election.cc:304] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.022614 7016 raft_consensus.cc:493] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.022727 5619 tablet_bootstrap.cc:492] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.022756 7016 raft_consensus.cc:515] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.023440 7016 leader_election.cc:290] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.023612 7016 raft_consensus.cc:2749] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:03.024722 5184 consensus_peers.cc:597] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7dc140bba42a43758fa0c6540d728275. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:03.024881 5626 ts_tablet_manager.cc:1434] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260927 13:50:03.025101 5619 tablet_bootstrap.cc:654] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.025185 5626 tablet_bootstrap.cc:492] T 0d54e51b5c104c75b938aba55cecf890 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:03.027052 5626 tablet_bootstrap.cc:654] T 0d54e51b5c104c75b938aba55cecf890 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.027858 6779 raft_consensus.cc:493] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.028004 6779 raft_consensus.cc:515] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.028592 6779 leader_election.cc:290] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.022081 5045 leader_election.cc:304] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.036558 6779 raft_consensus.cc:2749] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.037169 5628 tablet_bootstrap.cc:492] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.037331 5628 ts_tablet_manager.cc:1403] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.189s user 0.017s sys 0.025s
I20260927 13:50:03.038586 5628 raft_consensus.cc:359] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.038829 5628 raft_consensus.cc:385] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.038934 5628 raft_consensus.cc:740] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.039192 5628 consensus_queue.cc:260] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.039805 5628 ts_tablet_manager.cc:1434] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:03.040266 5628 tablet_bootstrap.cc:492] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.048506 5628 tablet_bootstrap.cc:654] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.050348 5619 tablet_bootstrap.cc:492] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.050551 5619 ts_tablet_manager.cc:1403] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260927 13:50:03.051295 5619 raft_consensus.cc:359] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.051517 5619 raft_consensus.cc:385] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.051607 5619 raft_consensus.cc:740] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.051851 5619 consensus_queue.cc:260] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.052364 5619 ts_tablet_manager.cc:1434] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:03.052699 5619 tablet_bootstrap.cc:492] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:50:03.054284 5184 consensus_peers.cc:597] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c2f814bb9ff41ebab19e8c16cf4affa. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:03.054533 5619 tablet_bootstrap.cc:654] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.056983 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191cfad4e7a4b088b2ecdc246bfa58a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:03.057956 5045 leader_election.cc:343] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.057440 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6985779674646f4abe18cdf7c063c90" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:03.060993 5045 leader_election.cc:343] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.062539 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afb800e7ff44aadaed8f8d85aa9efe2" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:03.062672 5628 tablet_bootstrap.cc:492] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.062813 5628 ts_tablet_manager.cc:1403] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.003s
I20260927 13:50:03.062989 5383 raft_consensus.cc:3060] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.063596 5628 raft_consensus.cc:359] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.063773 5628 raft_consensus.cc:385] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.063841 5628 raft_consensus.cc:740] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.064074 5628 consensus_queue.cc:260] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.065867 5619 tablet_bootstrap.cc:492] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.066004 5619 ts_tablet_manager.cc:1403] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260927 13:50:03.067066 5628 ts_tablet_manager.cc:1434] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260927 13:50:03.068348 5619 raft_consensus.cc:359] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.068543 5619 raft_consensus.cc:385] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.068610 5619 raft_consensus.cc:740] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.069360 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6985779674646f4abe18cdf7c063c90" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.070310 5619 consensus_queue.cc:260] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.070919 5628 tablet_bootstrap.cc:492] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.071434 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191cfad4e7a4b088b2ecdc246bfa58a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.072827 5628 tablet_bootstrap.cc:654] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:03.074571 5044 leader_election.cc:343] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.074764 5044 leader_election.cc:304] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.075014 6779 raft_consensus.cc:2749] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:03.077033 5044 leader_election.cc:343] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.077160 5044 leader_election.cc:304] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.077529 6779 raft_consensus.cc:2749] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.083539 5383 raft_consensus.cc:2468] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:03.084306 6752 consensus_queue.cc:1048] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.094521 5626 tablet_bootstrap.cc:492] T 0d54e51b5c104c75b938aba55cecf890 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.094661 5626 ts_tablet_manager.cc:1403] T 0d54e51b5c104c75b938aba55cecf890 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.001s
W20260927 13:50:03.095153 5184 consensus_peers.cc:597] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2657276c4b2f43c1ad64a8c1fd58ada9. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:03.095418 5626 raft_consensus.cc:359] T 0d54e51b5c104c75b938aba55cecf890 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.095584 5626 raft_consensus.cc:385] T 0d54e51b5c104c75b938aba55cecf890 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.095628 5626 raft_consensus.cc:740] T 0d54e51b5c104c75b938aba55cecf890 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.097332 5626 consensus_queue.cc:260] T 0d54e51b5c104c75b938aba55cecf890 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.098042 5626 ts_tablet_manager.cc:1434] T 0d54e51b5c104c75b938aba55cecf890 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:03.098321 5626 tablet_bootstrap.cc:492] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:03.086278 5619 ts_tablet_manager.cc:1434] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.020s user 0.002s sys 0.001s
I20260927 13:50:03.096511 6882 consensus_queue.cc:1048] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.099713 5619 tablet_bootstrap.cc:492] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.101632 5619 tablet_bootstrap.cc:654] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.105806 5626 tablet_bootstrap.cc:654] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.112118 5628 tablet_bootstrap.cc:492] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.112398 5628 ts_tablet_manager.cc:1403] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.003s
I20260927 13:50:03.113370 5628 raft_consensus.cc:359] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.113705 5628 raft_consensus.cc:385] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.113859 5628 raft_consensus.cc:740] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.114223 5628 consensus_queue.cc:260] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.114852 5628 ts_tablet_manager.cc:1434] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:03.115206 5628 tablet_bootstrap.cc:492] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.120175 5626 tablet_bootstrap.cc:492] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.120324 5626 ts_tablet_manager.cc:1403] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.000s
I20260927 13:50:03.121094 5626 raft_consensus.cc:359] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.121323 5626 raft_consensus.cc:385] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.121374 5626 raft_consensus.cc:740] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.121538 5628 tablet_bootstrap.cc:654] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.122738 5619 tablet_bootstrap.cc:492] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.122903 5619 ts_tablet_manager.cc:1403] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.004s
I20260927 13:50:03.123031 6779 raft_consensus.cc:493] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.123169 6779 raft_consensus.cc:515] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.123603 5619 raft_consensus.cc:359] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.123781 5619 raft_consensus.cc:385] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.123818 6779 leader_election.cc:290] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.123843 5619 raft_consensus.cc:740] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.124104 5619 consensus_queue.cc:260] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.124667 5619 ts_tablet_manager.cc:1434] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:03.124966 5619 tablet_bootstrap.cc:492] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.125106 6449 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet c99bf2abdfc64f169a3937f3e4499f75
I20260927 13:50:03.125836 5185 leader_election.cc:304] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:03.126086 6752 raft_consensus.cc:2804] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.126233 6752 raft_consensus.cc:697] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:03.126464 6752 consensus_queue.cc:237] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.127662 5619 tablet_bootstrap.cc:654] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.127812 6449 catalog_manager.cc:6934] ReplaceTablet: tablet c99bf2abdfc64f169a3937f3e4499f75 deleted and replaced by tablet d212ee5cd8f7416a840d307b16ba5e28
I20260927 13:50:03.134675 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7b3a35b2e94bbea6be4b4a8f158593" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.139670 5626 consensus_queue.cc:260] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.140623 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7b3a35b2e94bbea6be4b4a8f158593" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.141319 6441 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 960822bb4f984ad481cdac3be2d4cca3
I20260927 13:50:03.143334 5619 tablet_bootstrap.cc:492] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.143512 5619 ts_tablet_manager.cc:1403] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.000s
I20260927 13:50:03.144541 5619 raft_consensus.cc:359] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.144721 5619 raft_consensus.cc:385] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.144809 5619 raft_consensus.cc:740] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.145015 5619 consensus_queue.cc:260] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.146169 5619 ts_tablet_manager.cc:1434] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:03.148456 5619 tablet_bootstrap.cc:492] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.150282 5619 tablet_bootstrap.cc:654] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.170102 5619 tablet_bootstrap.cc:492] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.170325 5619 ts_tablet_manager.cc:1403] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.017s
I20260927 13:50:03.171108 5619 raft_consensus.cc:359] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.171331 5619 raft_consensus.cc:385] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.171407 5619 raft_consensus.cc:740] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.171701 5619 consensus_queue.cc:260] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:03.173157 5044 leader_election.cc:343] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.173612 5619 ts_tablet_manager.cc:1434] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:03.175016 5619 tablet_bootstrap.cc:492] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.176337 6896 consensus_queue.cc:1048] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.176800 5619 tablet_bootstrap.cc:654] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.177624 6896 consensus_queue.cc:1048] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.179576 6444 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet da5d9bda857f467da6930a6c64266f3a
I20260927 13:50:03.180353 6444 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_2b8dc798fa334079a96ce21a0a5358a0" } new_table_name: "default.Table_464a0b4a4e9d430fad6cbf768b6bf2ca" modify_external_catalogs: true
I20260927 13:50:03.187718 6779 raft_consensus.cc:493] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.187887 6779 raft_consensus.cc:515] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.188524 6779 leader_election.cc:290] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.191581 6442 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 9cb1d6091729498698924e6857ebfd6c
I20260927 13:50:03.191772 6441 catalog_manager.cc:5838] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } }
I20260927 13:50:03.192157 6442 catalog_manager.cc:6934] ReplaceTablet: tablet 9cb1d6091729498698924e6857ebfd6c deleted and replaced by tablet 55f62f4ba23f4b82b9bcde89126ce1e6
I20260927 13:50:03.195294 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee18063dc634385b9e61fae3b3ece99" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:03.195851 5044 leader_election.cc:343] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.197894 5045 leader_election.cc:343] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.198050 5045 leader_election.cc:304] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.198662 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee18063dc634385b9e61fae3b3ece99" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.198877 7016 raft_consensus.cc:2749] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.199079 7016 raft_consensus.cc:493] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.199229 7016 raft_consensus.cc:515] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.199829 7016 leader_election.cc:290] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.200718 6882 raft_consensus.cc:493] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.200897 6882 raft_consensus.cc:515] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.201453 6882 leader_election.cc:290] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.202642 5626 ts_tablet_manager.cc:1434] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.082s user 0.002s sys 0.000s
I20260927 13:50:03.202713 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e2e305b92a4492a0df14a506c768f3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.202986 5626 tablet_bootstrap.cc:492] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:03.192356 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 60de1c28618f4e478aae68ad07fbcf98 (table default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]). Expected version 1 got 0
W20260927 13:50:03.204053 5044 leader_election.cc:343] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.205194 5626 tablet_bootstrap.cc:654] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.192490 6442 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_4155d438fc7c4d6cbe87e16451c6bbba" } modify_external_catalogs: true
I20260927 13:50:03.211997 6779 raft_consensus.cc:493] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.212271 7006 raft_consensus.cc:493] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.212242 6779 raft_consensus.cc:515] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.212419 7006 raft_consensus.cc:515] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.213025 6779 leader_election.cc:290] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.213164 7006 leader_election.cc:290] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:03.213917 5045 leader_election.cc:343] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.214092 5045 leader_election.cc:304] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.214936 5628 tablet_bootstrap.cc:492] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.214946 6779 raft_consensus.cc:2749] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.215118 5628 ts_tablet_manager.cc:1403] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.100s user 0.004s sys 0.002s
I20260927 13:50:03.215878 5628 raft_consensus.cc:359] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.216069 5628 raft_consensus.cc:385] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.216159 5628 raft_consensus.cc:740] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.216533 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fbf1e7f5e04122a65f6e192ffdae20" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.216691 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c4bbb0512c4411916eb4c48731f32f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:03.217211 5044 leader_election.cc:343] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.218041 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c4bbb0512c4411916eb4c48731f32f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:03.218303 5105 raft_consensus.cc:2468] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:03.218708 7006 consensus_queue.cc:1048] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.219558 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fbf1e7f5e04122a65f6e192ffdae20" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.219719 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e2e305b92a4492a0df14a506c768f3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.219800 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b044fbc166e848f39d17b63db69f63a4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.220286 7006 consensus_queue.cc:1048] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.221175 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b044fbc166e848f39d17b63db69f63a4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:03.221452 5105 raft_consensus.cc:2468] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:03.225275 5628 consensus_queue.cc:260] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.225850 5628 ts_tablet_manager.cc:1434] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 13:50:03.225996 6442 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_4155d438fc7c4d6cbe87e16451c6bbba" } modify_external_catalogs: true
I20260927 13:50:03.233338 6451 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 24bd9a95e2d24242aba890ee9d01c023
I20260927 13:50:03.233942 6451 catalog_manager.cc:6934] ReplaceTablet: tablet 24bd9a95e2d24242aba890ee9d01c023 deleted and replaced by tablet ad2b4316eeb643cc8c2440ed04191a57
I20260927 13:50:03.243975 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet c99bf2abdfc64f169a3937f3e4499f75 with delete_type TABLET_DATA_DELETED (replaced by tablet d212ee5cd8f7416a840d307b16ba5e28) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.244414 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet da5d9bda857f467da6930a6c64266f3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:02 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.244623 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cb1d6091729498698924e6857ebfd6c with delete_type TABLET_DATA_DELETED (replaced by tablet 55f62f4ba23f4b82b9bcde89126ce1e6) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.244796 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bd9a95e2d24242aba890ee9d01c023 with delete_type TABLET_DATA_DELETED (replaced by tablet ad2b4316eeb643cc8c2440ed04191a57) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.247467 5619 tablet_bootstrap.cc:492] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.247682 5619 ts_tablet_manager.cc:1403] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.073s user 0.005s sys 0.004s
I20260927 13:50:03.251549 6451 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_82bed47438394acea3b96b95d18f862e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.252203 6451 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82bed47438394acea3b96b95d18f862e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.252655 6447 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_55bbacce10ca46659231c8bd691d7cef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.253135 6447 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55bbacce10ca46659231c8bd691d7cef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.253458 6880 raft_consensus.cc:493] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.253645 6880 raft_consensus.cc:515] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.253767 5619 raft_consensus.cc:359] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.253942 5619 raft_consensus.cc:385] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.254038 5619 raft_consensus.cc:740] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.254311 6880 leader_election.cc:290] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.254381 5619 consensus_queue.cc:260] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.260205 6882 raft_consensus.cc:493] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.260349 6882 raft_consensus.cc:515] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.260881 6882 leader_election.cc:290] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:03.261762 5319 leader_election.cc:343] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.262292 5319 leader_election.cc:343] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.262503 5628 tablet_bootstrap.cc:492] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.263590 5319 leader_election.cc:304] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:03.264427 5628 tablet_bootstrap.cc:654] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.264500 6882 raft_consensus.cc:2804] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.264592 6882 raft_consensus.cc:493] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.264681 6882 raft_consensus.cc:3060] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.267688 5626 tablet_bootstrap.cc:492] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.267843 5626 ts_tablet_manager.cc:1403] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.007s
I20260927 13:50:03.267839 6882 raft_consensus.cc:515] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.268523 6882 leader_election.cc:290] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.268640 5626 raft_consensus.cc:359] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.268807 5626 raft_consensus.cc:385] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.268865 5626 raft_consensus.cc:740] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.269042 6779 raft_consensus.cc:493] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.269059 5626 consensus_queue.cc:260] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.269200 6779 raft_consensus.cc:515] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.269836 6779 leader_election.cc:290] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.269259 5319 leader_election.cc:304] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:03.270555 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec130d31f6274fd9b730c2bb8bba817e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.270854 6882 raft_consensus.cc:2804] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.270947 6882 raft_consensus.cc:493] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.271039 6882 raft_consensus.cc:3060] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.272264 5626 ts_tablet_manager.cc:1434] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:50:03.272542 5626 tablet_bootstrap.cc:492] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:03.273993 6882 raft_consensus.cc:515] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.274158 5626 tablet_bootstrap.cc:654] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.274621 6882 leader_election.cc:290] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.275408 7098 tablet_replica.cc:333] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:03.275651 7098 raft_consensus.cc:2243] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:03.275851 7098 raft_consensus.cc:2272] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:03.276153 5044 leader_election.cc:343] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.277235 5628 tablet_bootstrap.cc:492] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.277419 5628 ts_tablet_manager.cc:1403] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.001s
W20260927 13:50:03.278282 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet c99bf2abdfc64f169a3937f3e4499f75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c99bf2abdfc64f169a3937f3e4499f75 already in progress: creating tablet
W20260927 13:50:03.278506 5045 leader_election.cc:343] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.278585 5628 raft_consensus.cc:359] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.278709 5045 leader_election.cc:304] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.278789 5628 raft_consensus.cc:385] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.278882 5628 raft_consensus.cc:740] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.279124 5628 consensus_queue.cc:260] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:03.279234 5045 leader_election.cc:343] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.279403 5045 leader_election.cc:304] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.279649 6779 raft_consensus.cc:2749] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.279681 7016 raft_consensus.cc:2749] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.280304 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715b9af057f6425eb664e2399677890f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.281280 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715b9af057f6425eb664e2399677890f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:03.281488 5105 raft_consensus.cc:2468] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:03.282449 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet c99bf2abdfc64f169a3937f3e4499f75 with delete_type TABLET_DATA_DELETED (replaced by tablet d212ee5cd8f7416a840d307b16ba5e28) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:03.282603 6986 raft_consensus.cc:493] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.282719 6986 raft_consensus.cc:515] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.282775 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b04acc39f3436384fbb69cebdc35cd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.283071 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet da5d9bda857f467da6930a6c64266f3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:02 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:03.283245 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cb1d6091729498698924e6857ebfd6c with delete_type TABLET_DATA_DELETED (replaced by tablet 55f62f4ba23f4b82b9bcde89126ce1e6) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:03.283316 6986 leader_election.cc:290] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.283429 5224 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bd9a95e2d24242aba890ee9d01c023 with delete_type TABLET_DATA_DELETED (replaced by tablet ad2b4316eeb643cc8c2440ed04191a57) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:03.283921 5619 ts_tablet_manager.cc:1434] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20260927 13:50:03.284436 5619 tablet_bootstrap.cc:492] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.286401 5619 tablet_bootstrap.cc:654] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.288100 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75847513dcf4c84913a4073176f2507" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.288399 5381 raft_consensus.cc:2468] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:03.292949 7098 ts_tablet_manager.cc:1916] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:03.295984 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b04acc39f3436384fbb69cebdc35cd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:03.296207 5107 raft_consensus.cc:2468] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:03.297288 5628 ts_tablet_manager.cc:1434] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20260927 13:50:03.297631 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c4bbb0512c4411916eb4c48731f32f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:03.297297 5185 leader_election.cc:304] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:03.298146 5628 tablet_bootstrap.cc:492] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.298456 5619 tablet_bootstrap.cc:492] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.298712 6973 raft_consensus.cc:2804] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.298815 6973 raft_consensus.cc:493] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.298895 6973 raft_consensus.cc:3060] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.300047 5628 tablet_bootstrap.cc:654] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.300171 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b044fbc166e848f39d17b63db69f63a4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:03.301661 5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b044fbc166e848f39d17b63db69f63a4" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:03.301870 5105 raft_consensus.cc:3060] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.302626 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c4bbb0512c4411916eb4c48731f32f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:03.302757 5107 raft_consensus.cc:3060] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.304574 5105 raft_consensus.cc:2468] T b044fbc166e848f39d17b63db69f63a4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:03.305976 5107 raft_consensus.cc:2468] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:03.306272 7016 raft_consensus.cc:493] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.306413 7016 raft_consensus.cc:515] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.306538 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec130d31f6274fd9b730c2bb8bba817e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.306679 5626 tablet_bootstrap.cc:492] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.306805 5619 ts_tablet_manager.cc:1403] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260927 13:50:03.306840 5626 ts_tablet_manager.cc:1403] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.000s
I20260927 13:50:03.307051 7016 leader_election.cc:290] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.307600 5626 raft_consensus.cc:359] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.307567 5619 raft_consensus.cc:359] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.307765 5619 raft_consensus.cc:385] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.307765 5626 raft_consensus.cc:385] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.307818 5619 raft_consensus.cc:740] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.307828 5626 raft_consensus.cc:740] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.307914 5319 leader_election.cc:304] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:03.308043 5619 consensus_queue.cc:260] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.308457 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdacca4b5bd4afb95c83f6c72091b2f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.309284 6973 raft_consensus.cc:515] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:03.310261 5044 leader_election.cc:343] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.310700 6973 leader_election.cc:290] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.310726 5626 consensus_queue.cc:260] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:03.311112 5184 leader_election.cc:343] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f75847513dcf4c84913a4073176f2507
I20260927 13:50:03.311247 5626 ts_tablet_manager.cc:1434] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:50:03.311532 5626 tablet_bootstrap.cc:492] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:03.311740 7006 raft_consensus.cc:2804] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.311848 7006 raft_consensus.cc:493] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.311921 7006 raft_consensus.cc:3060] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.313315 5626 tablet_bootstrap.cc:654] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.314352 6791 consensus_queue.cc:1048] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.315411 7006 raft_consensus.cc:515] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.316154 7006 leader_election.cc:290] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.316745 5619 ts_tablet_manager.cc:1434] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260927 13:50:03.317009 5619 tablet_bootstrap.cc:492] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.317919 5319 leader_election.cc:304] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:03.318197 6791 raft_consensus.cc:2804] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.318255 6791 raft_consensus.cc:493] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.318321 6791 raft_consensus.cc:3060] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:03.319867 5184 leader_election.cc:343] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f75847513dcf4c84913a4073176f2507
I20260927 13:50:03.320739 6791 raft_consensus.cc:515] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.321223 6791 leader_election.cc:290] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.322206 5319 leader_election.cc:304] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:50:03.322773 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet c99bf2abdfc64f169a3937f3e4499f75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c99bf2abdfc64f169a3937f3e4499f75 already in progress: creating tablet
I20260927 13:50:03.322945 7098 ts_tablet_manager.cc:1929] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:03.323079 7098 log.cc:1199] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/da5d9bda857f467da6930a6c64266f3a
I20260927 13:50:03.323472 7098 ts_tablet_manager.cc:1950] T da5d9bda857f467da6930a6c64266f3a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:50:03.323540 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet da5d9bda857f467da6930a6c64266f3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da5d9bda857f467da6930a6c64266f3a already in progress: creating tablet
I20260927 13:50:03.323770 6791 raft_consensus.cc:2804] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.323886 6791 raft_consensus.cc:697] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:03.324093 6791 consensus_queue.cc:237] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.324558 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet da5d9bda857f467da6930a6c64266f3a (table default.Table_98a47a6f58fe457395c7f1accbac44eb [id=42bfb85e0c8f425ea04c34b94ec24c58]) successfully deleted
W20260927 13:50:03.325062 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 9cb1d6091729498698924e6857ebfd6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb1d6091729498698924e6857ebfd6c already in progress: creating tablet
W20260927 13:50:03.325268 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 24bd9a95e2d24242aba890ee9d01c023 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24bd9a95e2d24242aba890ee9d01c023 already in progress: creating tablet
I20260927 13:50:03.328155 6973 raft_consensus.cc:493] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.328455 6973 raft_consensus.cc:515] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:03.328724 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 9cb1d6091729498698924e6857ebfd6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb1d6091729498698924e6857ebfd6c already in progress: creating tablet
I20260927 13:50:03.329247 6973 leader_election.cc:290] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:03.330132 5184 leader_election.cc:343] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 51e1acd618fc44be9169fa1d56fa510a
I20260927 13:50:03.330634 5319 leader_election.cc:304] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:50:03.331425 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 24bd9a95e2d24242aba890ee9d01c023 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24bd9a95e2d24242aba890ee9d01c023 already in progress: creating tablet
W20260927 13:50:03.331468 6445 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36314f4c93434b1f8d462aa9d838da78 consensus state has no leader
I20260927 13:50:03.332008 6445 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_8e016376cfaf4dd299110321dbf67554"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:03.332261 6454 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_60c8613aadad4742b6ede2feb6f3d1a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.332576 6445 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e016376cfaf4dd299110321dbf67554 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:50:03.332808 6454 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60c8613aadad4742b6ede2feb6f3d1a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:50:03.334096 6444 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5678703b72c8471583147786f49122a5 consensus state has no leader
I20260927 13:50:03.334492 6444 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_4ce714062e7c4acf8c4945dc787ca610" } modify_external_catalogs: true
I20260927 13:50:03.334661 7006 raft_consensus.cc:2804] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.334707 6444 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_4ce714062e7c4acf8c4945dc787ca610" } modify_external_catalogs: true
I20260927 13:50:03.334846 7006 raft_consensus.cc:697] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:03.335086 7006 consensus_queue.cc:237] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:03.342188 5319 leader_election.cc:343] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.343174 5319 leader_election.cc:343] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.343454 5319 leader_election.cc:343] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.343703 5319 leader_election.cc:343] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.344172 5319 consensus_peers.cc:597] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:03.345593 5245 raft_consensus.cc:3060] T 0d54e51b5c104c75b938aba55cecf890 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.345530 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715b9af057f6425eb664e2399677890f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:03.346089 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b04acc39f3436384fbb69cebdc35cd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:03.346606 5109 raft_consensus.cc:3060] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.346799 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet c99bf2abdfc64f169a3937f3e4499f75 with delete_type TABLET_DATA_DELETED (replaced by tablet d212ee5cd8f7416a840d307b16ba5e28) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.348981 5626 tablet_bootstrap.cc:492] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.349144 5626 ts_tablet_manager.cc:1403] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.003s
I20260927 13:50:03.349303 5109 raft_consensus.cc:2468] T e5b04acc39f3436384fbb69cebdc35cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:50:03.349661 5045 leader_election.cc:343] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.349771 5045 leader_election.cc:304] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.350023 7016 raft_consensus.cc:2749] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.350147 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b04acc39f3436384fbb69cebdc35cd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:03.350260 6973 raft_consensus.cc:493] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.350378 6973 raft_consensus.cc:515] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.351104 6973 leader_election.cc:290] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.350045 5626 raft_consensus.cc:359] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.351387 5626 raft_consensus.cc:385] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.351442 5626 raft_consensus.cc:740] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
W20260927 13:50:03.351630 5184 leader_election.cc:343] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3a07adcd33414d18ae9720e7a307548a
I20260927 13:50:03.351679 5626 consensus_queue.cc:260] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.352229 5626 ts_tablet_manager.cc:1434] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:03.352542 5626 tablet_bootstrap.cc:492] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:03.353191 5619 tablet_bootstrap.cc:654] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.354429 6453 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet a4f4bc5cefef448d85ff31b7fafaca74
I20260927 13:50:03.354516 5626 tablet_bootstrap.cc:654] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.351073 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715b9af057f6425eb664e2399677890f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:03.355002 6453 catalog_manager.cc:6934] ReplaceTablet: tablet a4f4bc5cefef448d85ff31b7fafaca74 deleted and replaced by tablet f3e3ebd06dd1429fa5ec20396e4bb5b6
I20260927 13:50:03.355050 5106 raft_consensus.cc:3060] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.355392 6453 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_d6067ca7e0a04380a6629bf8edeb93d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.355935 6453 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6067ca7e0a04380a6629bf8edeb93d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.357740 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f4bc5cefef448d85ff31b7fafaca74 with delete_type TABLET_DATA_DELETED (replaced by tablet f3e3ebd06dd1429fa5ec20396e4bb5b6) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.357838 5106 raft_consensus.cc:2468] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:03.357622 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f4bc5cefef448d85ff31b7fafaca74 with delete_type TABLET_DATA_DELETED (replaced by tablet f3e3ebd06dd1429fa5ec20396e4bb5b6) from {username='slave'} at 127.0.0.1:44390
W20260927 13:50:03.358832 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a4f4bc5cefef448d85ff31b7fafaca74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4f4bc5cefef448d85ff31b7fafaca74 already in progress: creating tablet
I20260927 13:50:03.359440 6882 raft_consensus.cc:493] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.359606 6882 raft_consensus.cc:515] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.360175 6882 leader_election.cc:290] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.365082 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet da5d9bda857f467da6930a6c64266f3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:02 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.365303 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cb1d6091729498698924e6857ebfd6c with delete_type TABLET_DATA_DELETED (replaced by tablet 55f62f4ba23f4b82b9bcde89126ce1e6) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.365955 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bd9a95e2d24242aba890ee9d01c023 with delete_type TABLET_DATA_DELETED (replaced by tablet ad2b4316eeb643cc8c2440ed04191a57) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.366166 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f4bc5cefef448d85ff31b7fafaca74 with delete_type TABLET_DATA_DELETED (replaced by tablet f3e3ebd06dd1429fa5ec20396e4bb5b6) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.366554 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdacca4b5bd4afb95c83f6c72091b2f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.367049 5319 leader_election.cc:304] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:03.367512 6882 raft_consensus.cc:2804] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.367605 6882 raft_consensus.cc:697] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:03.367817 6882 consensus_queue.cc:237] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:03.369122 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a4f4bc5cefef448d85ff31b7fafaca74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4f4bc5cefef448d85ff31b7fafaca74 already in progress: creating tablet
I20260927 13:50:03.372607 6451 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_2ce0e4a2f8844a6e8c93e8e94551bd4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.373203 6451 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ce0e4a2f8844a6e8c93e8e94551bd4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.373934 6442 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 44d85213c05c465abda78cc49c70d36f
I20260927 13:50:03.374660 6442 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_5972ad040bd64ddda4bf22eac0f03998" } new_table_name: "default.Table_5b64a307e44a471598ef010e33a82fe3" modify_external_catalogs: true
I20260927 13:50:03.376704 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 44d85213c05c465abda78cc49c70d36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.376859 6447 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_a70fd3b1b9fc480586fd49c1d4cc00c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:03.377308 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 44d85213c05c465abda78cc49c70d36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:44390
W20260927 13:50:03.377380 6447 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a70fd3b1b9fc480586fd49c1d4cc00c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.377440 6454 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_a061fe9a0f414f838517412afe01641f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.377903 6454 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a061fe9a0f414f838517412afe01641f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:50:03.377956 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 44d85213c05c465abda78cc49c70d36f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44d85213c05c465abda78cc49c70d36f already in progress: creating tablet
I20260927 13:50:03.378226 6791 raft_consensus.cc:493] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.378348 6791 raft_consensus.cc:515] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.378882 6791 leader_election.cc:290] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:03.379647 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 44d85213c05c465abda78cc49c70d36f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44d85213c05c465abda78cc49c70d36f already in progress: creating tablet
I20260927 13:50:03.380276 6445 master_service.cc:960] ReplaceTablet: received request to replace tablet f04b3a942c404f3894fbbd6ece24a727 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:03.381349 6455 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_82abe0dde56e49ea9af2bb8ddcfa508d" } new_table_name: "default.Table_36609f3408124349b504ae9eb3275d87" modify_external_catalogs: true
I20260927 13:50:03.382647 6449 catalog_manager.cc:5838] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } }
I20260927 13:50:03.382912 6973 raft_consensus.cc:493] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.382993 6449 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 36181512a94c4702ae0a417665919faa (table default.Table_06b04cbe300b4373813df57694d32684 [id=ed3f5ac2c7fe4efeaa58e8a11100851b]). Expected version 1 got 0
I20260927 13:50:03.383172 6449 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 60de1c28618f4e478aae68ad07fbcf98 (table default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]). Expected version 1 got 0
I20260927 13:50:03.383080 6973 raft_consensus.cc:515] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.383826 6973 leader_election.cc:290] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:03.384893 5184 leader_election.cc:343] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 4211f338c6a648c5b3e36c6df0b3c510
I20260927 13:50:03.387446 5626 tablet_bootstrap.cc:492] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.387583 5626 ts_tablet_manager.cc:1403] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
I20260927 13:50:03.388304 5626 raft_consensus.cc:359] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.388463 5626 raft_consensus.cc:385] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.388511 5626 raft_consensus.cc:740] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.388702 5626 consensus_queue.cc:260] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.389402 5626 ts_tablet_manager.cc:1434] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:03.389663 5626 tablet_bootstrap.cc:492] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:03.391247 6424 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 5678703b72c8471583147786f49122a5 (table default.Table_464a0b4a4e9d430fad6cbf768b6bf2ca [id=0d85f9f0d28e43debda43f83a3e59637], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5678703b72c8471583147786f49122a5 consensus state has no leader
I20260927 13:50:03.392141 5626 tablet_bootstrap.cc:654] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.396790 5319 leader_election.cc:304] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:03.399078 7006 raft_consensus.cc:2804] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.399288 7006 raft_consensus.cc:697] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:03.404129 7006 consensus_queue.cc:237] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.405547 7016 raft_consensus.cc:493] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.405680 7016 raft_consensus.cc:515] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.406273 7016 leader_election.cc:290] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.406980 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d29459405b4cdd921fb43bf5a2ae81" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:03.407557 5044 leader_election.cc:343] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.411972 5619 tablet_bootstrap.cc:492] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.412108 5619 ts_tablet_manager.cc:1403] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.095s user 0.005s sys 0.000s
I20260927 13:50:03.416002 5626 tablet_bootstrap.cc:492] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.416142 5626 ts_tablet_manager.cc:1403] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
I20260927 13:50:03.418452 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d9c94ee0af46e8aea12adac57829f7" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.419293 5619 raft_consensus.cc:359] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.419397 6453 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_06b04cbe300b4373813df57694d32684" } modify_external_catalogs: true
I20260927 13:50:03.419481 5619 raft_consensus.cc:385] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.419607 6453 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_06b04cbe300b4373813df57694d32684" } modify_external_catalogs: true
I20260927 13:50:03.419678 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d9c94ee0af46e8aea12adac57829f7" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:03.419885 5107 raft_consensus.cc:2468] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:03.419533 5619 raft_consensus.cc:740] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.420734 5619 consensus_queue.cc:260] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:03.421418 5045 leader_election.cc:343] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.421545 5045 leader_election.cc:304] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.421911 5619 ts_tablet_manager.cc:1434] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 13:50:03.421907 7016 raft_consensus.cc:2749] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.423009 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbacda63c0d3427aabf3332b278576c5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.423759 5626 raft_consensus.cc:359] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.424641 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbacda63c0d3427aabf3332b278576c5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:03.424840 5106 raft_consensus.cc:2468] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:03.425550 5619 tablet_bootstrap.cc:492] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.428335 5628 tablet_bootstrap.cc:492] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
W20260927 13:50:03.428323 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet c99bf2abdfc64f169a3937f3e4499f75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c99bf2abdfc64f169a3937f3e4499f75 already in progress: creating tablet
I20260927 13:50:03.427819 5626 raft_consensus.cc:385] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.428488 5628 ts_tablet_manager.cc:1403] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.131s user 0.016s sys 0.003s
I20260927 13:50:03.428488 5626 raft_consensus.cc:740] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
W20260927 13:50:03.428584 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet da5d9bda857f467da6930a6c64266f3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da5d9bda857f467da6930a6c64266f3a already in progress: creating tablet
W20260927 13:50:03.428797 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 9cb1d6091729498698924e6857ebfd6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb1d6091729498698924e6857ebfd6c already in progress: creating tablet
W20260927 13:50:03.429035 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 24bd9a95e2d24242aba890ee9d01c023 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24bd9a95e2d24242aba890ee9d01c023 already in progress: creating tablet
I20260927 13:50:03.429242 7016 raft_consensus.cc:493] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:50:03.429236 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a4f4bc5cefef448d85ff31b7fafaca74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4f4bc5cefef448d85ff31b7fafaca74 already in progress: creating tablet
I20260927 13:50:03.429200 5628 raft_consensus.cc:359] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.429373 5628 raft_consensus.cc:385] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.429342 7016 raft_consensus.cc:515] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.429416 5628 raft_consensus.cc:740] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.429587 5628 consensus_queue.cc:260] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.429901 7016 leader_election.cc:290] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.430056 5628 ts_tablet_manager.cc:1434] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 13:50:03.431010 5619 tablet_bootstrap.cc:654] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.431183 6451 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_162ac02f5d444371ad6d85becb6b16a0" } new_table_name: "default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1" modify_external_catalogs: true
I20260927 13:50:03.432327 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0827a26334c42728545a9eaa006fae0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:03.433035 5044 leader_election.cc:343] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.429119 5626 consensus_queue.cc:260] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.433548 5628 tablet_bootstrap.cc:492] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.434899 5628 tablet_bootstrap.cc:654] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.438580 6791 raft_consensus.cc:493] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.438710 6791 raft_consensus.cc:515] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.439270 6791 leader_election.cc:290] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.439802 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75847513dcf4c84913a4073176f2507" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:03.439965 5381 raft_consensus.cc:3060] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.440172 5432 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:03.440402 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a07adcd33414d18ae9720e7a307548a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.440537 5385 raft_consensus.cc:2468] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:03.441390 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4211f338c6a648c5b3e36c6df0b3c510" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.441511 5385 raft_consensus.cc:2468] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:03.439962 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e1acd618fc44be9169fa1d56fa510a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.443853 5381 raft_consensus.cc:2468] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
W20260927 13:50:03.445267 6442 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b26289ed050454d817c13159295ec37 has no consensus state
I20260927 13:50:03.446156 5619 tablet_bootstrap.cc:492] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.446293 5619 ts_tablet_manager.cc:1403] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20260927 13:50:03.447012 5619 raft_consensus.cc:359] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.447170 5619 raft_consensus.cc:385] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.447227 5619 raft_consensus.cc:740] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.447472 5619 consensus_queue.cc:260] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.448069 5619 ts_tablet_manager.cc:1434] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:03.448343 5619 tablet_bootstrap.cc:492] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.450140 6442 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_e039138831b14ad6b5324ce5cb852dd0" } modify_external_catalogs: true
I20260927 13:50:03.450322 6442 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_e039138831b14ad6b5324ce5cb852dd0" } modify_external_catalogs: true
I20260927 13:50:03.450798 5619 tablet_bootstrap.cc:654] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.454654 5628 tablet_bootstrap.cc:492] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.454798 5628 ts_tablet_manager.cc:1403] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260927 13:50:03.455470 5628 raft_consensus.cc:359] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.455639 5628 raft_consensus.cc:385] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.455704 5628 raft_consensus.cc:740] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.455942 5628 consensus_queue.cc:260] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.456553 5628 ts_tablet_manager.cc:1434] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:03.442215 5185 leader_election.cc:304] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
W20260927 13:50:03.434715 5319 leader_election.cc:343] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.467778 5185 leader_election.cc:304] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:03.468562 6752 raft_consensus.cc:2804] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.468647 6752 raft_consensus.cc:493] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.468704 6752 raft_consensus.cc:3060] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.468842 6857 consensus_queue.cc:1048] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.469197 6857 raft_consensus.cc:2804] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.469257 6857 raft_consensus.cc:493] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.469305 6857 raft_consensus.cc:3060] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.470890 6986 raft_consensus.cc:493] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.471009 6986 raft_consensus.cc:515] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.471499 6986 leader_election.cc:290] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.471889 6857 raft_consensus.cc:515] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.472118 6447 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_d930205241084c7b957ca0983bfb037f" } modify_external_catalogs: true
I20260927 13:50:03.472390 6447 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_d930205241084c7b957ca0983bfb037f" } modify_external_catalogs: true
I20260927 13:50:03.472752 6857 leader_election.cc:290] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.473922 6752 raft_consensus.cc:515] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.474583 6752 leader_election.cc:290] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.474895 7016 raft_consensus.cc:493] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.475080 7016 raft_consensus.cc:515] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.475811 7016 leader_election.cc:290] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.481374 7016 raft_consensus.cc:493] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.481537 7016 raft_consensus.cc:515] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.482039 6454 master_service.cc:960] ReplaceTablet: received request to replace tablet ecb5cdc007074e0c8f44d963e527a955 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:03.482240 7016 leader_election.cc:290] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.482376 5626 ts_tablet_manager.cc:1434] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.066s user 0.002s sys 0.000s
I20260927 13:50:03.482700 5626 tablet_bootstrap.cc:492] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:03.483750 5319 leader_election.cc:343] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.484192 5319 leader_election.cc:343] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.484534 5319 leader_election.cc:343] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.484823 6880 consensus_queue.cc:1048] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.486737 5628 tablet_bootstrap.cc:492] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.488126 5628 tablet_bootstrap.cc:654] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.495766 5626 tablet_bootstrap.cc:654] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:03.497331 5185 leader_election.cc:343] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.497500 5185 leader_election.cc:304] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.497752 6896 raft_consensus.cc:2749] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.498234 5185 leader_election.cc:304] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:03.498490 6896 raft_consensus.cc:2804] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.498621 6896 raft_consensus.cc:697] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:03.498941 6896 consensus_queue.cc:237] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.501927 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4211f338c6a648c5b3e36c6df0b3c510" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:03.502122 5382 raft_consensus.cc:3060] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.502065 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da75a470ec0c4ec9afa7c18a51cd7276" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.502256 5384 raft_consensus.cc:2468] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:03.502907 5628 tablet_bootstrap.cc:492] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.503037 5628 ts_tablet_manager.cc:1403] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.004s
I20260927 13:50:03.503669 5628 raft_consensus.cc:359] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.503818 5628 raft_consensus.cc:385] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.503866 5628 raft_consensus.cc:740] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.504112 5628 consensus_queue.cc:260] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.504714 5628 ts_tablet_manager.cc:1434] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:03.504936 5382 raft_consensus.cc:2468] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:03.505424 6445 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet f04b3a942c404f3894fbbd6ece24a727
I20260927 13:50:03.505470 5628 tablet_bootstrap.cc:492] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.506006 6445 catalog_manager.cc:6934] ReplaceTablet: tablet f04b3a942c404f3894fbbd6ece24a727 deleted and replaced by tablet 6657ff16861043daa2652597bcf26271
I20260927 13:50:03.506902 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a07adcd33414d18ae9720e7a307548a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:03.507050 5382 raft_consensus.cc:3060] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.507258 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet f04b3a942c404f3894fbbd6ece24a727 with delete_type TABLET_DATA_DELETED (replaced by tablet 6657ff16861043daa2652597bcf26271) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.507504 7098 tablet_replica.cc:333] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:03.507679 7098 raft_consensus.cc:2243] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:03.507876 7098 raft_consensus.cc:2272] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:03.507992 5628 tablet_bootstrap.cc:654] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.508420 7098 ts_tablet_manager.cc:1916] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:03.512969 5382 raft_consensus.cc:2468] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:03.518491 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet f04b3a942c404f3894fbbd6ece24a727 with delete_type TABLET_DATA_DELETED (replaced by tablet 6657ff16861043daa2652597bcf26271) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:03.518915 7104 tablet_replica.cc:333] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:03.519173 7104 raft_consensus.cc:2243] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:03.519388 7104 raft_consensus.cc:2272] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:03.519464 6445 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_4f0c853ca7b6461a8c933b047b632834"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:03.520064 7104 ts_tablet_manager.cc:1916] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:03.520061 6445 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f0c853ca7b6461a8c933b047b632834 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.528542 7098 ts_tablet_manager.cc:1929] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:03.528767 7098 log.cc:1199] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f04b3a942c404f3894fbbd6ece24a727
I20260927 13:50:03.529376 7098 ts_tablet_manager.cc:1950] T f04b3a942c404f3894fbbd6ece24a727 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:03.530261 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f04b3a942c404f3894fbbd6ece24a727 (table default.Table_db70ad184fab4e5984d1777fecae5518 [id=c6230203df764e97a3fd3c8117177db2]) successfully deleted
I20260927 13:50:03.532401 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e3bb24afad4d789041b6a557512618" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.532905 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e7e50142e447158f90770322609a2f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:03.533592 5044 leader_election.cc:343] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.533624 5185 leader_election.cc:304] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:50:03.533829 5044 leader_election.cc:343] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.533896 5185 leader_election.cc:304] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:03.533995 7124 raft_consensus.cc:2804] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.534067 7124 raft_consensus.cc:493] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.534097 6896 raft_consensus.cc:2804] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.534214 6896 raft_consensus.cc:697] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:03.534164 7124 raft_consensus.cc:3060] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.534459 6896 consensus_queue.cc:237] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.537848 7124 raft_consensus.cc:515] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.538461 7124 leader_election.cc:290] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.543308 7104 ts_tablet_manager.cc:1929] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 13:50:03.543656 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 58864.4us
I20260927 13:50:03.544597 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 44d85213c05c465abda78cc49c70d36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.545400 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bc839e0fc54839a5d06c176760f618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.545636 7111 tablet_replica.cc:333] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:03.545848 7111 raft_consensus.cc:2243] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:03.546002 7111 raft_consensus.cc:2272] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:03.546559 7111 ts_tablet_manager.cc:1916] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:03.546633 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet da75a470ec0c4ec9afa7c18a51cd7276 with delete_type TABLET_DATA_DELETED (replaced by tablet bad30e7310c842e6818471272f5d669e) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.547169 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet a813939920244be781d546311fe8a33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.547703 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.548204 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet f04b3a942c404f3894fbbd6ece24a727 with delete_type TABLET_DATA_DELETED (replaced by tablet 6657ff16861043daa2652597bcf26271) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.550257 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d29459405b4cdd921fb43bf5a2ae81" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.550884 7016 raft_consensus.cc:493] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.551041 7016 raft_consensus.cc:515] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:03.551266 6455 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e808336f5b746d486d375695536c052 consensus state has no leader
I20260927 13:50:03.551586 6455 master_service.cc:960] ReplaceTablet: received request to replace tablet 4b13c629908a47368846770c697aebd8 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:03.551651 7016 leader_election.cc:290] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.552541 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0827a26334c42728545a9eaa006fae0" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.553184 7104 log.cc:1199] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f04b3a942c404f3894fbbd6ece24a727
I20260927 13:50:03.554230 7104 ts_tablet_manager.cc:1950] T f04b3a942c404f3894fbbd6ece24a727 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:03.554471 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e3bb24afad4d789041b6a557512618" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.555138 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880ce1300eac40b28aac8cba3e11077e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.555500 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e7e50142e447158f90770322609a2f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.555609 7111 ts_tablet_manager.cc:1929] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:03.556107 7111 log.cc:1199] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/50bc839e0fc54839a5d06c176760f618
I20260927 13:50:03.557031 7111 ts_tablet_manager.cc:1950] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:03.545130 5185 leader_election.cc:304] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:03.561038 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880ce1300eac40b28aac8cba3e11077e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.562258 7123 raft_consensus.cc:2804] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.562393 7123 raft_consensus.cc:697] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:03.562646 7123 consensus_queue.cc:237] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.565333 7111 tablet_replica.cc:333] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:03.566742 5628 tablet_bootstrap.cc:492] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.566890 5628 ts_tablet_manager.cc:1403] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.001s
I20260927 13:50:03.562041 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da75a470ec0c4ec9afa7c18a51cd7276" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:03.567102 5382 raft_consensus.cc:3060] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.567550 5628 raft_consensus.cc:359] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.567744 5628 raft_consensus.cc:385] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.567813 5628 raft_consensus.cc:740] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:50:03.569056 6451 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 85130d7ea68545518ca3c255e28a20d3 consensus state has no leader
I20260927 13:50:03.570055 5382 raft_consensus.cc:2468] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
W20260927 13:50:03.518551 5184 consensus_peers.cc:597] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b57886cc11a2423983c2b7bac79150a0. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:03.570530 7111 raft_consensus.cc:2243] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 13:50:03.570359 5184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 51842.5us
I20260927 13:50:03.570703 7111 raft_consensus.cc:2272] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:03.570851 5184 leader_election.cc:343] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: da75a470ec0c4ec9afa7c18a51cd7276
W20260927 13:50:03.571144 5184 leader_election.cc:343] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 4211f338c6a648c5b3e36c6df0b3c510
I20260927 13:50:03.571228 7111 ts_tablet_manager.cc:1916] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:03.571388 5184 leader_election.cc:343] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3a07adcd33414d18ae9720e7a307548a
I20260927 13:50:03.573101 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f04b3a942c404f3894fbbd6ece24a727 (table default.Table_db70ad184fab4e5984d1777fecae5518 [id=c6230203df764e97a3fd3c8117177db2]) successfully deleted
W20260927 13:50:03.573590 5184 leader_election.cc:343] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: da75a470ec0c4ec9afa7c18a51cd7276
W20260927 13:50:03.574131 5044 leader_election.cc:343] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.574290 5628 consensus_queue.cc:260] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.574841 5628 ts_tablet_manager.cc:1434] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260927 13:50:03.575609 5185 leader_election.cc:304] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:03.575860 6896 raft_consensus.cc:2804] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.575976 5628 tablet_bootstrap.cc:492] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.576000 6896 raft_consensus.cc:697] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:03.576215 6896 consensus_queue.cc:237] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.577097 6451 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_17de044576d64b0ca0eb9ca7f930b964"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:03.577384 5628 tablet_bootstrap.cc:654] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:03.577720 6451 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17de044576d64b0ca0eb9ca7f930b964 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.581861 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bc839e0fc54839a5d06c176760f618" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.583096 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bc839e0fc54839a5d06c176760f618" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:03.583266 5106 raft_consensus.cc:2468] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:03.585093 6442 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet e761457384e54078933a07f5b0eca68b
I20260927 13:50:03.585991 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet e761457384e54078933a07f5b0eca68b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:39028
W20260927 13:50:03.587718 5184 consensus_peers.cc:597] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64c7919f5076406186000cd4077aadaf. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:03.588004 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet e761457384e54078933a07f5b0eca68b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:44390
W20260927 13:50:03.590229 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet e761457384e54078933a07f5b0eca68b because the tablet was not found. No further retry: Not found: Tablet not found: e761457384e54078933a07f5b0eca68b
I20260927 13:50:03.590323 6442 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_b0b2ff4faec94fc9a83fc6271fd5ec6d" } new_table_name: "default.Table_7b19583e86df4689a2e40ce5a9148e19" modify_external_catalogs: true
I20260927 13:50:03.591044 5628 tablet_bootstrap.cc:492] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.591197 5628 ts_tablet_manager.cc:1403] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.002s
I20260927 13:50:03.591939 5628 raft_consensus.cc:359] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.592139 5628 raft_consensus.cc:385] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.592209 5628 raft_consensus.cc:740] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.592538 5628 consensus_queue.cc:260] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.593151 5628 ts_tablet_manager.cc:1434] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:03.593497 5628 tablet_bootstrap.cc:492] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.596901 6447 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 0851e183315a45f4a85d68d698e74cb7
I20260927 13:50:03.599483 5628 tablet_bootstrap.cc:654] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.601246 6447 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_a8cb85c2ad064149be57407ba25423d6" } new_table_name: "default.Table_cfdab7814ecc495089389612e0a7e4fe" modify_external_catalogs: true
I20260927 13:50:03.601756 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 0851e183315a45f4a85d68d698e74cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.602416 7098 tablet_replica.cc:333] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:03.602605 7098 raft_consensus.cc:2243] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:03.602749 7098 raft_consensus.cc:2272] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:03.603271 7098 ts_tablet_manager.cc:1916] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:03.606348 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 0851e183315a45f4a85d68d698e74cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:03.607594 5628 tablet_bootstrap.cc:492] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.607714 5628 ts_tablet_manager.cc:1403] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20260927 13:50:03.607713 6454 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet ecb5cdc007074e0c8f44d963e527a955
I20260927 13:50:03.608203 6454 catalog_manager.cc:6934] ReplaceTablet: tablet ecb5cdc007074e0c8f44d963e527a955 deleted and replaced by tablet fc25ff5c6a3545759e7de977f91a9453
I20260927 13:50:03.608294 5628 raft_consensus.cc:359] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.608467 5628 raft_consensus.cc:385] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.608517 5628 raft_consensus.cc:740] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.613884 5628 consensus_queue.cc:260] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.614531 5628 ts_tablet_manager.cc:1434] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 13:50:03.614811 5628 tablet_bootstrap.cc:492] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.614981 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet ecb5cdc007074e0c8f44d963e527a955 with delete_type TABLET_DATA_DELETED (replaced by tablet fc25ff5c6a3545759e7de977f91a9453) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.615458 5626 tablet_bootstrap.cc:492] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.615614 5626 ts_tablet_manager.cc:1403] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.133s user 0.004s sys 0.000s
I20260927 13:50:03.616516 5626 raft_consensus.cc:359] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.616729 5626 raft_consensus.cc:385] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.616791 5626 raft_consensus.cc:740] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.618525 5628 tablet_bootstrap.cc:654] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.620091 7111 ts_tablet_manager.cc:1929] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:03.622920 6454 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_94ba7a27252044beb2d23563d4092a8f" } modify_external_catalogs: true
I20260927 13:50:03.623118 6454 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_94ba7a27252044beb2d23563d4092a8f" } modify_external_catalogs: true
I20260927 13:50:03.623185 7111 log.cc:1199] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/da75a470ec0c4ec9afa7c18a51cd7276
I20260927 13:50:03.623572 7111 ts_tablet_manager.cc:1950] T da75a470ec0c4ec9afa7c18a51cd7276 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:03.624511 7111 tablet_replica.cc:333] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:03.624747 7111 raft_consensus.cc:2243] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:03.629134 7111 raft_consensus.cc:2272] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:03.629959 7111 ts_tablet_manager.cc:1916] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:03.631439 5628 tablet_bootstrap.cc:492] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.631569 5628 ts_tablet_manager.cc:1403] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260927 13:50:03.632200 5628 raft_consensus.cc:359] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.632385 5628 raft_consensus.cc:385] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.632457 5628 raft_consensus.cc:740] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:50:03.634431 5045 leader_election.cc:343] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.634562 5045 leader_election.cc:304] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.634963 6779 raft_consensus.cc:2749] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.636463 5628 consensus_queue.cc:260] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.636951 5628 ts_tablet_manager.cc:1434] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:50:03.637600 7111 ts_tablet_manager.cc:1929] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:03.637907 5628 tablet_bootstrap.cc:492] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.637938 7104 tablet_replica.cc:333] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:03.638574 7104 raft_consensus.cc:2243] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:03.638798 7104 raft_consensus.cc:2272] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:03.639593 7104 ts_tablet_manager.cc:1916] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:03.640095 5628 tablet_bootstrap.cc:654] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:03.644879 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet e761457384e54078933a07f5b0eca68b because the tablet was not found. No further retry: Not found: Tablet not found: e761457384e54078933a07f5b0eca68b
W20260927 13:50:03.645435 5045 leader_election.cc:343] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.645542 5045 leader_election.cc:304] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.645867 6779 raft_consensus.cc:2749] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:03.646615 5045 leader_election.cc:343] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.646747 5045 leader_election.cc:304] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.647176 6779 raft_consensus.cc:2749] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.647447 6779 raft_consensus.cc:493] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.647580 6779 raft_consensus.cc:515] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.648319 6779 leader_election.cc:290] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.650633 5319 leader_election.cc:304] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:03.651100 6793 raft_consensus.cc:2804] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.651180 6793 raft_consensus.cc:493] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.651242 6793 raft_consensus.cc:3060] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.654091 6793 raft_consensus.cc:515] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.654874 6793 leader_election.cc:290] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.655385 5319 leader_election.cc:304] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:03.655608 6793 raft_consensus.cc:2804] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.655684 6793 raft_consensus.cc:493] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.655750 6793 raft_consensus.cc:3060] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.656011 5628 tablet_bootstrap.cc:492] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.656133 5628 ts_tablet_manager.cc:1403] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260927 13:50:03.656804 5628 raft_consensus.cc:359] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.656951 5628 raft_consensus.cc:385] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.656996 5628 raft_consensus.cc:740] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.657171 5628 consensus_queue.cc:260] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.657632 5628 ts_tablet_manager.cc:1434] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 13:50:03.657878 5628 tablet_bootstrap.cc:492] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.660606 6793 raft_consensus.cc:515] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.661129 6793 leader_election.cc:290] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.663630 7111 log.cc:1199] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/a813939920244be781d546311fe8a33e
I20260927 13:50:03.664892 7111 ts_tablet_manager.cc:1950] T a813939920244be781d546311fe8a33e P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:03.666221 7111 tablet_replica.cc:333] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
W20260927 13:50:03.634572 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 44d85213c05c465abda78cc49c70d36f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44d85213c05c465abda78cc49c70d36f already in progress: creating tablet
I20260927 13:50:03.667786 5628 tablet_bootstrap.cc:654] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.669204 7111 raft_consensus.cc:2243] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:03.669433 7111 pending_rounds.cc:70] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:50:03.669507 7111 pending_rounds.cc:77] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957642859552768 op_type: NO_OP noop_request { }
I20260927 13:50:03.669621 7111 raft_consensus.cc:2889] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:03.669716 7111 raft_consensus.cc:2272] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:03.670945 7125 raft_consensus.cc:493] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.671097 7125 raft_consensus.cc:515] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.671721 7125 leader_election.cc:290] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.674602 7111 ts_tablet_manager.cc:1916] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:03.681587 6451 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_9e90cb3d6f55432795b8bcde5584712a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.682224 6451 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e90cb3d6f55432795b8bcde5584712a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.649279 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet ecb5cdc007074e0c8f44d963e527a955 with delete_type TABLET_DATA_DELETED (replaced by tablet fc25ff5c6a3545759e7de977f91a9453) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:03.662294 7123 raft_consensus.cc:493] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.682610 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d48db9b20a41419d5be703190fadd8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.686810 5626 consensus_queue.cc:260] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.688225 7123 raft_consensus.cc:515] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.688710 5626 ts_tablet_manager.cc:1434] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.073s user 0.002s sys 0.000s
I20260927 13:50:03.688782 7123 leader_election.cc:290] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.688987 5626 tablet_bootstrap.cc:492] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:03.689603 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e14fd01a9141cdb2df030ee0dd05db" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:03.689821 5106 raft_consensus.cc:2468] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:03.690537 5626 tablet_bootstrap.cc:654] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.691160 5184 leader_election.cc:304] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:03.691426 6896 raft_consensus.cc:2804] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.691545 6896 raft_consensus.cc:493] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.691663 6896 raft_consensus.cc:3060] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.694238 6896 raft_consensus.cc:515] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.694837 6896 leader_election.cc:290] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.694802 6451 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_46120fb594064efdb49bfbe4e64d3598"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:03.694864 7125 consensus_queue.cc:1048] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:03.695866 5044 leader_election.cc:343] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.696272 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e14fd01a9141cdb2df030ee0dd05db" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:03.696439 5106 raft_consensus.cc:3060] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.697065 5626 tablet_bootstrap.cc:492] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.697173 5626 ts_tablet_manager.cc:1403] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260927 13:50:03.697877 5626 raft_consensus.cc:359] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.698010 5626 raft_consensus.cc:385] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.698055 5626 raft_consensus.cc:740] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.699546 5106 raft_consensus.cc:2468] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:03.700026 5184 leader_election.cc:304] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:03.700423 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e14fd01a9141cdb2df030ee0dd05db" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.700629 5382 raft_consensus.cc:2468] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:03.701560 7111 ts_tablet_manager.cc:1929] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 13:50:03.701948 6451 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46120fb594064efdb49bfbe4e64d3598 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.702003 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e14fd01a9141cdb2df030ee0dd05db" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:03.702167 5382 raft_consensus.cc:3060] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.702194 6896 raft_consensus.cc:2804] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.702409 6896 raft_consensus.cc:697] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:03.702630 6896 consensus_queue.cc:237] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.701825 7111 log.cc:1199] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/1ae6b1e46bdc4c28a2d0a2633d40f92a
I20260927 13:50:03.705173 5382 raft_consensus.cc:2468] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:03.705468 7111 ts_tablet_manager.cc:1950] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:03.705416 5626 consensus_queue.cc:260] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.705927 5626 ts_tablet_manager.cc:1434] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260927 13:50:03.706137 5319 leader_election.cc:304] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:50:03.706363 5319 raft_consensus.cc:2686] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:50:03.706869 5628 tablet_bootstrap.cc:492] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.709143 6451 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_5e9055a0823846ddae6164cecbf5a882"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.709700 6451 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e9055a0823846ddae6164cecbf5a882 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.710229 6896 consensus_queue.cc:1048] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.712558 7111 tablet_replica.cc:333] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:03.712780 5628 ts_tablet_manager.cc:1403] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.055s user 0.007s sys 0.001s
I20260927 13:50:03.711243 6779 raft_consensus.cc:493] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.713130 7111 raft_consensus.cc:2243] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:03.713097 6779 raft_consensus.cc:515] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.713405 7111 raft_consensus.cc:2272] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:03.713735 6779 leader_election.cc:290] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.714928 5619 tablet_bootstrap.cc:492] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.715042 5619 ts_tablet_manager.cc:1403] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.267s user 0.018s sys 0.049s
I20260927 13:50:03.714998 5628 raft_consensus.cc:359] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.715160 5628 raft_consensus.cc:385] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.715209 5628 raft_consensus.cc:740] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.715426 5628 consensus_queue.cc:260] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.718102 6451 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_47c17bb336c34c678a4dfe8ada8a1d95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.718688 6451 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47c17bb336c34c678a4dfe8ada8a1d95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.722303 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 50bc839e0fc54839a5d06c176760f618 (table default.Table_16dc00b04267495ea0bf7b352b433889 [id=02b943faad65425ba6058acef5bff0eb]) successfully deleted
I20260927 13:50:03.723678 7098 ts_tablet_manager.cc:1929] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 13:50:03.723716 5045 leader_election.cc:343] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.723801 7098 log.cc:1199] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/0851e183315a45f4a85d68d698e74cb7
I20260927 13:50:03.723832 5045 leader_election.cc:304] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.724169 7098 ts_tablet_manager.cc:1950] T 0851e183315a45f4a85d68d698e74cb7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:50:03.724206 5045 leader_election.cc:343] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.724295 5045 leader_election.cc:304] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.724480 7016 raft_consensus.cc:2749] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.724643 7016 raft_consensus.cc:2749] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.725340 7111 ts_tablet_manager.cc:1916] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:03.725502 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 0851e183315a45f4a85d68d698e74cb7 (table default.Table_d930205241084c7b957ca0983bfb037f [id=dd996f6d5b764e799ed45890225b7670]) successfully deleted
W20260927 13:50:03.725756 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet ecb5cdc007074e0c8f44d963e527a955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecb5cdc007074e0c8f44d963e527a955 already in progress: creating tablet
I20260927 13:50:03.727583 5619 raft_consensus.cc:359] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.727766 5619 raft_consensus.cc:385] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.727824 5619 raft_consensus.cc:740] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.728024 5619 consensus_queue.cc:260] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.728029 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ca4b429294782a9e6ed496c6dfb72" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.728543 5619 ts_tablet_manager.cc:1434] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260927 13:50:03.728829 5619 tablet_bootstrap.cc:492] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.730083 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet da75a470ec0c4ec9afa7c18a51cd7276 (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]) successfully deleted
W20260927 13:50:03.730365 5044 leader_election.cc:343] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.731060 6451 master_service.cc:960] ReplaceTablet: received request to replace tablet 1087ad60dade46bb9d38f52a94dd536b from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:03.732882 5628 ts_tablet_manager.cc:1434] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.020s user 0.000s sys 0.001s
I20260927 13:50:03.733462 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d9c94ee0af46e8aea12adac57829f7" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:03.735533 5626 tablet_bootstrap.cc:492] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:03.736864 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbacda63c0d3427aabf3332b278576c5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:03.737416 5626 tablet_bootstrap.cc:654] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.736238 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d9c94ee0af46e8aea12adac57829f7" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:03.737797 5106 raft_consensus.cc:3060] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.738790 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbacda63c0d3427aabf3332b278576c5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:03.738863 5619 tablet_bootstrap.cc:654] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.738933 5107 raft_consensus.cc:3060] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.741505 5107 raft_consensus.cc:2468] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:03.741653 5106 raft_consensus.cc:2468] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:03.745154 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ee31d13d1a4c3c99b9accb4e4f5cb6" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.745445 5247 raft_consensus.cc:2468] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:03.746454 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet a813939920244be781d546311fe8a33e (table default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]) successfully deleted
I20260927 13:50:03.747792 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a (table default.Table_42fee70b5ead49929314182670a6aa7e [id=bfd622f425d94088a9bb3afb7475021e]) successfully deleted
I20260927 13:50:03.748345 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ee31d13d1a4c3c99b9accb4e4f5cb6" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:03.748605 5106 raft_consensus.cc:2468] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:03.749226 7145 tablet.cc:1751] T 3513663de6724b108adcb46cc151163c P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:50:03.755146 5626 tablet_bootstrap.cc:492] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.755296 5626 ts_tablet_manager.cc:1403] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260927 13:50:03.756043 5626 raft_consensus.cc:359] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.756206 5626 raft_consensus.cc:385] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.756276 5626 raft_consensus.cc:740] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.756225 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d48db9b20a41419d5be703190fadd8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.756917 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ca4b429294782a9e6ed496c6dfb72" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:03.757103 5381 raft_consensus.cc:2468] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:03.757580 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet e761457384e54078933a07f5b0eca68b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.738452 5628 tablet_bootstrap.cc:492] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.759846 5626 consensus_queue.cc:260] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.761173 5628 tablet_bootstrap.cc:654] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.762440 5626 ts_tablet_manager.cc:1434] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 13:50:03.764760 6779 raft_consensus.cc:493] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.764894 6779 raft_consensus.cc:515] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:03.765409 6779 leader_election.cc:290] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.767565 6896 consensus_queue.cc:1048] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.767969 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0d3e3f86440448a88404f0ac06e0c0c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:03.775014 5044 leader_election.cc:343] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.782908 5619 tablet_bootstrap.cc:492] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.783070 5619 ts_tablet_manager.cc:1403] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.004s
I20260927 13:50:03.789423 5628 tablet_bootstrap.cc:492] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.789577 5628 ts_tablet_manager.cc:1403] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.051s user 0.008s sys 0.003s
I20260927 13:50:03.791275 5628 raft_consensus.cc:359] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.791460 5628 raft_consensus.cc:385] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.791512 5628 raft_consensus.cc:740] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.791743 5628 consensus_queue.cc:260] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.792348 5628 ts_tablet_manager.cc:1434] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:03.793007 5628 tablet_bootstrap.cc:492] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.794950 6451 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 1087ad60dade46bb9d38f52a94dd536b
I20260927 13:50:03.795495 6451 catalog_manager.cc:6934] ReplaceTablet: tablet 1087ad60dade46bb9d38f52a94dd536b deleted and replaced by tablet 07830b76d7e14ff0b6b1b1523dda21bc
I20260927 13:50:03.795867 5222 tablet_service.cc:1558] Processing DeleteTablet for tablet 1087ad60dade46bb9d38f52a94dd536b with delete_type TABLET_DATA_DELETED (replaced by tablet 07830b76d7e14ff0b6b1b1523dda21bc) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:03.795873 6451 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_3272a4a26c764ccfa98301a594aacfba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.796402 6451 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3272a4a26c764ccfa98301a594aacfba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.797712 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 1087ad60dade46bb9d38f52a94dd536b with delete_type TABLET_DATA_DELETED (replaced by tablet 07830b76d7e14ff0b6b1b1523dda21bc) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.798534 5628 tablet_bootstrap.cc:654] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.796044 5619 raft_consensus.cc:359] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.799836 5619 raft_consensus.cc:385] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.799889 5619 raft_consensus.cc:740] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.800078 5619 consensus_queue.cc:260] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.801280 5619 ts_tablet_manager.cc:1434] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260927 13:50:03.801555 5619 tablet_bootstrap.cc:492] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.801955 7098 tablet_replica.cc:333] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:03.802173 7098 raft_consensus.cc:2243] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:03.802332 7098 raft_consensus.cc:2272] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:03.803234 5619 tablet_bootstrap.cc:654] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.803368 7098 ts_tablet_manager.cc:1916] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:03.810457 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 0851e183315a45f4a85d68d698e74cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.810927 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet ecb5cdc007074e0c8f44d963e527a955 with delete_type TABLET_DATA_DELETED (replaced by tablet fc25ff5c6a3545759e7de977f91a9453) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:03.811225 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 1087ad60dade46bb9d38f52a94dd536b with delete_type TABLET_DATA_DELETED (replaced by tablet 07830b76d7e14ff0b6b1b1523dda21bc) from {username='slave'} at 127.0.0.1:35946
W20260927 13:50:03.812322 5319 leader_election.cc:343] T 50bc839e0fc54839a5d06c176760f618 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.814339 5319 consensus_peers.cc:597] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:50:03.814486 5319 leader_election.cc:343] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.814626 5319 leader_election.cc:343] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.814914 5319 leader_election.cc:304] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:03.815354 5222 tablet_service.cc:1511] Processing CreateTablet for tablet b6a36afae51e4aaeb61ed0010f4077e3 (DEFAULT_TABLE table=default.Table_51418e08551949709fa1cc76c3d6bd21 [id=ff0e6686b11541b09e78176361aca3b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.815766 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a36afae51e4aaeb61ed0010f4077e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.818426 5086 tablet_service.cc:1511] Processing CreateTablet for tablet b6a36afae51e4aaeb61ed0010f4077e3 (DEFAULT_TABLE table=default.Table_51418e08551949709fa1cc76c3d6bd21 [id=ff0e6686b11541b09e78176361aca3b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.818816 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a36afae51e4aaeb61ed0010f4077e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.821806 6455 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 4b13c629908a47368846770c697aebd8
I20260927 13:50:03.822361 6455 catalog_manager.cc:6934] ReplaceTablet: tablet 4b13c629908a47368846770c697aebd8 deleted and replaced by tablet dec7c4c6b46d4b5791d9b7af1a8e55cc
I20260927 13:50:03.822434 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 2a92a10032dd40008cdcffd0699e1874 (DEFAULT_TABLE table=default.Table_022283b66bf4471691348ed0a603a4c3 [id=fca092c89d4e44cfbce954b0d0fd8400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.822827 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a92a10032dd40008cdcffd0699e1874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.822764 6455 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_58d22b166d164bd7baa193ee9ccae8ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.823318 6455 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58d22b166d164bd7baa193ee9ccae8ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.825577 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b13c629908a47368846770c697aebd8 with delete_type TABLET_DATA_DELETED (replaced by tablet dec7c4c6b46d4b5791d9b7af1a8e55cc) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:03.826026 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 2a92a10032dd40008cdcffd0699e1874 (DEFAULT_TABLE table=default.Table_022283b66bf4471691348ed0a603a4c3 [id=fca092c89d4e44cfbce954b0d0fd8400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.826385 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a92a10032dd40008cdcffd0699e1874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.830189 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b13c629908a47368846770c697aebd8 with delete_type TABLET_DATA_DELETED (replaced by tablet dec7c4c6b46d4b5791d9b7af1a8e55cc) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.831466 6896 consensus_queue.cc:1048] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:03.843448 5084 tablet_service.cc:1511] Processing CreateTablet for tablet 34cd6225aaf34bdbbec06df453d57301 (DEFAULT_TABLE table=default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.843881 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cd6225aaf34bdbbec06df453d57301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.844511 6451 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_8e30f259d16146d18136753eb1805e15" } new_table_name: "default.Table_3403808c5c374ea394fee64ad76c8d73" modify_external_catalogs: true
I20260927 13:50:03.848878 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 34cd6225aaf34bdbbec06df453d57301 (DEFAULT_TABLE table=default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.849445 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cd6225aaf34bdbbec06df453d57301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.854707 6455 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_1b2791929bad4aaea7fcd8e2b206334d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:03.855167 7104 ts_tablet_manager.cc:1929] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 13:50:03.855304 6455 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b2791929bad4aaea7fcd8e2b206334d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.855332 7104 log.cc:1199] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/0851e183315a45f4a85d68d698e74cb7
I20260927 13:50:03.855872 7104 ts_tablet_manager.cc:1950] T 0851e183315a45f4a85d68d698e74cb7 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:03.859452 7111 ts_tablet_manager.cc:1929] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:03.859655 7111 log.cc:1199] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/f04b3a942c404f3894fbbd6ece24a727
I20260927 13:50:03.860164 7111 ts_tablet_manager.cc:1950] T f04b3a942c404f3894fbbd6ece24a727 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:50:03.861498 5185 consensus_peers.cc:597] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a -> Peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Couldn't send request to peer bb28c54312c94d7dafb1c2abf7870735. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a813939920244be781d546311fe8a33e. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:03.863317 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 0851e183315a45f4a85d68d698e74cb7 (table default.Table_d930205241084c7b957ca0983bfb037f [id=dd996f6d5b764e799ed45890225b7670]) successfully deleted
I20260927 13:50:03.768076 5626 tablet_bootstrap.cc:492] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:03.867538 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet ecb5cdc007074e0c8f44d963e527a955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecb5cdc007074e0c8f44d963e527a955 already in progress: creating tablet
I20260927 13:50:03.867671 5626 tablet_bootstrap.cc:654] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:03.867812 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 1087ad60dade46bb9d38f52a94dd536b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1087ad60dade46bb9d38f52a94dd536b already in progress: creating tablet
W20260927 13:50:03.868013 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 4b13c629908a47368846770c697aebd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b13c629908a47368846770c697aebd8 already in progress: creating tablet
I20260927 13:50:03.869083 7125 raft_consensus.cc:2804] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.869184 7125 raft_consensus.cc:493] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.869275 7125 raft_consensus.cc:3060] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:03.871289 5184 consensus_peers.cc:597] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3933c0a2fd6547f28528fae7d443a2c1. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:03.871889 5084 tablet_service.cc:1511] Processing CreateTablet for tablet fd861e06085e4c7b8bdf1101432bdc31 (DEFAULT_TABLE table=default.Table_3b716a51ffbe4613a958b62eef4cdcb6 [id=f4ff4dd6b47a4ce9a42f7b13a6a1ce34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.873008 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd861e06085e4c7b8bdf1101432bdc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.872967 7125 raft_consensus.cc:515] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.873620 7125 leader_election.cc:290] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.874012 5222 tablet_service.cc:1511] Processing CreateTablet for tablet fd861e06085e4c7b8bdf1101432bdc31 (DEFAULT_TABLE table=default.Table_3b716a51ffbe4613a958b62eef4cdcb6 [id=f4ff4dd6b47a4ce9a42f7b13a6a1ce34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.874508 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd861e06085e4c7b8bdf1101432bdc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.877045 6455 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_65dc116e5f0344ce81993d560de66aa0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:03.877714 6455 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65dc116e5f0344ce81993d560de66aa0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:03.881564 5219 tablet_service.cc:1511] Processing CreateTablet for tablet d2d8f69b4e964dc98db3809eecdf8ad7 (DEFAULT_TABLE table=default.Table_240f3492390b48428f555f3f2dbce154 [id=ef4c47103ab94117b1130306118f923f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.881910 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d8f69b4e964dc98db3809eecdf8ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.882684 5619 tablet_bootstrap.cc:492] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.882822 5619 ts_tablet_manager.cc:1403] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.081s user 0.002s sys 0.002s
I20260927 13:50:03.883569 5619 raft_consensus.cc:359] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.888677 5086 tablet_service.cc:1511] Processing CreateTablet for tablet d2d8f69b4e964dc98db3809eecdf8ad7 (DEFAULT_TABLE table=default.Table_240f3492390b48428f555f3f2dbce154 [id=ef4c47103ab94117b1130306118f923f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.888989 5619 raft_consensus.cc:385] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.889122 5619 raft_consensus.cc:740] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.889272 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d8f69b4e964dc98db3809eecdf8ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.889436 5619 consensus_queue.cc:260] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.889556 6455 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_7b9eaaab4c6149e09eb18425cb5c38a3" } new_table_name: "default.Table_92d85a6034254e3ead61aa5649669d9b" modify_external_catalogs: true
W20260927 13:50:03.891379 5184 consensus_peers.cc:597] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb25bb5ee153494d803130f1ad4f7c2e. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:03.891856 5219 tablet_service.cc:1511] Processing CreateTablet for tablet c0779fde1c55428fbf09ff46cf448387 (DEFAULT_TABLE table=default.Table_7db7dcae15a64ff4b308591077608880 [id=ea5c56db81904caab25d8b1a0c6d0fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.892294 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0779fde1c55428fbf09ff46cf448387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.892863 5075 tablet_service.cc:1511] Processing CreateTablet for tablet c0779fde1c55428fbf09ff46cf448387 (DEFAULT_TABLE table=default.Table_7db7dcae15a64ff4b308591077608880 [id=ea5c56db81904caab25d8b1a0c6d0fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.890808 5619 ts_tablet_manager.cc:1434] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260927 13:50:03.893410 5619 tablet_bootstrap.cc:492] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:03.894405 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0779fde1c55428fbf09ff46cf448387. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:03.900476 6455 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f551c48587df4681961234121507af1a consensus state has no leader
I20260927 13:50:03.900818 6455 master_service.cc:960] ReplaceTablet: received request to replace tablet b9a1193719e140beb9b492927adeb78c from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:03.901120 5619 tablet_bootstrap.cc:654] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:03.905272 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 90364.4us
W20260927 13:50:03.906786 5184 consensus_peers.cc:597] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b082227264e442a8b1db7a68fb0c3eb. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:03.910964 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 58d9274ad0934f19a7c36325eee3dd59 (DEFAULT_TABLE table=default.Table_544497088a2047e8a6b190c4e23e3e1c [id=d7b1a5499c5f4f9784a8952f1e66c3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.911356 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d9274ad0934f19a7c36325eee3dd59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.911801 6455 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet b9a1193719e140beb9b492927adeb78c
I20260927 13:50:03.912602 6455 catalog_manager.cc:6934] ReplaceTablet: tablet b9a1193719e140beb9b492927adeb78c deleted and replaced by tablet a583d84f0f9247c68f330149b41e65ae
I20260927 13:50:03.913337 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet b9a1193719e140beb9b492927adeb78c with delete_type TABLET_DATA_DELETED (replaced by tablet a583d84f0f9247c68f330149b41e65ae) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:03.914216 5229 tablet_service.cc:1558] Processing DeleteTablet for tablet b9a1193719e140beb9b492927adeb78c with delete_type TABLET_DATA_DELETED (replaced by tablet a583d84f0f9247c68f330149b41e65ae) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:03.915145 5084 tablet_service.cc:1511] Processing CreateTablet for tablet 58d9274ad0934f19a7c36325eee3dd59 (DEFAULT_TABLE table=default.Table_544497088a2047e8a6b190c4e23e3e1c [id=d7b1a5499c5f4f9784a8952f1e66c3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.916612 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d9274ad0934f19a7c36325eee3dd59. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:03.916923 6429 consensus_peers.cc:597] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c -> Peer 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095): Couldn't send request to peer 802b83f09d3445359cfac825cd87c9de. Status: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260927 13:50:03.920311 5075 tablet_service.cc:1511] Processing CreateTablet for tablet fb1532f75f1c481696240b0016a646a9 (DEFAULT_TABLE table=default.Table_4121f961061a429290fbb458b1059ba0 [id=609e0e0e929e47adacb63fee55390a6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.921144 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1532f75f1c481696240b0016a646a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.921366 5227 tablet_service.cc:1511] Processing CreateTablet for tablet fb1532f75f1c481696240b0016a646a9 (DEFAULT_TABLE table=default.Table_4121f961061a429290fbb458b1059ba0 [id=609e0e0e929e47adacb63fee55390a6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.921725 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1532f75f1c481696240b0016a646a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.923233 7123 raft_consensus.cc:493] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.923377 7123 raft_consensus.cc:515] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.923987 7123 leader_election.cc:290] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:03.924554 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b9a1193719e140beb9b492927adeb78c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a1193719e140beb9b492927adeb78c already in progress: creating tablet
I20260927 13:50:03.924531 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bc839e0fc54839a5d06c176760f618" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:03.924723 5107 raft_consensus.cc:2468] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
W20260927 13:50:03.924804 5185 leader_election.cc:343] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 50bc839e0fc54839a5d06c176760f618
I20260927 13:50:03.925390 5184 leader_election.cc:304] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:03.929971 5045 leader_election.cc:343] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.930147 5045 leader_election.cc:304] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:03.930805 5229 tablet_service.cc:1511] Processing CreateTablet for tablet befeab68084b4e6d8e33c5434652c3db (DEFAULT_TABLE table=default.Table_19de48446f02465ca170ad7a349da94d [id=b5a4301a2e1f45d2b20099589ede2b26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.931226 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet befeab68084b4e6d8e33c5434652c3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.931602 6896 raft_consensus.cc:2804] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.931708 6896 raft_consensus.cc:493] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.931808 6896 raft_consensus.cc:3060] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.934265 6779 raft_consensus.cc:2749] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:03.940009 5080 tablet_service.cc:1511] Processing CreateTablet for tablet befeab68084b4e6d8e33c5434652c3db (DEFAULT_TABLE table=default.Table_19de48446f02465ca170ad7a349da94d [id=b5a4301a2e1f45d2b20099589ede2b26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.940392 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet befeab68084b4e6d8e33c5434652c3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.941112 5628 tablet_bootstrap.cc:492] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:03.941236 5628 ts_tablet_manager.cc:1403] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.148s user 0.007s sys 0.002s
I20260927 13:50:03.941535 5045 leader_election.cc:304] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:03.941898 6779 raft_consensus.cc:2804] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:03.941972 6779 raft_consensus.cc:493] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:03.942029 6779 raft_consensus.cc:3060] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.941952 5628 raft_consensus.cc:359] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.942102 5628 raft_consensus.cc:385] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.942170 5628 raft_consensus.cc:740] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.943492 6896 raft_consensus.cc:515] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.946401 6896 leader_election.cc:290] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.945824 5628 consensus_queue.cc:260] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.946826 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bc839e0fc54839a5d06c176760f618" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:03.946981 5107 raft_consensus.cc:3060] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.947801 5628 ts_tablet_manager.cc:1434] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:50:03.948379 7160 tablet.cc:1751] T 3513663de6724b108adcb46cc151163c P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:50:03.950520 5107 raft_consensus.cc:2468] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:03.951037 5184 leader_election.cc:304] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:03.951597 6752 raft_consensus.cc:2804] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.951645 6779 raft_consensus.cc:515] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.951881 6752 raft_consensus.cc:697] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:03.952184 6752 consensus_queue.cc:237] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.953233 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ca4b429294782a9e6ed496c6dfb72" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:50:03.953827 5044 leader_election.cc:343] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.954036 6779 leader_election.cc:290] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.955224 5082 tablet_service.cc:1511] Processing CreateTablet for tablet a9b8029e9be945ca95db7cdb3b010b8e (DEFAULT_TABLE table=default.Table_6b5cdd8077ed408991f25cc07e1cb24f [id=9a14d2729126450ca4dd7f68467662c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.957895 6779 raft_consensus.cc:493] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.958069 6779 raft_consensus.cc:515] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.958992 6779 leader_election.cc:290] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.959421 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aed7fe630f64213846ad37d904f6516" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:03.959868 5044 leader_election.cc:343] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:03.960548 5185 leader_election.cc:343] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 50bc839e0fc54839a5d06c176760f618
I20260927 13:50:03.961171 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 319a788b7d9542f6a2ae11e21bc8af55 (DEFAULT_TABLE table=default.Table_74c7885b9da54e549b3e0207088d8fc2 [id=3f099f07c6384429bb435c7c9f363866]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.961578 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 319a788b7d9542f6a2ae11e21bc8af55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.963268 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 319a788b7d9542f6a2ae11e21bc8af55 (DEFAULT_TABLE table=default.Table_74c7885b9da54e549b3e0207088d8fc2 [id=3f099f07c6384429bb435c7c9f363866]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.966207 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ee31d13d1a4c3c99b9accb4e4f5cb6" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:03.966360 5107 raft_consensus.cc:3060] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.966423 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b8029e9be945ca95db7cdb3b010b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.966727 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ee31d13d1a4c3c99b9accb4e4f5cb6" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:03.966890 5245 raft_consensus.cc:3060] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:03.969146 5107 raft_consensus.cc:2468] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:03.969602 5245 raft_consensus.cc:2468] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:03.969735 6779 raft_consensus.cc:493] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.969856 6779 raft_consensus.cc:515] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.969954 5619 tablet_bootstrap.cc:492] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:03.970072 5619 ts_tablet_manager.cc:1403] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.000s
I20260927 13:50:03.970741 6779 leader_election.cc:290] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.970929 5619 raft_consensus.cc:359] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.971087 5619 raft_consensus.cc:385] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:03.971135 5619 raft_consensus.cc:740] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:03.971140 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54a83664397460399960a0f73966fef" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:03.971630 5044 leader_election.cc:343] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.973925 6793 raft_consensus.cc:493] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.974043 6793 raft_consensus.cc:515] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.974568 6793 leader_election.cc:290] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:03.974867 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 319a788b7d9542f6a2ae11e21bc8af55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.975821 5319 leader_election.cc:304] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:03.976052 6793 raft_consensus.cc:2804] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.976174 6793 raft_consensus.cc:697] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:03.976393 6793 consensus_queue.cc:237] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.983260 5628 tablet_bootstrap.cc:492] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:03.987002 5319 leader_election.cc:304] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:03.987066 5628 tablet_bootstrap.cc:654] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:03.987771 6779 raft_consensus.cc:493] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.987946 6779 raft_consensus.cc:515] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.988335 7016 raft_consensus.cc:493] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.988461 7016 raft_consensus.cc:515] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.988940 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496cffc2a8774185a0e0f63208bed8a5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:03.989032 7016 leader_election.cc:290] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.989151 5626 tablet_bootstrap.cc:492] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:03.989300 5626 ts_tablet_manager.cc:1403] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.227s user 0.003s sys 0.000s
W20260927 13:50:03.989398 5044 leader_election.cc:343] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.989616 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49384587bfa41d6aabfa8ee175d6abe" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:03.990038 5044 leader_election.cc:343] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.990548 6779 leader_election.cc:290] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.991376 7111 tablet_replica.cc:333] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:03.991600 7111 raft_consensus.cc:2243] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:03.991672 6779 raft_consensus.cc:493] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:03.991807 6779 raft_consensus.cc:515] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.992009 6882 raft_consensus.cc:2804] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:03.992139 6882 raft_consensus.cc:697] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:03.992385 6882 consensus_queue.cc:237] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:03.992795 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd91ddaeff4f2a9d7a0761c08fc192" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:03.993271 5044 leader_election.cc:343] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:03.993355 7163 tablet.cc:1751] T 3513663de6724b108adcb46cc151163c P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:50:03.994326 6779 leader_election.cc:290] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:03.998605 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1443441b444075ab502ccdfa355a80 (DEFAULT_TABLE table=default.Table_552cc54d365f49b1848f9806cae88e18 [id=4906565a0f5949f797472db5e4daa544]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:03.999043 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1443441b444075ab502ccdfa355a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:03.998268 5619 consensus_queue.cc:260] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.003840 5619 ts_tablet_manager.cc:1434] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20260927 13:50:04.004155 5619 tablet_bootstrap.cc:492] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:04.006382 5619 tablet_bootstrap.cc:654] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:04.006584 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1443441b444075ab502ccdfa355a80 (DEFAULT_TABLE table=default.Table_552cc54d365f49b1848f9806cae88e18 [id=4906565a0f5949f797472db5e4daa544]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.008095 7125 consensus_queue.cc:1048] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:04.010182 5071 tablet_service.cc:1511] Processing CreateTablet for tablet dba5c22f515c4ad095d15a09a8f5e2dc (DEFAULT_TABLE table=default.Table_fef73c8f52d144b6ae2358a575f61151 [id=47cfa38d5dc84502b26ddc79a872d1a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.010546 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba5c22f515c4ad095d15a09a8f5e2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.008567 5221 tablet_service.cc:1511] Processing CreateTablet for tablet dba5c22f515c4ad095d15a09a8f5e2dc (DEFAULT_TABLE table=default.Table_fef73c8f52d144b6ae2358a575f61151 [id=47cfa38d5dc84502b26ddc79a872d1a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.017383 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba5c22f515c4ad095d15a09a8f5e2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.022611 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 8f102cad945b42b5ba128637d213acca (DEFAULT_TABLE table=default.Table_daa2858f5f994d1ba5432fa5506b2a44 [id=414bf9afb1d54d779d0324aff799dca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.022992 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f102cad945b42b5ba128637d213acca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.023890 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1443441b444075ab502ccdfa355a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.029983 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]). Expected version 2 got 0
I20260927 13:50:04.030432 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_a8cb85c2ad064149be57407ba25423d6 [id=ae170bbebc4e460fb58beb7f95f013a2]). Expected version 1 got 0
I20260927 13:50:04.030732 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]). Expected version 2 got 0
I20260927 13:50:04.031019 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]). Expected version 1 got 0
I20260927 13:50:04.031230 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_954f47d3ef8846b8ade030d87002460e [id=750521adcb384c75841d7e1ff89af83d]). Expected version 2 got 0
I20260927 13:50:04.031603 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]). Expected version 1 got 0
I20260927 13:50:04.031818 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]). Expected version 1 got 0
I20260927 13:50:04.032155 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 992bf643dee64bccaa993a08027aa5fc (table default.Table_85388904282441d09642d64019688c97 [id=00fdc87b0cbf4bc091a92db3004b4397]). Expected version 1 got 0
I20260927 13:50:04.032944 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:50:04.033061 6752 raft_consensus.cc:493] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.033182 6752 raft_consensus.cc:515] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.033257 6445 catalog_manager.cc:5838] T d0cf4234fa5e42469ba6b9bdee1e793f P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65). New cstate: current_term: 1 leader_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } }
I20260927 13:50:04.033730 6752 leader_election.cc:290] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:04.033747 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_908235dbf46e4c6f9a13506c919c6492 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 2 got 0
I20260927 13:50:04.033916 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 95726f690a71433ca63f95da4ee750e5 (table default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e]). Expected version 1 got 0
I20260927 13:50:04.034097 6445 catalog_manager.cc:5838] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260927 13:50:04.034329 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95726f690a71433ca63f95da4ee750e5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:04.034508 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:50:04.034511 5106 raft_consensus.cc:2468] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:04.035022 5184 leader_election.cc:304] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:04.036281 6752 raft_consensus.cc:2804] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:04.036356 6752 raft_consensus.cc:493] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:04.036415 6752 raft_consensus.cc:3060] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:04.036480 5084 tablet_service.cc:1511] Processing CreateTablet for tablet 8f102cad945b42b5ba128637d213acca (DEFAULT_TABLE table=default.Table_daa2858f5f994d1ba5432fa5506b2a44 [id=414bf9afb1d54d779d0324aff799dca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.036867 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f102cad945b42b5ba128637d213acca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.040045 6752 raft_consensus.cc:515] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.041064 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95726f690a71433ca63f95da4ee750e5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:04.041221 5106 raft_consensus.cc:3060] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:04.042312 6445 catalog_manager.cc:5838] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:50:04.042778 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]). Expected version 3 got 0
I20260927 13:50:04.043052 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]). Expected version 1 got 0
I20260927 13:50:04.043227 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]). Expected version 5 got 0
I20260927 13:50:04.043417 6445 catalog_manager.cc:5838] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } }
I20260927 13:50:04.043807 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet f46f45a0a13b4e05802a08880d7f6a01 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]). Expected version 1 got 0
I20260927 13:50:04.044252 6445 catalog_manager.cc:5838] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260927 13:50:04.044791 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
I20260927 13:50:04.045106 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 3513663de6724b108adcb46cc151163c (table default.Table_dcdd264dd7c84641aac8566bae2bf8b6 [id=6b9a7948d0b34aa89f9f7c58a2cd2a0e]). Expected version 2 got 0
I20260927 13:50:04.045581 6445 catalog_manager.cc:5838] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:50:04.044064 5106 raft_consensus.cc:2468] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:04.046975 5619 tablet_bootstrap.cc:492] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:04.047111 5619 ts_tablet_manager.cc:1403] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.003s
I20260927 13:50:04.047408 5184 leader_election.cc:304] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:04.048542 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95726f690a71433ca63f95da4ee750e5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.048491 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95726f690a71433ca63f95da4ee750e5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:04.048935 6752 leader_election.cc:290] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:04.049141 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 71bd7f25c086418297db7f576f45f92d (DEFAULT_TABLE table=default.Table_835ec246322b4927a1c94badce00f804 [id=47b130fed16142099cfe308ab98849f1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:50:04.049340 5185 leader_election.cc:343] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:04.049536 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bd7f25c086418297db7f576f45f92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.050158 6896 consensus_queue.cc:1048] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:04.049150 6752 raft_consensus.cc:2804] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:04.053439 6752 raft_consensus.cc:697] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:04.053658 6752 consensus_queue.cc:237] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.062929 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 362f660cac76436aba54bb707d8a991c (DEFAULT_TABLE table=default.Table_d6b9b32a54ed4746b880a4ae62ad9ba3 [id=2d2f55956ec141f0b2de4501fbc6c655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.063318 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362f660cac76436aba54bb707d8a991c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.063573 5221 tablet_service.cc:1511] Processing CreateTablet for tablet 362f660cac76436aba54bb707d8a991c (DEFAULT_TABLE table=default.Table_d6b9b32a54ed4746b880a4ae62ad9ba3 [id=2d2f55956ec141f0b2de4501fbc6c655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.063958 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362f660cac76436aba54bb707d8a991c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.068164 7125 raft_consensus.cc:493] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.068315 7125 raft_consensus.cc:515] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.068905 7125 leader_election.cc:290] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:04.072218 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 71bd7f25c086418297db7f576f45f92d (DEFAULT_TABLE table=default.Table_835ec246322b4927a1c94badce00f804 [id=47b130fed16142099cfe308ab98849f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.072638 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bd7f25c086418297db7f576f45f92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.075205 5619 raft_consensus.cc:359] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.075400 5619 raft_consensus.cc:385] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:04.075452 5619 raft_consensus.cc:740] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:04.075655 5619 consensus_queue.cc:260] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.076141 5619 ts_tablet_manager.cc:1434] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.029s user 0.000s sys 0.002s
I20260927 13:50:04.076406 5619 tablet_bootstrap.cc:492] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:04.078071 5619 tablet_bootstrap.cc:654] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:04.079886 6752 raft_consensus.cc:493] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.080214 6752 raft_consensus.cc:515] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.081856 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fb1288684c45f6a778d809a5e2c160" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:04.082059 5106 raft_consensus.cc:2468] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:04.083868 5184 leader_election.cc:304] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:04.084697 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fb1288684c45f6a778d809a5e2c160" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.084903 5384 raft_consensus.cc:2468] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:04.085291 6896 raft_consensus.cc:2804] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:04.085433 6896 raft_consensus.cc:493] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:04.085556 6896 raft_consensus.cc:3060] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:04.088124 6793 raft_consensus.cc:493] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.088303 6793 raft_consensus.cc:515] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.088685 6896 raft_consensus.cc:515] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.088909 6793 leader_election.cc:290] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:04.090567 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fb1288684c45f6a778d809a5e2c160" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:04.090833 5106 raft_consensus.cc:3060] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:04.092854 5212 tablet_service.cc:1511] Processing CreateTablet for tablet fd312b6587cc48a096fe68d63e69abc4 (DEFAULT_TABLE table=default.Table_58f9b708528b4ba980888bbb033af8be [id=46389dd8c7dc4a719ab17a29c2259d74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.093729 5106 raft_consensus.cc:2468] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:04.096385 5080 tablet_service.cc:1511] Processing CreateTablet for tablet cda5bf0471894a8da41c3a6520a1abc3 (DEFAULT_TABLE table=default.Table_3fb24892ee2347868762b8a77ed1f594 [id=40da0ef42c8a4519b9e6987b826e513b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.096807 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda5bf0471894a8da41c3a6520a1abc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.098129 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fb1288684c45f6a778d809a5e2c160" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:04.098312 5384 raft_consensus.cc:3060] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:04.101681 5384 raft_consensus.cc:2468] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:04.101747 5619 tablet_bootstrap.cc:492] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:04.101945 5619 ts_tablet_manager.cc:1403] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.002s
W20260927 13:50:04.102809 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 93881.1us
I20260927 13:50:04.103170 5319 leader_election.cc:304] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:04.102811 5619 raft_consensus.cc:359] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.103832 5619 raft_consensus.cc:385] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:04.103926 5619 raft_consensus.cc:740] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:04.104292 5619 consensus_queue.cc:260] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.104822 5628 tablet_bootstrap.cc:492] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:04.104947 5628 ts_tablet_manager.cc:1403] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.122s user 0.003s sys 0.000s
I20260927 13:50:04.105271 5086 tablet_service.cc:1511] Processing CreateTablet for tablet fd312b6587cc48a096fe68d63e69abc4 (DEFAULT_TABLE table=default.Table_58f9b708528b4ba980888bbb033af8be [id=46389dd8c7dc4a719ab17a29c2259d74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.105811 6882 raft_consensus.cc:2804] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:04.105966 6882 raft_consensus.cc:697] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:04.106277 6882 consensus_queue.cc:237] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.107466 7111 raft_consensus.cc:2272] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:04.107997 5619 ts_tablet_manager.cc:1434] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:50:04.108206 7111 ts_tablet_manager.cc:1916] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:04.108335 5619 tablet_bootstrap.cc:492] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:04.094276 5184 leader_election.cc:304] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:04.111023 7123 raft_consensus.cc:2804] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:04.111162 7123 raft_consensus.cc:697] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:04.111403 7123 consensus_queue.cc:237] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:04.115336 5184 consensus_peers.cc:597] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3afb800e7ff44aadaed8f8d85aa9efe2. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:04.117175 5619 tablet_bootstrap.cc:654] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:04.102140 6752 leader_election.cc:290] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:04.118798 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd312b6587cc48a096fe68d63e69abc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.125540 7123 raft_consensus.cc:493] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.010085 5222 tablet_service.cc:1511] Processing CreateTablet for tablet a9b8029e9be945ca95db7cdb3b010b8e (DEFAULT_TABLE table=default.Table_6b5cdd8077ed408991f25cc07e1cb24f [id=9a14d2729126450ca4dd7f68467662c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.125694 7123 raft_consensus.cc:515] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:04.126300 7123 leader_election.cc:290] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.128711 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46f45a0a13b4e05802a08880d7f6a01" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.129741 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee829874a0d4f54a516c947685de021 (DEFAULT_TABLE table=default.Table_3787d49451114bc298d54d844cc68eaa [id=394868e5f3dc477d8825134327ccb4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.130357 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b8029e9be945ca95db7cdb3b010b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.130726 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee829874a0d4f54a516c947685de021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.142968 5214 tablet_service.cc:1511] Processing CreateTablet for tablet d212ee5cd8f7416a840d307b16ba5e28 (DEFAULT_TABLE table=default.Table_52cd6f5926494db78b6f05c29b36d509 [id=3f11aa4dd2e5436b942c02b53621b04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.142975 5219 tablet_service.cc:1511] Processing CreateTablet for tablet cda5bf0471894a8da41c3a6520a1abc3 (DEFAULT_TABLE table=default.Table_3fb24892ee2347868762b8a77ed1f594 [id=40da0ef42c8a4519b9e6987b826e513b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.143422 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d212ee5cd8f7416a840d307b16ba5e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.143639 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda5bf0471894a8da41c3a6520a1abc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.105496 6896 leader_election.cc:290] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:04.146987 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ca4b429294782a9e6ed496c6dfb72" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:04.146997 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 60e3bee895c7405ba37d54ffc7a436b6 (DEFAULT_TABLE table=default.Table_9f53709861824b0591e1b8ce63a64393 [id=bd0f9079417b4b609bd68a7abb12e8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.147153 5382 raft_consensus.cc:3060] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:04.147344 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e3bee895c7405ba37d54ffc7a436b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.151477 5382 raft_consensus.cc:2468] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:50:04.152251 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0d3e3f86440448a88404f0ac06e0c0c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.105590 5626 raft_consensus.cc:359] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.153370 5626 raft_consensus.cc:385] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:04.153502 5626 raft_consensus.cc:740] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:04.153823 5626 consensus_queue.cc:260] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.154543 5626 ts_tablet_manager.cc:1434] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.165s user 0.003s sys 0.000s
I20260927 13:50:04.154656 7111 ts_tablet_manager.cc:1929] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:04.155805 7111 log.cc:1199] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/0851e183315a45f4a85d68d698e74cb7
I20260927 13:50:04.156347 7111 ts_tablet_manager.cc:1950] T 0851e183315a45f4a85d68d698e74cb7 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:04.046087 6445 catalog_manager.cc:5838] T 04d3c47755c94148a488782dbc379011 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260927 13:50:04.160981 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]). Expected version 1 got 0
I20260927 13:50:04.161299 6445 catalog_manager.cc:5838] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 2, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 2 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } }
I20260927 13:50:04.161741 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]). Expected version 1 got 0
I20260927 13:50:04.162029 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 5678703b72c8471583147786f49122a5 (table default.Table_464a0b4a4e9d430fad6cbf768b6bf2ca [id=0d85f9f0d28e43debda43f83a3e59637]). Expected version 1 got 0
I20260927 13:50:04.162385 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]). Expected version 1 got 0
I20260927 13:50:04.162593 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]). Expected version 2 got 0
I20260927 13:50:04.162809 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
I20260927 13:50:04.163008 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]). Expected version 1 got 0
I20260927 13:50:04.163460 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]). Expected version 1 got 0
I20260927 13:50:04.163749 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]). Expected version 2 got 0
I20260927 13:50:04.164019 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 9fdef4f56d9647118afe83ac3cd364fd (table default.Table_f9afa72c04394383a22302115766399d [id=c073a79da0b440698186e6856c8c8c68]). Expected version 3 got 0
I20260927 13:50:04.164223 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]). Expected version 1 got 0
I20260927 13:50:04.105679 5628 raft_consensus.cc:359] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.164669 5628 raft_consensus.cc:385] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:04.164804 5628 raft_consensus.cc:740] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:04.165126 5628 consensus_queue.cc:260] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.165709 5628 ts_tablet_manager.cc:1434] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.061s user 0.002s sys 0.000s
I20260927 13:50:04.175207 5082 tablet_service.cc:1511] Processing CreateTablet for tablet c27872794fb24934b723c56935d94702 (DEFAULT_TABLE table=default.Table_a5b94f165eff40f3826437ed44404e55 [id=caf6214f83fd4d19b26a6f39ef349629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.175742 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27872794fb24934b723c56935d94702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.179886 6779 raft_consensus.cc:493] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.180064 6779 raft_consensus.cc:515] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.180656 6779 leader_election.cc:290] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.182940 5217 tablet_service.cc:1511] Processing CreateTablet for tablet f94b8a726790439ab382830be5fc92ed (DEFAULT_TABLE table=default.Table_3ff54037c03446db8068c7bfd74ac465 [id=6a7df7bc6295417689c6b194556456ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.183416 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94b8a726790439ab382830be5fc92ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.164587 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1b4494b7e895454f81fef308950729ef (table default.Table_8e30f259d16146d18136753eb1805e15 [id=ee0789e9d1f34c3791d35794473e2246]). Expected version 2 got 0
I20260927 13:50:04.193107 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 9e808336f5b746d486d375695536c052 (table default.Table_36609f3408124349b504ae9eb3275d87 [id=d088563f44224b01a3eba63ce70e5681]). Expected version 1 got 0
I20260927 13:50:04.193372 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]). Expected version 1 got 0
I20260927 13:50:04.193579 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]). Expected version 2 got 0
I20260927 13:50:04.193847 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_445d25d3eeb64eb3845dad47fa41f27d [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 1 got 0
I20260927 13:50:04.194319 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]). Expected version 1 got 0
I20260927 13:50:04.194531 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 187b3ceeccb142c4b798947e584d6044 (table default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82]). Expected version 1 got 0
I20260927 13:50:04.194727 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]). Expected version 1 got 0
I20260927 13:50:04.195006 6445 catalog_manager.cc:5838] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:50:04.195503 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]). Expected version 2 got 0
I20260927 13:50:04.195721 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]). Expected version 1 got 0
I20260927 13:50:04.195895 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]). Expected version 1 got 0
I20260927 13:50:04.196149 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:04.196621 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 97b46497d8254a248df8d421d0b09d8d (table default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815]). Expected version 1 got 0
I20260927 13:50:04.197021 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]). Expected version 1 got 0
I20260927 13:50:04.197444 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:04.197572 5628 tablet_bootstrap.cc:492] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:04.197677 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:04.197860 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:04.198029 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:04.198282 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]). Expected version 1 got 0
I20260927 13:50:04.198570 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
I20260927 13:50:04.199021 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:04.199074 5628 tablet_bootstrap.cc:654] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:04.199425 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:04.199640 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
I20260927 13:50:04.129873 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4d5bf420004d1aae51563ec3263b9a (DEFAULT_TABLE table=default.Table_83f977d77c3640b9b7c7c9ccfb96e327 [id=64d546b25be34918a7c80835c0ed7ac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.199990 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4d5bf420004d1aae51563ec3263b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.130168 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46f45a0a13b4e05802a08880d7f6a01" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:04.200461 6445 catalog_manager.cc:5838] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:50:04.200708 5184 leader_election.cc:304] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:04.201129 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]). Expected version 1 got 0
I20260927 13:50:04.201504 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]). Expected version 1 got 0
I20260927 13:50:04.201736 7123 raft_consensus.cc:2749] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:04.201864 5082 tablet_service.cc:1511] Processing CreateTablet for tablet f94b8a726790439ab382830be5fc92ed (DEFAULT_TABLE table=default.Table_3ff54037c03446db8068c7bfd74ac465 [id=6a7df7bc6295417689c6b194556456ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.202054 6445 catalog_manager.cc:5838] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260927 13:50:04.202422 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94b8a726790439ab382830be5fc92ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.202526 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 0d54e51b5c104c75b938aba55cecf890 (table default.Table_a02033f4b12c4cdd986cd855cb148309 [id=0c14f160c8ab4321b14a35fc5f8d3b56]). Expected version 1 got 0
I20260927 13:50:04.202840 6445 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
I20260927 13:50:04.203290 6454 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 467aa7fb4edf4b1b8dad6514d1d017b1
W20260927 13:50:04.203370 6442 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 90fb369fec2d43149080ab2ad94ecc57 consensus state has no leader
I20260927 13:50:04.204128 6454 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_445d25d3eeb64eb3845dad47fa41f27d" } new_table_name: "default.Table_b68a6b76e8684ab9ab1e52fbfaad3740" modify_external_catalogs: true
I20260927 13:50:04.207248 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.207594 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bbc6c76a194e5dbd5e9ea08e95f4f7" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:04.207844 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:39028
W20260927 13:50:04.208511 6447 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5e8ae1a0ce2496cb2eed2066eb37a13 consensus state has no leader
I20260927 13:50:04.208894 6447 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_a836a91c61ae4aa699a3e710b418f9cd" } modify_external_catalogs: true
I20260927 13:50:04.209087 6447 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_a836a91c61ae4aa699a3e710b418f9cd" } modify_external_catalogs: true
W20260927 13:50:04.209245 5044 leader_election.cc:343] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:04.208508 6451 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b4494b7e895454f81fef308950729ef consensus state has no leader
I20260927 13:50:04.210510 6451 master_service.cc:960] ReplaceTablet: received request to replace tablet 95726f690a71433ca63f95da4ee750e5 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:04.211810 7123 consensus_queue.cc:1048] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:04.213188 5071 tablet_service.cc:1511] Processing CreateTablet for tablet 60e3bee895c7405ba37d54ffc7a436b6 (DEFAULT_TABLE table=default.Table_9f53709861824b0591e1b8ce63a64393 [id=bd0f9079417b4b609bd68a7abb12e8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.213702 5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e3bee895c7405ba37d54ffc7a436b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:04.208292 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 467aa7fb4edf4b1b8dad6514d1d017b1 already in progress: creating tablet
I20260927 13:50:04.159252 5084 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee829874a0d4f54a516c947685de021 (DEFAULT_TABLE table=default.Table_3787d49451114bc298d54d844cc68eaa [id=394868e5f3dc477d8825134327ccb4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.160066 5080 tablet_service.cc:1511] Processing CreateTablet for tablet d212ee5cd8f7416a840d307b16ba5e28 (DEFAULT_TABLE table=default.Table_52cd6f5926494db78b6f05c29b36d509 [id=3f11aa4dd2e5436b942c02b53621b04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.213263 7016 raft_consensus.cc:493] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.215611 7016 raft_consensus.cc:515] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.216236 7016 leader_election.cc:290] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.221784 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 820a5574f2304cb7b34ebdbf1f0937f2 (DEFAULT_TABLE table=default.Table_22c755d674734bbdaf00ff031dd35bde [id=e3b2f033f16b4d1185c45d1dc7e99515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.222265 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820a5574f2304cb7b34ebdbf1f0937f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.224057 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d212ee5cd8f7416a840d307b16ba5e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.229074 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 71299230399649d29444f30f94ad0f1b (DEFAULT_TABLE table=default.Table_f11cc18b15654825aa1a7da20c318f26 [id=0d0c63fb4b8d4675a1678a59012efe80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.229489 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71299230399649d29444f30f94ad0f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.230414 5223 tablet_service.cc:1511] Processing CreateTablet for tablet a4099c41981f46758a8f478d7fdb4182 (DEFAULT_TABLE table=default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.230749 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4099c41981f46758a8f478d7fdb4182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.234505 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 55f62f4ba23f4b82b9bcde89126ce1e6 (DEFAULT_TABLE table=default.Table_8cda445237a34eac8407eedddae90d1e [id=8f547ebbb90047fabb7ff5a35a56c857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.234838 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f62f4ba23f4b82b9bcde89126ce1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.238402 5228 tablet_service.cc:1511] Processing CreateTablet for tablet e08e47480cf2482f83f2e32e3b706dc1 (DEFAULT_TABLE table=default.Table_4f52702b62174d5a906804a02e82bea5 [id=090619527c7644578f4f12e2efcdfade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.238740 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08e47480cf2482f83f2e32e3b706dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.242398 5226 tablet_service.cc:1511] Processing CreateTablet for tablet 383cdd68cd5544b399d57e32298bf9db (DEFAULT_TABLE table=default.Table_36a0d6612db348268c1305cf46302992 [id=61efed7929c1470a8463a5a99b493c6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.242745 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383cdd68cd5544b399d57e32298bf9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.245466 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54a83664397460399960a0f73966fef" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.245651 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496cffc2a8774185a0e0f63208bed8a5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.245484 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49384587bfa41d6aabfa8ee175d6abe" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.246284 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd91ddaeff4f2a9d7a0761c08fc192" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.246791 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bbc6c76a194e5dbd5e9ea08e95f4f7" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.247594 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08798185a7c641f98d7dc6a6b1b72e0a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.248282 5349 tablet_service.cc:1511] Processing CreateTablet for tablet b6a36afae51e4aaeb61ed0010f4077e3 (DEFAULT_TABLE table=default.Table_51418e08551949709fa1cc76c3d6bd21 [id=ff0e6686b11541b09e78176361aca3b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.248660 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a36afae51e4aaeb61ed0010f4077e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.250684 6447 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 38a34074d833424bae6035d9e437ad3e
I20260927 13:50:04.251473 6447 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_85388904282441d09642d64019688c97" } modify_external_catalogs: true
I20260927 13:50:04.251646 6447 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_85388904282441d09642d64019688c97" } modify_external_catalogs: true
I20260927 13:50:04.253988 5079 tablet_service.cc:1511] Processing CreateTablet for tablet a4099c41981f46758a8f478d7fdb4182 (DEFAULT_TABLE table=default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.254307 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 55f62f4ba23f4b82b9bcde89126ce1e6 (DEFAULT_TABLE table=default.Table_8cda445237a34eac8407eedddae90d1e [id=8f547ebbb90047fabb7ff5a35a56c857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.254698 5070 tablet_service.cc:1511] Processing CreateTablet for tablet e08e47480cf2482f83f2e32e3b706dc1 (DEFAULT_TABLE table=default.Table_4f52702b62174d5a906804a02e82bea5 [id=090619527c7644578f4f12e2efcdfade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.255107 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 71299230399649d29444f30f94ad0f1b (DEFAULT_TABLE table=default.Table_f11cc18b15654825aa1a7da20c318f26 [id=0d0c63fb4b8d4675a1678a59012efe80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.254046 5077 tablet_service.cc:1511] Processing CreateTablet for tablet bef7b844a07b420faa115fdd22b0539e (DEFAULT_TABLE table=default.Table_fd6ee019e754408fab65109daeb90c0e [id=1ac22cd7afdf47b691add3ee5d043cb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.153097 7098 ts_tablet_manager.cc:1929] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:04.256727 7098 log.cc:1199] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/1087ad60dade46bb9d38f52a94dd536b
I20260927 13:50:04.257133 7098 ts_tablet_manager.cc:1950] T 1087ad60dade46bb9d38f52a94dd536b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:04.258781 5215 tablet_service.cc:1511] Processing CreateTablet for tablet bf7aac9972ba403d883e0c5e2f5c2666 (DEFAULT_TABLE table=default.Table_6d74eaa4eb034485b7844e149cb6b14b [id=d7573db0f99048ac84381b6b2e2d2c08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.259346 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf7aac9972ba403d883e0c5e2f5c2666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.261109 5078 tablet_service.cc:1511] Processing CreateTablet for tablet bf7aac9972ba403d883e0c5e2f5c2666 (DEFAULT_TABLE table=default.Table_6d74eaa4eb034485b7844e149cb6b14b [id=d7573db0f99048ac84381b6b2e2d2c08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.261164 5085 tablet_service.cc:1511] Processing CreateTablet for tablet 1055c50e7ffd4d12a7c4ed424aa13eea (DEFAULT_TABLE table=default.Table_28a47364bcdf40bf851bc99d3513ca99 [id=2760dc486ae9433682cee682308534f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.261694 5074 tablet_service.cc:1511] Processing CreateTablet for tablet 9971bbea3ec2425db728f7832a93fe06 (DEFAULT_TABLE table=default.Table_9749d8dab54a412fb6dd1234772d3155 [id=31e674233f944706b5ad3362d0c2db06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.261775 5081 tablet_service.cc:1511] Processing CreateTablet for tablet 9775c853381749ad89906b32d3adee23 (DEFAULT_TABLE table=default.Table_e34a6db37cbf47d79d8f13cd46cc83fb [id=4d9779ad662542bda9207247226d34a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.262043 5088 tablet_service.cc:1511] Processing CreateTablet for tablet b3cd09c466b8476891cc8b26d13e8701 (DEFAULT_TABLE table=default.Table_aa475363b82246bcbc00b2b60ce222ae [id=227e1333cf1e4ceeb6ecc6e09b014100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.262300 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 1055c50e7ffd4d12a7c4ed424aa13eea (DEFAULT_TABLE table=default.Table_28a47364bcdf40bf851bc99d3513ca99 [id=2760dc486ae9433682cee682308534f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.262346 6455 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:04.262665 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1055c50e7ffd4d12a7c4ed424aa13eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.262620 6455 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:04.262733 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 04e16ca60020406fb46436fa68ea4b33 (DEFAULT_TABLE table=default.Table_2d0fed5c3d8c43dba32fce20571132d1 [id=3583b63e50c74d4c9c8cb6c70ef685ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.262812 6455 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 3513663de6724b108adcb46cc151163c (table default.Table_dcdd264dd7c84641aac8566bae2bf8b6 [id=6b9a7948d0b34aa89f9f7c58a2cd2a0e]). Expected version 2 got 0
I20260927 13:50:04.263005 6455 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:04.263713 6455 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
I20260927 13:50:04.263887 6455 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_445d25d3eeb64eb3845dad47fa41f27d [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 1 got 0
I20260927 13:50:04.264057 6455 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:04.264019 5072 tablet_service.cc:1511] Processing CreateTablet for tablet 262cb3e5f847409993e1ca20c296bff3 (DEFAULT_TABLE table=default.Table_eaa1571598144afbb2bb374264f3f84a [id=6f2177bb5be94c0e99a15217b1c84169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.264194 6455 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:04.264328 6455 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
I20260927 13:50:04.264525 5073 tablet_service.cc:1511] Processing CreateTablet for tablet e016878296da44b9a7691a7fc7206cb9 (DEFAULT_TABLE table=default.Table_2f47a147309843cda12839d088afebef [id=2c1da9087ada46f083eaa9f1a170761f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.264662 6455 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 0d54e51b5c104c75b938aba55cecf890 (table default.Table_a02033f4b12c4cdd986cd855cb148309 [id=0c14f160c8ab4321b14a35fc5f8d3b56]). Expected version 1 got 0
I20260927 13:50:04.264966 6455 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet f46f45a0a13b4e05802a08880d7f6a01 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]). Expected version 1 got 0
W20260927 13:50:04.265290 6454 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6fdacca4b5bd4afb95c83f6c72091b2f consensus state has no leader
I20260927 13:50:04.265969 6896 raft_consensus.cc:493] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.266149 6896 raft_consensus.cc:515] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.266463 5218 tablet_service.cc:1511] Processing CreateTablet for tablet 9971bbea3ec2425db728f7832a93fe06 (DEFAULT_TABLE table=default.Table_9749d8dab54a412fb6dd1234772d3155 [id=31e674233f944706b5ad3362d0c2db06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.266744 6896 leader_election.cc:290] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:04.266903 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9971bbea3ec2425db728f7832a93fe06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.266947 5210 tablet_service.cc:1511] Processing CreateTablet for tablet 9775c853381749ad89906b32d3adee23 (DEFAULT_TABLE table=default.Table_e34a6db37cbf47d79d8f13cd46cc83fb [id=4d9779ad662542bda9207247226d34a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.267443 5220 tablet_service.cc:1511] Processing CreateTablet for tablet b3cd09c466b8476891cc8b26d13e8701 (DEFAULT_TABLE table=default.Table_aa475363b82246bcbc00b2b60ce222ae [id=227e1333cf1e4ceeb6ecc6e09b014100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.267874 5216 tablet_service.cc:1511] Processing CreateTablet for tablet 04e16ca60020406fb46436fa68ea4b33 (DEFAULT_TABLE table=default.Table_2d0fed5c3d8c43dba32fce20571132d1 [id=3583b63e50c74d4c9c8cb6c70ef685ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.268361 5211 tablet_service.cc:1511] Processing CreateTablet for tablet 262cb3e5f847409993e1ca20c296bff3 (DEFAULT_TABLE table=default.Table_eaa1571598144afbb2bb374264f3f84a [id=6f2177bb5be94c0e99a15217b1c84169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.268805 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 383cdd68cd5544b399d57e32298bf9db (DEFAULT_TABLE table=default.Table_36a0d6612db348268c1305cf46302992 [id=61efed7929c1470a8463a5a99b493c6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.272579 5210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9775c853381749ad89906b32d3adee23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.273170 6454 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_4d76dda091074c2a916d8a3993b45834"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:04.273849 6454 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d76dda091074c2a916d8a3993b45834 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.275947 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aed7fe630f64213846ad37d904f6516" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.276721 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4d5bf420004d1aae51563ec3263b9a (DEFAULT_TABLE table=default.Table_83f977d77c3640b9b7c7c9ccfb96e327 [id=64d546b25be34918a7c80835c0ed7ac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.277758 6451 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 95726f690a71433ca63f95da4ee750e5
I20260927 13:50:04.279239 6451 catalog_manager.cc:6934] ReplaceTablet: tablet 95726f690a71433ca63f95da4ee750e5 deleted and replaced by tablet cddf1b48a78e4ff789e0bb0bf75e307b
I20260927 13:50:04.279639 6451 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_cfbb8fd97928450cb39e38bce22effc1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:04.280185 6451 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfbb8fd97928450cb39e38bce22effc1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.284323 6447 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 992bf643dee64bccaa993a08027aa5fc
I20260927 13:50:04.286316 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26a3a50396940cf826442e4ba7356a8" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:04.287081 5626 tablet_bootstrap.cc:492] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:04.288165 6447 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_a0e7f65e456f440497cf22b28f3629bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:04.289736 6447 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0e7f65e456f440497cf22b28f3629bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.291160 5082 tablet_service.cc:1511] Processing CreateTablet for tablet afb1862777b94fed97c0b92fa2c5545d (DEFAULT_TABLE table=default.Table_f76750964cba404fb197cc254b4ed32a [id=297e14783b0840c5864234841184e17e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.291539 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb1862777b94fed97c0b92fa2c5545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.292690 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e16ca60020406fb46436fa68ea4b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.296842 5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262cb3e5f847409993e1ca20c296bff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.299858 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee829874a0d4f54a516c947685de021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.302378 6882 raft_consensus.cc:493] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.302570 6882 raft_consensus.cc:515] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.303216 6882 leader_election.cc:290] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:04.303763 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4d5bf420004d1aae51563ec3263b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.304014 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3cd09c466b8476891cc8b26d13e8701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.305810 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 3513663de6724b108adcb46cc151163c (table default.Table_dcdd264dd7c84641aac8566bae2bf8b6 [id=6b9a7948d0b34aa89f9f7c58a2cd2a0e]). Expected version 2 got 0
I20260927 13:50:04.306141 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 0d54e51b5c104c75b938aba55cecf890 (table default.Table_a02033f4b12c4cdd986cd855cb148309 [id=0c14f160c8ab4321b14a35fc5f8d3b56]). Expected version 1 got 0
I20260927 13:50:04.306890 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_908235dbf46e4c6f9a13506c919c6492 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 2 got 0
I20260927 13:50:04.307246 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet f46f45a0a13b4e05802a08880d7f6a01 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]). Expected version 1 got 0
I20260927 13:50:04.307322 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08798185a7c641f98d7dc6a6b1b72e0a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:04.307744 6444 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 60de1c28618f4e478aae68ad07fbcf98
I20260927 13:50:04.308313 6444 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34390 (request call id 18) took 1587 ms. Trace:
I20260927 13:50:04.308409 6444 rpcz_store.cc:276] 0927 13:50:02.720819 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:03.334350 (+613531us) service_pool.cc:224] Handling call
0927 13:50:03.334818 (+ 468us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:03.335011 (+ 193us) catalog_manager.cc:2854] Modifying in-memory table state
0927 13:50:03.335083 (+ 72us) catalog_manager.cc:2863] Locking tablets
0927 13:50:03.793823 (+458740us) catalog_manager.cc:2877] Removing table and tablets from system table
0927 13:50:03.846191 (+ 52368us) catalog_manager.cc:2895] Removing table from by-name map
0927 13:50:03.846275 (+ 84us) catalog_manager.cc:2911] Committing in-memory state
0927 13:50:04.307679 (+461404us) catalog_manager.cc:2915] Aborting table tasks
0927 13:50:04.308254 (+ 575us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:03.822899 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:03.822992 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:03.822997 (+ 5us) write_op.cc:435] Acquired schema lock
0927 13:50:03.822999 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:03.823093 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:03.823104 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:03.823108 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:03.823199 (+ 91us) tablet.cc:701] Row locks acquired
0927 13:50:03.823201 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:50:03.823247 (+ 46us) write_op.cc:270] Start()
0927 13:50:03.823276 (+ 29us) write_op.cc:276] Timestamp: P: 1790517003823198 usec, L: 0
0927 13:50:03.823281 (+ 5us) op_driver.cc:348] REPLICATION: starting
0927 13:50:03.823498 (+ 217us) log.cc:844] Serialized 793 byte log entry
0927 13:50:03.842595 (+ 19097us) op_driver.cc:464] REPLICATION: finished
0927 13:50:03.843095 (+ 500us) write_op.cc:301] APPLY: starting
0927 13:50:03.843110 (+ 15us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:03.843146 (+ 36us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:03.843177 (+ 31us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:03.843256 (+ 79us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:03.843284 (+ 28us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:50:03.843291 (+ 7us) write_op.cc:312] APPLY: finished
0927 13:50:03.843357 (+ 66us) log.cc:844] Serialized 29 byte log entry
0927 13:50:03.843416 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:03.843433 (+ 17us) write_op.cc:454] Released schema lock
0927 13:50:03.843439 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:03.843512 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:03.843515 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":448,"apply.run_cpu_time_us":408,"apply.run_wall_time_us":408,"num_ops":2,"prepare.queue_time_us":28394,"prepare.run_cpu_time_us":697,"prepare.run_wall_time_us":7313,"replication_time_us":19279}]]}
I20260927 13:50:04.309340 6444 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_2340dd3345454c9cbdf067c0a3638a19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:04.309944 6444 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2340dd3345454c9cbdf067c0a3638a19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.309906 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26a3a50396940cf826442e4ba7356a8" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:04.309947 5217 tablet_service.cc:1511] Processing CreateTablet for tablet bef7b844a07b420faa115fdd22b0539e (DEFAULT_TABLE table=default.Table_fd6ee019e754408fab65109daeb90c0e [id=1ac22cd7afdf47b691add3ee5d043cb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.310402 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef7b844a07b420faa115fdd22b0539e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:04.310905 6441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.66:54649 (request call id 110) took 1368 ms (client timeout 1000 ms). Trace:
I20260927 13:50:04.310866 5220 tablet_service.cc:1511] Processing CreateTablet for tablet e016878296da44b9a7691a7fc7206cb9 (DEFAULT_TABLE table=default.Table_2f47a147309843cda12839d088afebef [id=2c1da9087ada46f083eaa9f1a170761f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.311214 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e016878296da44b9a7691a7fc7206cb9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:04.311008 6441 rpcz_store.cc:269] 0927 13:50:02.942471 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:03.141656 (+199185us) service_pool.cc:224] Handling call
0927 13:50:03.179991 (+ 38335us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00007fe748a7c65d 00007fe748a7c753 00007fe7455f9db1 00007fe74d3eda7d 00007fe74d5776e8 00007fe743f461f6 00007fe743f45f25 00007fe74064c63e 00007fe74064b51e 00007fe740651758 00007fe7406520bf
0927 13:50:04.310867 (+1130876us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:03.260074 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:03.260163 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:03.260167 (+ 4us) write_op.cc:435] Acquired schema lock
0927 13:50:03.260169 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:03.260237 (+ 68us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:03.329872 (+ 69635us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:03.329883 (+ 11us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:50:03.329987 (+ 104us) tablet.cc:701] Row locks acquired
0927 13:50:03.329990 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:03.330034 (+ 44us) write_op.cc:270] Start()
0927 13:50:03.330079 (+ 45us) write_op.cc:276] Timestamp: P: 1790517003329994 usec, L: 0
0927 13:50:03.330084 (+ 5us) op_driver.cc:348] REPLICATION: starting
0927 13:50:03.330311 (+ 227us) log.cc:844] Serialized 530 byte log entry
0927 13:50:03.353392 (+ 23081us) op_driver.cc:464] REPLICATION: finished
0927 13:50:03.357893 (+ 4501us) write_op.cc:301] APPLY: starting
0927 13:50:03.357913 (+ 20us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:03.357955 (+ 42us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:03.357989 (+ 34us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:03.358044 (+ 55us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:03.358075 (+ 31us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:03.358082 (+ 7us) write_op.cc:312] APPLY: finished
0927 13:50:03.361284 (+ 3202us) log.cc:844] Serialized 23 byte log entry
0927 13:50:03.361508 (+ 224us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:03.361523 (+ 15us) write_op.cc:454] Released schema lock
0927 13:50:03.361530 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:03.362138 (+ 608us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:03.362142 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":84960512,"child_traces":[["op",{"apply.queue_time_us":4445,"apply.run_cpu_time_us":479,"apply.run_wall_time_us":4209,"num_ops":1,"prepare.queue_time_us":32246,"prepare.run_cpu_time_us":767,"prepare.run_wall_time_us":71775,"raft.queue_time_us":148,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":321,"replication_time_us":23274}]]}
I20260927 13:50:04.311681 6441 master_service.cc:960] ReplaceTablet: received request to replace tablet 8c14a6b95c1e460a8e7a299340f09498 from {username='slave'} at 127.0.0.1:34390
W20260927 13:50:04.312494 5044 leader_election.cc:343] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:04.313079 6453 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 36181512a94c4702ae0a417665919faa
I20260927 13:50:04.313561 6453 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34390 (request call id 26) took 1591 ms. Trace:
I20260927 13:50:04.313642 6453 rpcz_store.cc:276] 0927 13:50:02.722387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:03.418064 (+695677us) service_pool.cc:224] Handling call
0927 13:50:03.419339 (+ 1275us) spinlock_profiling.cc:243] Waited 981 us on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00007fe748a7c65d 00007fe748a7c753 00007fe7455f9db1 00007fe74d3eda7d 00007fe74d57de96 00007fe743f4a9d6 00007fe743f4a705 00007fe74064c63e 00007fe74064b51e 00007fe740651758 00007fe7406520bf
0927 13:50:03.419766 (+ 427us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:03.419893 (+ 127us) catalog_manager.cc:2854] Modifying in-memory table state
0927 13:50:03.419963 (+ 70us) catalog_manager.cc:2863] Locking tablets
0927 13:50:03.790158 (+370195us) catalog_manager.cc:2877] Removing table and tablets from system table
0927 13:50:03.803625 (+ 13467us) catalog_manager.cc:2895] Removing table from by-name map
0927 13:50:03.803700 (+ 75us) catalog_manager.cc:2911] Committing in-memory state
0927 13:50:04.313038 (+509338us) catalog_manager.cc:2915] Aborting table tasks
0927 13:50:04.313508 (+ 470us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:03.797715 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:03.797837 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:03.797842 (+ 5us) write_op.cc:435] Acquired schema lock
0927 13:50:03.797844 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:03.798203 (+ 359us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:03.798217 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:03.798225 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:03.798346 (+ 121us) tablet.cc:701] Row locks acquired
0927 13:50:03.798349 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:03.798384 (+ 35us) write_op.cc:270] Start()
0927 13:50:03.798419 (+ 35us) write_op.cc:276] Timestamp: P: 1790517003798352 usec, L: 0
0927 13:50:03.798424 (+ 5us) op_driver.cc:348] REPLICATION: starting
0927 13:50:03.798658 (+ 234us) log.cc:844] Serialized 793 byte log entry
0927 13:50:03.802958 (+ 4300us) op_driver.cc:464] REPLICATION: finished
0927 13:50:03.803141 (+ 183us) write_op.cc:301] APPLY: starting
0927 13:50:03.803157 (+ 16us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:03.803225 (+ 68us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:03.803265 (+ 40us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:03.803334 (+ 69us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:03.803372 (+ 38us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:50:03.803383 (+ 11us) write_op.cc:312] APPLY: finished
0927 13:50:03.803465 (+ 82us) log.cc:844] Serialized 29 byte log entry
0927 13:50:03.803517 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:03.803534 (+ 17us) write_op.cc:454] Released schema lock
0927 13:50:03.803539 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:03.807799 (+ 4260us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:03.807805 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":2255744,"child_traces":[["op",{"apply.queue_time_us":138,"apply.run_cpu_time_us":448,"apply.run_wall_time_us":448,"num_ops":2,"prepare.queue_time_us":6870,"prepare.run_cpu_time_us":882,"prepare.run_wall_time_us":10083,"raft.queue_time_us":64,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":340,"replication_time_us":4506}]]}
I20260927 13:50:04.314534 6453 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_c6e31b4579c5408d9c10f11b74af4a7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:04.314711 5223 tablet_service.cc:1511] Processing CreateTablet for tablet afb1862777b94fed97c0b92fa2c5545d (DEFAULT_TABLE table=default.Table_f76750964cba404fb197cc254b4ed32a [id=297e14783b0840c5864234841184e17e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.315053 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb1862777b94fed97c0b92fa2c5545d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:04.315063 6453 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6e31b4579c5408d9c10f11b74af4a7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:50:04.316161 6449 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.65:57911 (request call id 134) took 1415 ms (client timeout 1000 ms). Trace:
W20260927 13:50:04.316250 6449 rpcz_store.cc:269] 0927 13:50:02.900620 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:03.128072 (+227452us) service_pool.cc:224] Handling call
0927 13:50:03.182339 (+ 54267us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00007fe748a7c65d 00007fe748a7c753 00007fe7455f9db1 00007fe74d3eda7d 00007fe74d5776e8 00007fe743f461f6 00007fe743f45f25 00007fe74064c63e 00007fe74064b51e 00007fe740651758 00007fe7406520bf
0927 13:50:04.316107 (+1133768us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:03.519328 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:03.519481 (+ 153us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:03.519489 (+ 8us) write_op.cc:435] Acquired schema lock
0927 13:50:03.519494 (+ 5us) tablet.cc:662] Decoding operations
0927 13:50:03.519609 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:03.519622 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:03.519627 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:50:03.519694 (+ 67us) tablet.cc:701] Row locks acquired
0927 13:50:03.519696 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:50:03.519731 (+ 35us) write_op.cc:270] Start()
0927 13:50:03.519765 (+ 34us) write_op.cc:276] Timestamp: P: 1790517003519677 usec, L: 0
0927 13:50:03.519769 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:03.519958 (+ 189us) log.cc:844] Serialized 530 byte log entry
0927 13:50:03.531069 (+ 11111us) op_driver.cc:464] REPLICATION: finished
0927 13:50:03.531520 (+ 451us) write_op.cc:301] APPLY: starting
0927 13:50:03.531531 (+ 11us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:03.531561 (+ 30us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:03.531594 (+ 33us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:03.531645 (+ 51us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:03.531687 (+ 42us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:03.531714 (+ 27us) write_op.cc:312] APPLY: finished
0927 13:50:03.531803 (+ 89us) log.cc:844] Serialized 23 byte log entry
0927 13:50:03.531876 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:03.531893 (+ 17us) write_op.cc:454] Released schema lock
0927 13:50:03.531902 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:03.538213 (+ 6311us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:03.538220 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":122601856,"child_traces":[["op",{"apply.queue_time_us":399,"apply.run_cpu_time_us":475,"apply.run_wall_time_us":6669,"num_ops":1,"prepare.queue_time_us":135664,"prepare.run_cpu_time_us":814,"prepare.run_wall_time_us":3854,"raft.queue_time_us":171,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":307,"replication_time_us":11266}]]}
I20260927 13:50:04.316769 5217 tablet_service.cc:1511] Processing CreateTablet for tablet db800a7002b04b79baf9f4ec61af764b (DEFAULT_TABLE table=default.Table_479338a884a047389e0343ea71022b50 [id=f5e5dded0c5042adb7dce1d541d92e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.317015 6449 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_3aa559bda6e74f04b2700167fb54731f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:04.317147 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1055c50e7ffd4d12a7c4ed424aa13eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.317359 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4099c41981f46758a8f478d7fdb4182. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:04.317456 6449 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3aa559bda6e74f04b2700167fb54731f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.317519 5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262cb3e5f847409993e1ca20c296bff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.317821 5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e016878296da44b9a7691a7fc7206cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.317971 5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9775c853381749ad89906b32d3adee23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.318212 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3cd09c466b8476891cc8b26d13e8701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.318507 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e16ca60020406fb46436fa68ea4b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.318674 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f62f4ba23f4b82b9bcde89126ce1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.319020 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf7aac9972ba403d883e0c5e2f5c2666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.319317 5228 tablet_service.cc:1511] Processing CreateTablet for tablet b02466d95c2a4ae880d61252b167f0c8 (DEFAULT_TABLE table=default.Table_39166aa385de4916b3c9aaf6d9133e1c [id=70fa5cc937ef4ee4b6a8920a1e29c4e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.319432 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383cdd68cd5544b399d57e32298bf9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.319813 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9971bbea3ec2425db728f7832a93fe06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.319963 5213 tablet_service.cc:1511] Processing CreateTablet for tablet 85debab98b0f42a5b50f1b0d132147d3 (DEFAULT_TABLE table=default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.320235 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef7b844a07b420faa115fdd22b0539e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.320614 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08e47480cf2482f83f2e32e3b706dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.320576 5210 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7bb872f4c347e2a0b4ee4dc1c787ef (DEFAULT_TABLE table=default.Table_a7a5af7cfafc47a49d35f8a72e1d1ab5 [id=84210551dbfd4670b948ea3357d599e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.320744 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 277615c97d9945269ba94d9d7c1c0464 (DEFAULT_TABLE table=default.Table_5de6d07207814569a0b1f42ac2e12c24 [id=87e80bd0bbe04f43b582390b45a522f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.321043 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71299230399649d29444f30f94ad0f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.321208 5215 tablet_service.cc:1511] Processing CreateTablet for tablet ac28d0072aa1455681d6fa0bfde68f7b (DEFAULT_TABLE table=default.Table_c759fc3bc488489a94e8a6193c491682 [id=bfc3d095064143c9b2adfd23049e64f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.321851 5226 tablet_service.cc:1511] Processing CreateTablet for tablet e3765fe06c664e60a11acf76c825bc42 (DEFAULT_TABLE table=default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.322238 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd312b6587cc48a096fe68d63e69abc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.322716 5082 tablet_service.cc:1511] Processing CreateTablet for tablet b02466d95c2a4ae880d61252b167f0c8 (DEFAULT_TABLE table=default.Table_39166aa385de4916b3c9aaf6d9133e1c [id=70fa5cc937ef4ee4b6a8920a1e29c4e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.322841 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 3b26289ed050454d817c13159295ec37 (DEFAULT_TABLE table=default.Table_5b64a307e44a471598ef010e33a82fe3 [id=9c86bcdd37654832b7a92763aa42e6c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.323279 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b02466d95c2a4ae880d61252b167f0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.329921 5211 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1ff7efba2042588a05a461d6179813 (DEFAULT_TABLE table=default.Table_c4f4659ddd2a47c48ae7d545ac78f2cc [id=c2a8b1992a3a4410b6e0a53d5beb27bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.332237 7016 raft_consensus.cc:493] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.332365 7016 raft_consensus.cc:515] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.332984 7016 leader_election.cc:290] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.333730 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 2a92a10032dd40008cdcffd0699e1874 (DEFAULT_TABLE table=default.Table_022283b66bf4471691348ed0a603a4c3 [id=fca092c89d4e44cfbce954b0d0fd8400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.333798 5085 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7bb872f4c347e2a0b4ee4dc1c787ef (DEFAULT_TABLE table=default.Table_a7a5af7cfafc47a49d35f8a72e1d1ab5 [id=84210551dbfd4670b948ea3357d599e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.334168 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a92a10032dd40008cdcffd0699e1874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.334192 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7bb872f4c347e2a0b4ee4dc1c787ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.337323 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 277615c97d9945269ba94d9d7c1c0464 (DEFAULT_TABLE table=default.Table_5de6d07207814569a0b1f42ac2e12c24 [id=87e80bd0bbe04f43b582390b45a522f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.337736 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277615c97d9945269ba94d9d7c1c0464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.338213 5216 tablet_service.cc:1511] Processing CreateTablet for tablet 7469927f3893494aa36b8f5b4d2d4146 (DEFAULT_TABLE table=default.Table_438c450d2fff477aaf6e67a530a1532a [id=aa804ddccaec408bbfca331d8b49125a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.338593 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e917382b6f3d4e009fa159ed38c342d8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:04.338701 5185 leader_election.cc:304] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:04.339001 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 78e409e186a24070b3fb3087fd805aa6 (DEFAULT_TABLE table=default.Table_800bad10399f4515acb401f9be49e957 [id=b0d2a5de33884946b95e67dffb65b617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.339146 6896 raft_consensus.cc:2749] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:04.339828 5044 leader_election.cc:343] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:04.340234 5628 tablet_bootstrap.cc:492] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:04.340358 5628 ts_tablet_manager.cc:1403] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.143s user 0.001s sys 0.005s
I20260927 13:50:04.341100 5628 raft_consensus.cc:359] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.341251 5628 raft_consensus.cc:385] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:04.341317 5628 raft_consensus.cc:740] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:04.341544 5628 consensus_queue.cc:260] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.326248 5084 tablet_service.cc:1511] Processing CreateTablet for tablet 85debab98b0f42a5b50f1b0d132147d3 (DEFAULT_TABLE table=default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.353826 5075 tablet_service.cc:1511] Processing CreateTablet for tablet 820a5574f2304cb7b34ebdbf1f0937f2 (DEFAULT_TABLE table=default.Table_22c755d674734bbdaf00ff031dd35bde [id=e3b2f033f16b4d1185c45d1dc7e99515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.354669 5218 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7a90d0fc534ef792788886207b29d2 (DEFAULT_TABLE table=default.Table_32fe69927df64b76b1aefe941e9f4241 [id=baed5667f9254dd99700c6d185b44535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.358964 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 1087ad60dade46bb9d38f52a94dd536b (table default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]) successfully deleted
W20260927 13:50:04.361483 6455 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b1a98e712fb3492f9e4ebccfd489c16f consensus state has no leader
W20260927 13:50:04.363412 6455 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 880ce1300eac40b28aac8cba3e11077e consensus state has no leader
W20260927 13:50:04.364004 6455 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549], current schema version=6): Not found: failed to reset TS proxy: No leader found: Tablet 23e3bb24afad4d789041b6a557512618 consensus state has no leader
W20260927 13:50:04.366873 6455 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 4709e969569b43a7aace8d7cfe4e64c5 consensus state has no leader
W20260927 13:50:04.372288 6455 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet e917382b6f3d4e009fa159ed38c342d8 consensus state has no leader
I20260927 13:50:04.376499 5073 tablet_service.cc:1511] Processing CreateTablet for tablet ac28d0072aa1455681d6fa0bfde68f7b (DEFAULT_TABLE table=default.Table_c759fc3bc488489a94e8a6193c491682 [id=bfc3d095064143c9b2adfd23049e64f7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:50:04.375732 6455 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 44d29459405b4cdd921fb43bf5a2ae81 consensus state has no leader
I20260927 13:50:04.377699 5351 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b13c629908a47368846770c697aebd8 with delete_type TABLET_DATA_DELETED (replaced by tablet dec7c4c6b46d4b5791d9b7af1a8e55cc) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:04.378089 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 34cd6225aaf34bdbbec06df453d57301 (DEFAULT_TABLE table=default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.378089 5353 tablet_service.cc:1511] Processing CreateTablet for tablet fd861e06085e4c7b8bdf1101432bdc31 (DEFAULT_TABLE table=default.Table_3b716a51ffbe4613a958b62eef4cdcb6 [id=f4ff4dd6b47a4ce9a42f7b13a6a1ce34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.378572 7111 tablet_replica.cc:333] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:04.378829 7111 raft_consensus.cc:2243] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:04.379015 7111 raft_consensus.cc:2272] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:04.379120 5365 tablet_service.cc:1511] Processing CreateTablet for tablet c0779fde1c55428fbf09ff46cf448387 (DEFAULT_TABLE table=default.Table_7db7dcae15a64ff4b308591077608880 [id=ea5c56db81904caab25d8b1a0c6d0fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.379700 5351 tablet_service.cc:1511] Processing CreateTablet for tablet d2d8f69b4e964dc98db3809eecdf8ad7 (DEFAULT_TABLE table=default.Table_240f3492390b48428f555f3f2dbce154 [id=ef4c47103ab94117b1130306118f923f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.380024 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet b9a1193719e140beb9b492927adeb78c with delete_type TABLET_DATA_DELETED (replaced by tablet a583d84f0f9247c68f330149b41e65ae) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:04.380228 5364 tablet_service.cc:1511] Processing CreateTablet for tablet fb1532f75f1c481696240b0016a646a9 (DEFAULT_TABLE table=default.Table_4121f961061a429290fbb458b1059ba0 [id=609e0e0e929e47adacb63fee55390a6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.380360 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 58d9274ad0934f19a7c36325eee3dd59 (DEFAULT_TABLE table=default.Table_544497088a2047e8a6b190c4e23e3e1c [id=d7b1a5499c5f4f9784a8952f1e66c3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.378572 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd861e06085e4c7b8bdf1101432bdc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.380833 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1532f75f1c481696240b0016a646a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.381126 5362 tablet_service.cc:1511] Processing CreateTablet for tablet befeab68084b4e6d8e33c5434652c3db (DEFAULT_TABLE table=default.Table_19de48446f02465ca170ad7a349da94d [id=b5a4301a2e1f45d2b20099589ede2b26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.381441 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet befeab68084b4e6d8e33c5434652c3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.382234 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d9274ad0934f19a7c36325eee3dd59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.386274 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cd6225aaf34bdbbec06df453d57301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.386461 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0779fde1c55428fbf09ff46cf448387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.387064 7111 ts_tablet_manager.cc:1916] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:04.390296 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d8f69b4e964dc98db3809eecdf8ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.393321 5087 tablet_service.cc:1511] Processing CreateTablet for tablet e3765fe06c664e60a11acf76c825bc42 (DEFAULT_TABLE table=default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:50:04.401592 6427 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e917382b6f3d4e009fa159ed38c342d8 consensus state has no leader
I20260927 13:50:04.294080 5080 tablet_service.cc:1511] Processing CreateTablet for tablet db800a7002b04b79baf9f4ec61af764b (DEFAULT_TABLE table=default.Table_479338a884a047389e0343ea71022b50 [id=f5e5dded0c5042adb7dce1d541d92e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.413470 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 8f102cad945b42b5ba128637d213acca (DEFAULT_TABLE table=default.Table_daa2858f5f994d1ba5432fa5506b2a44 [id=414bf9afb1d54d779d0324aff799dca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.413949 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f102cad945b42b5ba128637d213acca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.418998 5076 tablet_service.cc:1511] Processing CreateTablet for tablet 3b26289ed050454d817c13159295ec37 (DEFAULT_TABLE table=default.Table_5b64a307e44a471598ef010e33a82fe3 [id=9c86bcdd37654832b7a92763aa42e6c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.419592 7098 tablet_replica.cc:333] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:04.419816 7098 raft_consensus.cc:2243] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:04.419901 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1ff7efba2042588a05a461d6179813 (DEFAULT_TABLE table=default.Table_c4f4659ddd2a47c48ae7d545ac78f2cc [id=c2a8b1992a3a4410b6e0a53d5beb27bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.419981 7098 raft_consensus.cc:2272] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:04.420611 7098 ts_tablet_manager.cc:1916] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:04.422503 5072 tablet_service.cc:1511] Processing CreateTablet for tablet 78e409e186a24070b3fb3087fd805aa6 (DEFAULT_TABLE table=default.Table_800bad10399f4515acb401f9be49e957 [id=b0d2a5de33884946b95e67dffb65b617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.422503 5078 tablet_service.cc:1511] Processing CreateTablet for tablet 7469927f3893494aa36b8f5b4d2d4146 (DEFAULT_TABLE table=default.Table_438c450d2fff477aaf6e67a530a1532a [id=aa804ddccaec408bbfca331d8b49125a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.414095 7111 ts_tablet_manager.cc:1929] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:04.423632 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7a90d0fc534ef792788886207b29d2 (DEFAULT_TABLE table=default.Table_32fe69927df64b76b1aefe941e9f4241 [id=baed5667f9254dd99700c6d185b44535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.423553 7111 log.cc:1199] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/4b13c629908a47368846770c697aebd8
I20260927 13:50:04.424360 5347 tablet_service.cc:1511] Processing CreateTablet for tablet d212ee5cd8f7416a840d307b16ba5e28 (DEFAULT_TABLE table=default.Table_52cd6f5926494db78b6f05c29b36d509 [id=3f11aa4dd2e5436b942c02b53621b04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.424508 5082 tablet_service.cc:1511] Processing CreateTablet for tablet e1e574bc8b544039b440a845966eb1d4 (DEFAULT_TABLE table=default.Table_2159a2c74b9c4769be385712b34f41c3 [id=c386219cd45c4447b229c721951babeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.424746 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d212ee5cd8f7416a840d307b16ba5e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.425673 7111 ts_tablet_manager.cc:1950] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:04.427150 5085 tablet_service.cc:1558] Processing DeleteTablet for tablet 38a34074d833424bae6035d9e437ad3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.427465 5085 tablet_service.cc:1511] Processing CreateTablet for tablet d0a76346f33b4041b100bf2d736ae21c (DEFAULT_TABLE table=default.Table_5f348882b88d4bdc8b238f4794b07610 [id=c68169e25a9f43b08141799bc435b14c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.420513 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 319a788b7d9542f6a2ae11e21bc8af55 (DEFAULT_TABLE table=default.Table_74c7885b9da54e549b3e0207088d8fc2 [id=3f099f07c6384429bb435c7c9f363866]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.428306 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 319a788b7d9542f6a2ae11e21bc8af55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.420645 5364 tablet_service.cc:1511] Processing CreateTablet for tablet cda5bf0471894a8da41c3a6520a1abc3 (DEFAULT_TABLE table=default.Table_3fb24892ee2347868762b8a77ed1f594 [id=40da0ef42c8a4519b9e6987b826e513b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.420876 5353 tablet_service.cc:1511] Processing CreateTablet for tablet a9b8029e9be945ca95db7cdb3b010b8e (DEFAULT_TABLE table=default.Table_6b5cdd8077ed408991f25cc07e1cb24f [id=9a14d2729126450ca4dd7f68467662c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.429297 5070 tablet_service.cc:1511] Processing CreateTablet for tablet 7b229676c51e42d8bdd473f5d5fb1464 (DEFAULT_TABLE table=default.Table_645d9205892845cdb661a97f3576207e [id=c5b8489d57cf4ceabd115dfec550c9ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.421247 5363 tablet_service.cc:1511] Processing CreateTablet for tablet fd312b6587cc48a096fe68d63e69abc4 (DEFAULT_TABLE table=default.Table_58f9b708528b4ba980888bbb033af8be [id=46389dd8c7dc4a719ab17a29c2259d74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.421561 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 362f660cac76436aba54bb707d8a991c (DEFAULT_TABLE table=default.Table_d6b9b32a54ed4746b880a4ae62ad9ba3 [id=2d2f55956ec141f0b2de4501fbc6c655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.421820 5348 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee829874a0d4f54a516c947685de021 (DEFAULT_TABLE table=default.Table_3787d49451114bc298d54d844cc68eaa [id=394868e5f3dc477d8825134327ccb4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.421876 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1443441b444075ab502ccdfa355a80 (DEFAULT_TABLE table=default.Table_552cc54d365f49b1848f9806cae88e18 [id=4906565a0f5949f797472db5e4daa544]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.421006 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4d5bf420004d1aae51563ec3263b9a (DEFAULT_TABLE table=default.Table_83f977d77c3640b9b7c7c9ccfb96e327 [id=64d546b25be34918a7c80835c0ed7ac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.434963 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4d5bf420004d1aae51563ec3263b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.435833 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda5bf0471894a8da41c3a6520a1abc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.438488 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee829874a0d4f54a516c947685de021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.433696 5083 tablet_service.cc:1511] Processing CreateTablet for tablet 50c2661998134488a95b4750d0e653a6 (DEFAULT_TABLE table=default.Table_8ccdfb70bd5f4ae9912dd1e5669a09e3 [id=c39aa424f92d4fc8bf69b9829737f61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.434103 5074 tablet_service.cc:1511] Processing CreateTablet for tablet 740245532e274e2bab26dd84a68efa91 (DEFAULT_TABLE table=default.Table_6e893d08117849cea8b823b4d752b91b [id=c622333396e0438788c417822274dc41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.443571 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b8029e9be945ca95db7cdb3b010b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.446583 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd312b6587cc48a096fe68d63e69abc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.444763 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 95726f690a71433ca63f95da4ee750e5 with delete_type TABLET_DATA_DELETED (replaced by tablet cddf1b48a78e4ff789e0bb0bf75e307b) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.443550 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 6de346dcbaa7433db7ee0f23b6e7df45 (DEFAULT_TABLE table=default.Table_7a4d7f5d2d204a5c8a42b30ae9b4623d [id=c920b19c5b2041dd915de732f5b0c640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.454814 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362f660cac76436aba54bb707d8a991c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.457181 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 820a5574f2304cb7b34ebdbf1f0937f2 (DEFAULT_TABLE table=default.Table_22c755d674734bbdaf00ff031dd35bde [id=e3b2f033f16b4d1185c45d1dc7e99515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.457326 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:04.457609 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820a5574f2304cb7b34ebdbf1f0937f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.458078 5348 tablet_service.cc:1511] Processing CreateTablet for tablet 60e3bee895c7405ba37d54ffc7a436b6 (DEFAULT_TABLE table=default.Table_9f53709861824b0591e1b8ce63a64393 [id=bd0f9079417b4b609bd68a7abb12e8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.458487 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1443441b444075ab502ccdfa355a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.459089 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e3bee895c7405ba37d54ffc7a436b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.464728 5347 tablet_service.cc:1511] Processing CreateTablet for tablet c27872794fb24934b723c56935d94702 (DEFAULT_TABLE table=default.Table_a5b94f165eff40f3826437ed44404e55 [id=caf6214f83fd4d19b26a6f39ef349629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.465138 7016 raft_consensus.cc:493] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.465283 7016 raft_consensus.cc:515] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.465895 5347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27872794fb24934b723c56935d94702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.465952 7016 leader_election.cc:290] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.468580 7016 raft_consensus.cc:493] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.468725 7016 raft_consensus.cc:515] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.469352 7016 leader_election.cc:290] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.423671 5349 tablet_service.cc:1511] Processing CreateTablet for tablet dba5c22f515c4ad095d15a09a8f5e2dc (DEFAULT_TABLE table=default.Table_fef73c8f52d144b6ae2358a575f61151 [id=47cfa38d5dc84502b26ddc79a872d1a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.472069 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba5c22f515c4ad095d15a09a8f5e2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.462482 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 992bf643dee64bccaa993a08027aa5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.487185 5356 tablet_service.cc:1511] Processing CreateTablet for tablet bef7b844a07b420faa115fdd22b0539e (DEFAULT_TABLE table=default.Table_fd6ee019e754408fab65109daeb90c0e [id=1ac22cd7afdf47b691add3ee5d043cb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.487329 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 71299230399649d29444f30f94ad0f1b (DEFAULT_TABLE table=default.Table_f11cc18b15654825aa1a7da20c318f26 [id=0d0c63fb4b8d4675a1678a59012efe80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.488183 5157 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:04.488186 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 71bd7f25c086418297db7f576f45f92d (DEFAULT_TABLE table=default.Table_835ec246322b4927a1c94badce00f804 [id=47b130fed16142099cfe308ab98849f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.489871 5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820a5574f2304cb7b34ebdbf1f0937f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.490060 5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac28d0072aa1455681d6fa0bfde68f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.494226 5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b26289ed050454d817c13159295ec37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.494789 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7469927f3893494aa36b8f5b4d2d4146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.498230 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7a90d0fc534ef792788886207b29d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.498445 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de346dcbaa7433db7ee0f23b6e7df45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.498661 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a76346f33b4041b100bf2d736ae21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.499111 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b229676c51e42d8bdd473f5d5fb1464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.506240 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e574bc8b544039b440a845966eb1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.506528 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1ff7efba2042588a05a461d6179813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.506742 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85debab98b0f42a5b50f1b0d132147d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.506951 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3765fe06c664e60a11acf76c825bc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.508584 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db800a7002b04b79baf9f4ec61af764b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.509053 5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e409e186a24070b3fb3087fd805aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.513774 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71299230399649d29444f30f94ad0f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.518517 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef7b844a07b420faa115fdd22b0539e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.524482 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740245532e274e2bab26dd84a68efa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.524875 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 60de1c28618f4e478aae68ad07fbcf98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.525068 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 36181512a94c4702ae0a417665919faa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.525213 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aed7fe630f64213846ad37d904f6516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.525374 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet bb7b3a35b2e94bbea6be4b4a8f158593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.525518 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet b3fbf1e7f5e04122a65f6e192ffdae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.525699 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet ec130d31f6274fd9b730c2bb8bba817e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.525864 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.526211 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 496cffc2a8774185a0e0f63208bed8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.526693 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 08798185a7c641f98d7dc6a6b1b72e0a with delete_type TABLET_DATA_DELETED (replaced by tablet ecb5cdc007074e0c8f44d963e527a955) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.526855 5364 tablet_service.cc:1511] Processing CreateTablet for tablet f94b8a726790439ab382830be5fc92ed (DEFAULT_TABLE table=default.Table_3ff54037c03446db8068c7bfd74ac465 [id=6a7df7bc6295417689c6b194556456ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.527295 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94b8a726790439ab382830be5fc92ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.527195 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e3b98290dc74d88856e13f003a1e4c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.527707 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.528290 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 98e2e305b92a4492a0df14a506c768f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.528921 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet 8aeb0c2c2be04a598e011a9d99c5492a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.529608 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet e26a3a50396940cf826442e4ba7356a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.530582 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet 0191cfad4e7a4b088b2ecdc246bfa58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.530414 5071 tablet_service.cc:1558] Processing DeleteTablet for tablet f49384587bfa41d6aabfa8ee175d6abe with delete_type TABLET_DATA_DELETED (replaced by tablet dd0126a6df14457ca5c62c129f3275f8) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.531028 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 55f62f4ba23f4b82b9bcde89126ce1e6 (DEFAULT_TABLE table=default.Table_8cda445237a34eac8407eedddae90d1e [id=8f547ebbb90047fabb7ff5a35a56c857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.531370 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 1055c50e7ffd4d12a7c4ed424aa13eea (DEFAULT_TABLE table=default.Table_28a47364bcdf40bf851bc99d3513ca99 [id=2760dc486ae9433682cee682308534f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.531494 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f62f4ba23f4b82b9bcde89126ce1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.531531 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 9971bbea3ec2425db728f7832a93fe06 (DEFAULT_TABLE table=default.Table_9749d8dab54a412fb6dd1234772d3155 [id=31e674233f944706b5ad3362d0c2db06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.531567 5361 tablet_service.cc:1511] Processing CreateTablet for tablet a4099c41981f46758a8f478d7fdb4182 (DEFAULT_TABLE table=default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.531749 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1055c50e7ffd4d12a7c4ed424aa13eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.531941 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9971bbea3ec2425db728f7832a93fe06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.531991 5357 tablet_service.cc:1511] Processing CreateTablet for tablet e08e47480cf2482f83f2e32e3b706dc1 (DEFAULT_TABLE table=default.Table_4f52702b62174d5a906804a02e82bea5 [id=090619527c7644578f4f12e2efcdfade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.532274 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08e47480cf2482f83f2e32e3b706dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.534348 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 383cdd68cd5544b399d57e32298bf9db (DEFAULT_TABLE table=default.Table_36a0d6612db348268c1305cf46302992 [id=61efed7929c1470a8463a5a99b493c6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.534624 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383cdd68cd5544b399d57e32298bf9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.538352 5358 tablet_service.cc:1511] Processing CreateTablet for tablet bf7aac9972ba403d883e0c5e2f5c2666 (DEFAULT_TABLE table=default.Table_6d74eaa4eb034485b7844e149cb6b14b [id=d7573db0f99048ac84381b6b2e2d2c08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.538723 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf7aac9972ba403d883e0c5e2f5c2666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.541391 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bd7f25c086418297db7f576f45f92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.543144 7098 ts_tablet_manager.cc:1929] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:04.543458 7098 log.cc:1199] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/4b13c629908a47368846770c697aebd8
I20260927 13:50:04.546432 5628 ts_tablet_manager.cc:1434] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.206s user 0.002s sys 0.000s
I20260927 13:50:04.546813 5628 tablet_bootstrap.cc:492] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:04.461550 5088 tablet_service.cc:1511] Processing CreateTablet for tablet ead437e93bb14a73a820631b0be041aa (DEFAULT_TABLE table=default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.530448 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c2661998134488a95b4750d0e653a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.556452 6441 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 8c14a6b95c1e460a8e7a299340f09498
I20260927 13:50:04.557103 6449 master_service.cc:960] ReplaceTablet: received request to replace tablet 24bd9a95e2d24242aba890ee9d01c023 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:04.557158 6441 catalog_manager.cc:6934] ReplaceTablet: tablet 8c14a6b95c1e460a8e7a299340f09498 deleted and replaced by tablet 8acd411b965c49919dc77c8c94853548
I20260927 13:50:04.557454 6441 master_service.cc:960] ReplaceTablet: received request to replace tablet f46f45a0a13b4e05802a08880d7f6a01 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:04.559345 5619 tablet_bootstrap.cc:492] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:04.559770 5619 ts_tablet_manager.cc:1403] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.452s user 0.006s sys 0.000s
I20260927 13:50:04.560894 6447 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_e5e1a64053e246afa93a7a04384b119f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:04.560954 6454 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_70b5cd5dfa384bbe96b6cbde391503c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:04.561650 6447 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5e1a64053e246afa93a7a04384b119f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:50:04.561748 6454 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70b5cd5dfa384bbe96b6cbde391503c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.563628 5619 raft_consensus.cc:359] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.564517 5619 raft_consensus.cc:385] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:04.564831 6451 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_3ca628c79eab48babf7dad481da1cb2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:04.564822 5619 raft_consensus.cc:740] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:04.565572 6444 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_3fa264c067c94c4fb5a70ecffe083689"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:04.565985 6444 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fa264c067c94c4fb5a70ecffe083689 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.566249 5081 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e7e50142e447158f90770322609a2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.566510 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead437e93bb14a73a820631b0be041aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.566891 6449 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_fbe3019feb804488bb1c921ca74d85d1" } modify_external_catalogs: true
I20260927 13:50:04.567065 6449 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_fbe3019feb804488bb1c921ca74d85d1" } modify_external_catalogs: true
I20260927 13:50:04.568075 6453 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_2d7d460396774c7982b3391c3ad1827f" } new_table_name: "default.Table_b927618f29db4aa49333c257a59c9aa3" modify_external_catalogs: true
W20260927 13:50:04.568662 6451 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ca628c79eab48babf7dad481da1cb2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.572252 6455 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_908235dbf46e4c6f9a13506c919c6492" } new_table_name: "default.Table_6ac0611179c743808ff8a129f463dd61" modify_external_catalogs: true
I20260927 13:50:04.575999 7016 raft_consensus.cc:493] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.574640 5355 tablet_service.cc:1511] Processing CreateTablet for tablet 9775c853381749ad89906b32d3adee23 (DEFAULT_TABLE table=default.Table_e34a6db37cbf47d79d8f13cd46cc83fb [id=4d9779ad662542bda9207247226d34a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.576128 7016 raft_consensus.cc:515] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.576524 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9775c853381749ad89906b32d3adee23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.576754 7016 leader_election.cc:290] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.577246 7016 raft_consensus.cc:493] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.577368 7016 raft_consensus.cc:515] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.577853 7016 leader_election.cc:290] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.581414 7016 raft_consensus.cc:493] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.581542 7016 raft_consensus.cc:515] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.581888 6444 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_a0e7f65e456f440497cf22b28f3629bb" } new_table_name: "default.Table_406a7314de1d4a08a6842bc717404371" modify_external_catalogs: true
I20260927 13:50:04.581998 5076 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6073174dbb4ca1933685b7bd3a22e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 13ad5733322545f699d980df99ae0dff) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.582132 7016 leader_election.cc:290] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.582834 5075 tablet_service.cc:1558] Processing DeleteTablet for tablet 413d863d9a564e5d8325b4479346730d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.583159 6447 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_be21b5e424724df9868d8ded75617bdb" } new_table_name: "default.Table_7a5a607e5463433eb93aedb9f76696db" modify_external_catalogs: true
I20260927 13:50:04.589222 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 04e16ca60020406fb46436fa68ea4b33 (DEFAULT_TABLE table=default.Table_2d0fed5c3d8c43dba32fce20571132d1 [id=3583b63e50c74d4c9c8cb6c70ef685ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.589196 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 262cb3e5f847409993e1ca20c296bff3 (DEFAULT_TABLE table=default.Table_eaa1571598144afbb2bb374264f3f84a [id=6f2177bb5be94c0e99a15217b1c84169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.589728 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e16ca60020406fb46436fa68ea4b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.589917 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262cb3e5f847409993e1ca20c296bff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.589195 5084 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c14a6b95c1e460a8e7a299340f09498 with delete_type TABLET_DATA_DELETED (replaced by tablet 8acd411b965c49919dc77c8c94853548) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:04.598676 5354 tablet_service.cc:1511] Processing CreateTablet for tablet b3cd09c466b8476891cc8b26d13e8701 (DEFAULT_TABLE table=default.Table_aa475363b82246bcbc00b2b60ce222ae [id=227e1333cf1e4ceeb6ecc6e09b014100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.599464 6451 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_d6b9b32a54ed4746b880a4ae62ad9ba3" } modify_external_catalogs: true
I20260927 13:50:04.599722 6451 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_d6b9b32a54ed4746b880a4ae62ad9ba3" } modify_external_catalogs: true
I20260927 13:50:04.602128 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3cd09c466b8476891cc8b26d13e8701. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:04.605188 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_908235dbf46e4c6f9a13506c919c6492 [id=fe64adff124845c0b35692c8e48f8759], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 consensus state has no leader
I20260927 13:50:04.606163 7098 ts_tablet_manager.cc:1950] T 4b13c629908a47368846770c697aebd8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:04.607645 5628 tablet_bootstrap.cc:654] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:04.608731 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db800a7002b04b79baf9f4ec61af764b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.609009 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b26289ed050454d817c13159295ec37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.611174 5296 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:04.616025 5619 consensus_queue.cc:260] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.617974 5619 ts_tablet_manager.cc:1434] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.058s user 0.004s sys 0.000s
I20260927 13:50:04.620611 5221 tablet_service.cc:1511] Processing CreateTablet for tablet c27872794fb24934b723c56935d94702 (DEFAULT_TABLE table=default.Table_a5b94f165eff40f3826437ed44404e55 [id=caf6214f83fd4d19b26a6f39ef349629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.631503 7123 raft_consensus.cc:493] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.631670 7123 raft_consensus.cc:515] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.632371 7123 leader_election.cc:290] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:04.632495 6455 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 consensus state has no leader
I20260927 13:50:04.636593 5432 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:04.636804 6453 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_464a0b4a4e9d430fad6cbf768b6bf2ca" } new_table_name: "default.Table_f3c5680fa304438d9df88d573453cd6f" modify_external_catalogs: true
I20260927 13:50:04.638422 6454 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_4384df2328734676b60b16fe84947703" } modify_external_catalogs: true
I20260927 13:50:04.638634 6454 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_4384df2328734676b60b16fe84947703" } modify_external_catalogs: true
I20260927 13:50:04.639256 6455 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_3403808c5c374ea394fee64ad76c8d73" } modify_external_catalogs: true
I20260927 13:50:04.639477 6455 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_3403808c5c374ea394fee64ad76c8d73" } modify_external_catalogs: true
W20260927 13:50:04.645733 6444 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6b1e7169cdd4f6b8dced0a807bc17e8 has no consensus state
I20260927 13:50:04.645798 7098 tablet_replica.cc:333] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:04.645994 7098 raft_consensus.cc:2243] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:04.646163 7098 raft_consensus.cc:2272] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:04.646705 7098 ts_tablet_manager.cc:1916] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:04.650291 6447 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2cc7301d09b245328a851a0734669965 consensus state has no leader
I20260927 13:50:04.653522 5619 tablet_bootstrap.cc:492] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:04.659503 5619 tablet_bootstrap.cc:654] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:04.662024 5359 tablet_service.cc:1511] Processing CreateTablet for tablet e016878296da44b9a7691a7fc7206cb9 (DEFAULT_TABLE table=default.Table_2f47a147309843cda12839d088afebef [id=2c1da9087ada46f083eaa9f1a170761f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.662101 5353 tablet_service.cc:1511] Processing CreateTablet for tablet afb1862777b94fed97c0b92fa2c5545d (DEFAULT_TABLE table=default.Table_f76750964cba404fb197cc254b4ed32a [id=297e14783b0840c5864234841184e17e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.662443 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e016878296da44b9a7691a7fc7206cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.662648 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb1862777b94fed97c0b92fa2c5545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.665668 6444 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_f9afa72c04394383a22302115766399d" } modify_external_catalogs: true
I20260927 13:50:04.647578 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 4b13c629908a47368846770c697aebd8 (table default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]) successfully deleted
I20260927 13:50:04.665930 5210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7bb872f4c347e2a0b4ee4dc1c787ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.665916 6444 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_f9afa72c04394383a22302115766399d" } modify_external_catalogs: true
I20260927 13:50:04.666179 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac28d0072aa1455681d6fa0bfde68f7b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:04.666204 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b9a1193719e140beb9b492927adeb78c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a1193719e140beb9b492927adeb78c already in progress: creating tablet
W20260927 13:50:04.666456 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 467aa7fb4edf4b1b8dad6514d1d017b1 already in progress: creating tablet
I20260927 13:50:04.666563 6447 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_f8e1d2c1de20415e9d275698c23e2bb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:04.666868 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85debab98b0f42a5b50f1b0d132147d3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:04.666692 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 38a34074d833424bae6035d9e437ad3e because the tablet was not found. No further retry: Not found: Tablet not found: 38a34074d833424bae6035d9e437ad3e
W20260927 13:50:04.667423 6447 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8e1d2c1de20415e9d275698c23e2bb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:50:04.675916 6453 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5678703b72c8471583147786f49122a5 consensus state has no leader
I20260927 13:50:04.686084 6453 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_af45c618a8364666918fb3ae10a1fccd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:04.687070 6453 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af45c618a8364666918fb3ae10a1fccd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.694697 6779 raft_consensus.cc:493] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.694854 6779 raft_consensus.cc:515] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.696038 6779 leader_election.cc:290] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.697201 7098 ts_tablet_manager.cc:1929] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:04.697779 7098 log.cc:1199] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/95726f690a71433ca63f95da4ee750e5
I20260927 13:50:04.699658 7098 ts_tablet_manager.cc:1950] T 95726f690a71433ca63f95da4ee750e5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:04.701730 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 95726f690a71433ca63f95da4ee750e5 (table default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e]) successfully deleted
I20260927 13:50:04.702603 7098 tablet_replica.cc:333] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:04.703567 7098 raft_consensus.cc:2243] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:04.704140 6447 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_5cf641fb505b46939f594b89b22bb0e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:04.704377 7098 raft_consensus.cc:2272] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:04.705729 6447 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cf641fb505b46939f594b89b22bb0e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.707825 7098 ts_tablet_manager.cc:1916] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:04.709350 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 50c2661998134488a95b4750d0e653a6 (DEFAULT_TABLE table=default.Table_8ccdfb70bd5f4ae9912dd1e5669a09e3 [id=c39aa424f92d4fc8bf69b9829737f61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.717171 6779 raft_consensus.cc:493] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.717329 6779 raft_consensus.cc:515] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.718004 6779 leader_election.cc:290] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.720110 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b02466d95c2a4ae880d61252b167f0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.720726 6453 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_d7281f105585492eba77dc1d7ed95a94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:04.721576 6453 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7281f105585492eba77dc1d7ed95a94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.732774 6447 master_service.cc:960] ReplaceTablet: received request to replace tablet 58d9274ad0934f19a7c36325eee3dd59 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:04.740702 5358 tablet_service.cc:1511] Processing CreateTablet for tablet db800a7002b04b79baf9f4ec61af764b (DEFAULT_TABLE table=default.Table_479338a884a047389e0343ea71022b50 [id=f5e5dded0c5042adb7dce1d541d92e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.741134 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db800a7002b04b79baf9f4ec61af764b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.742703 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fb1288684c45f6a778d809a5e2c160" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:04.742938 5106 raft_consensus.cc:2393] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 79c1646c9659434b9a659382d2eb1d8a in this term.
I20260927 13:50:04.743767 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet f04b3a942c404f3894fbbd6ece24a727 (table default.Table_db70ad184fab4e5984d1777fecae5518 [id=c6230203df764e97a3fd3c8117177db2]) successfully deleted
W20260927 13:50:04.744232 6429 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet e761457384e54078933a07f5b0eca68b because the tablet was not found. No further retry: Not found: Tablet not found: e761457384e54078933a07f5b0eca68b
I20260927 13:50:04.747704 5363 tablet_service.cc:1511] Processing CreateTablet for tablet b02466d95c2a4ae880d61252b167f0c8 (DEFAULT_TABLE table=default.Table_39166aa385de4916b3c9aaf6d9133e1c [id=70fa5cc937ef4ee4b6a8920a1e29c4e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.748162 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b02466d95c2a4ae880d61252b167f0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.749207 5619 tablet_bootstrap.cc:492] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:04.749475 5619 ts_tablet_manager.cc:1403] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.096s user 0.006s sys 0.000s
I20260927 13:50:04.749714 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 85debab98b0f42a5b50f1b0d132147d3 (DEFAULT_TABLE table=default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.750039 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85debab98b0f42a5b50f1b0d132147d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.750816 5351 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7bb872f4c347e2a0b4ee4dc1c787ef (DEFAULT_TABLE table=default.Table_a7a5af7cfafc47a49d35f8a72e1d1ab5 [id=84210551dbfd4670b948ea3357d599e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.751480 5619 raft_consensus.cc:359] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.752054 5619 raft_consensus.cc:385] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:04.752264 5619 raft_consensus.cc:740] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:04.752552 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 277615c97d9945269ba94d9d7c1c0464 (DEFAULT_TABLE table=default.Table_5de6d07207814569a0b1f42ac2e12c24 [id=87e80bd0bbe04f43b582390b45a522f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.753929 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7bb872f4c347e2a0b4ee4dc1c787ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.753250 5619 consensus_queue.cc:260] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.757136 5352 tablet_service.cc:1511] Processing CreateTablet for tablet e3765fe06c664e60a11acf76c825bc42 (DEFAULT_TABLE table=default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.757442 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3765fe06c664e60a11acf76c825bc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.758225 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277615c97d9945269ba94d9d7c1c0464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.761130 5360 tablet_service.cc:1511] Processing CreateTablet for tablet 3b26289ed050454d817c13159295ec37 (DEFAULT_TABLE table=default.Table_5b64a307e44a471598ef010e33a82fe3 [id=9c86bcdd37654832b7a92763aa42e6c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.761461 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b26289ed050454d817c13159295ec37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.761986 6453 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_89f97a5bda26441d81fe82538717c17a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:04.764259 5357 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1ff7efba2042588a05a461d6179813 (DEFAULT_TABLE table=default.Table_c4f4659ddd2a47c48ae7d545ac78f2cc [id=c2a8b1992a3a4410b6e0a53d5beb27bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.764544 5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1ff7efba2042588a05a461d6179813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.766438 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 7469927f3893494aa36b8f5b4d2d4146 (DEFAULT_TABLE table=default.Table_438c450d2fff477aaf6e67a530a1532a [id=aa804ddccaec408bbfca331d8b49125a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.766752 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7469927f3893494aa36b8f5b4d2d4146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.767688 5358 tablet_service.cc:1511] Processing CreateTablet for tablet 78e409e186a24070b3fb3087fd805aa6 (DEFAULT_TABLE table=default.Table_800bad10399f4515acb401f9be49e957 [id=b0d2a5de33884946b95e67dffb65b617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.768463 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7a90d0fc534ef792788886207b29d2 (DEFAULT_TABLE table=default.Table_32fe69927df64b76b1aefe941e9f4241 [id=baed5667f9254dd99700c6d185b44535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.768545 5349 tablet_service.cc:1511] Processing CreateTablet for tablet e1e574bc8b544039b440a845966eb1d4 (DEFAULT_TABLE table=default.Table_2159a2c74b9c4769be385712b34f41c3 [id=c386219cd45c4447b229c721951babeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.768774 5355 tablet_service.cc:1511] Processing CreateTablet for tablet ac28d0072aa1455681d6fa0bfde68f7b (DEFAULT_TABLE table=default.Table_c759fc3bc488489a94e8a6193c491682 [id=bfc3d095064143c9b2adfd23049e64f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.769665 6779 raft_consensus.cc:493] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.769809 6779 raft_consensus.cc:515] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.770432 6779 leader_election.cc:290] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:04.771673 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 50c2661998134488a95b4750d0e653a6 (DEFAULT_TABLE table=default.Table_8ccdfb70bd5f4ae9912dd1e5669a09e3 [id=c39aa424f92d4fc8bf69b9829737f61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.772804 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 740245532e274e2bab26dd84a68efa91 (DEFAULT_TABLE table=default.Table_6e893d08117849cea8b823b4d752b91b [id=c622333396e0438788c417822274dc41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.773099 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet 38a34074d833424bae6035d9e437ad3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:04.773617 5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e409e186a24070b3fb3087fd805aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.774019 5365 tablet_service.cc:1511] Processing CreateTablet for tablet d0a76346f33b4041b100bf2d736ae21c (DEFAULT_TABLE table=default.Table_5f348882b88d4bdc8b238f4794b07610 [id=c68169e25a9f43b08141799bc435b14c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.775017 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a76346f33b4041b100bf2d736ae21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.775786 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e574bc8b544039b440a845966eb1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.777100 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7a90d0fc534ef792788886207b29d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.778290 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c2661998134488a95b4750d0e653a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.778656 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 7b229676c51e42d8bdd473f5d5fb1464 (DEFAULT_TABLE table=default.Table_645d9205892845cdb661a97f3576207e [id=c5b8489d57cf4ceabd115dfec550c9ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.778944 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b229676c51e42d8bdd473f5d5fb1464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.780369 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740245532e274e2bab26dd84a68efa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.782922 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac28d0072aa1455681d6fa0bfde68f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.792636 5619 ts_tablet_manager.cc:1434] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.043s user 0.000s sys 0.003s
I20260927 13:50:04.794472 5619 tablet_bootstrap.cc:492] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:04.804322 5626 tablet_bootstrap.cc:654] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:04.806452 6779 raft_consensus.cc:493] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.806600 6779 raft_consensus.cc:515] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.807179 6779 leader_election.cc:290] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:04.808522 6453 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89f97a5bda26441d81fe82538717c17a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.810846 7098 ts_tablet_manager.cc:1929] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:04.811043 7098 log.cc:1199] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/60de1c28618f4e478aae68ad07fbcf98
I20260927 13:50:04.815752 6453 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_56fd8ac906824c00b1a20aedef13e66b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:04.817299 6453 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56fd8ac906824c00b1a20aedef13e66b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.821777 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 38a34074d833424bae6035d9e437ad3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.824427 5220 tablet_service.cc:1511] Processing CreateTablet for tablet e1e574bc8b544039b440a845966eb1d4 (DEFAULT_TABLE table=default.Table_2159a2c74b9c4769be385712b34f41c3 [id=c386219cd45c4447b229c721951babeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.826023 5224 tablet_service.cc:1511] Processing CreateTablet for tablet d0a76346f33b4041b100bf2d736ae21c (DEFAULT_TABLE table=default.Table_5f348882b88d4bdc8b238f4794b07610 [id=c68169e25a9f43b08141799bc435b14c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.825995 6453 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_936e6396f4194eea8ed1eff9e6b374bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:04.827137 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e409e186a24070b3fb3087fd805aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.827370 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277615c97d9945269ba94d9d7c1c0464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.827561 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7469927f3893494aa36b8f5b4d2d4146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.827728 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27872794fb24934b723c56935d94702. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:04.828310 6453 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_936e6396f4194eea8ed1eff9e6b374bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:04.828859 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 740245532e274e2bab26dd84a68efa91 (DEFAULT_TABLE table=default.Table_6e893d08117849cea8b823b4d752b91b [id=c622333396e0438788c417822274dc41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.848841 5619 tablet_bootstrap.cc:654] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:04.854452 7098 ts_tablet_manager.cc:1950] T 60de1c28618f4e478aae68ad07fbcf98 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:04.855135 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 60de1c28618f4e478aae68ad07fbcf98 (table default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]) successfully deleted
I20260927 13:50:04.859303 5045 leader_election.cc:304] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:04.859761 6779 raft_consensus.cc:2804] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:04.859897 6779 raft_consensus.cc:697] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:50:04.860148 6779 consensus_queue.cc:237] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.879292 7098 tablet_replica.cc:333] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:04.879585 7098 raft_consensus.cc:2243] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:04.879794 7098 raft_consensus.cc:2272] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:04.880857 7098 ts_tablet_manager.cc:1916] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:04.882426 5045 leader_election.cc:343] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:04.882550 5045 leader_election.cc:304] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:04.883018 6779 raft_consensus.cc:2749] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:04.883630 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 0851e183315a45f4a85d68d698e74cb7 (table default.Table_d930205241084c7b957ca0983bfb037f [id=dd996f6d5b764e799ed45890225b7670]) successfully deleted
W20260927 13:50:04.883965 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet ecb5cdc007074e0c8f44d963e527a955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecb5cdc007074e0c8f44d963e527a955 already in progress: creating tablet
W20260927 13:50:04.884209 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 1087ad60dade46bb9d38f52a94dd536b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1087ad60dade46bb9d38f52a94dd536b already in progress: creating tablet
W20260927 13:50:04.888096 5045 leader_election.cc:343] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:04.888216 5045 leader_election.cc:304] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:04.888607 6779 raft_consensus.cc:2749] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:04.890030 5045 leader_election.cc:343] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:04.890196 5045 leader_election.cc:304] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:04.890604 6779 raft_consensus.cc:2749] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:04.891062 5045 leader_election.cc:343] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:04.891155 5045 leader_election.cc:304] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:04.891523 6779 raft_consensus.cc:2749] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:04.893159 5045 leader_election.cc:343] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:04.893272 5045 leader_election.cc:304] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:04.893707 6779 raft_consensus.cc:2749] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:04.894214 5045 leader_election.cc:343] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:04.894337 5045 leader_election.cc:304] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:04.894763 6779 raft_consensus.cc:2749] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:04.897627 5045 leader_election.cc:343] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:04.897782 5045 leader_election.cc:304] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:04.898368 6779 raft_consensus.cc:2749] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:04.902483 5045 leader_election.cc:343] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:04.902642 5045 leader_election.cc:304] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:04.902993 6779 raft_consensus.cc:2749] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:04.910341 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:04.910537 5107 raft_consensus.cc:2468] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:04.925988 5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1ff7efba2042588a05a461d6179813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.930634 5351 tablet_service.cc:1511] Processing CreateTablet for tablet ead437e93bb14a73a820631b0be041aa (DEFAULT_TABLE table=default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.930634 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 6de346dcbaa7433db7ee0f23b6e7df45 (DEFAULT_TABLE table=default.Table_7a4d7f5d2d204a5c8a42b30ae9b4623d [id=c920b19c5b2041dd915de732f5b0c640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.931083 5351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead437e93bb14a73a820631b0be041aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.931280 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de346dcbaa7433db7ee0f23b6e7df45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:04.936299 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 95726f690a71433ca63f95da4ee750e5 with delete_type TABLET_DATA_DELETED (replaced by tablet cddf1b48a78e4ff789e0bb0bf75e307b) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:04.936498 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 992bf643dee64bccaa993a08027aa5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:04.936544 7111 tablet_replica.cc:333] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:04.936619 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 60de1c28618f4e478aae68ad07fbcf98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:04.936746 7111 raft_consensus.cc:2243] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:04.936882 7111 raft_consensus.cc:2272] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:04.937410 7111 ts_tablet_manager.cc:1916] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:04.939841 5219 tablet_service.cc:1511] Processing CreateTablet for tablet 6de346dcbaa7433db7ee0f23b6e7df45 (DEFAULT_TABLE table=default.Table_7a4d7f5d2d204a5c8a42b30ae9b4623d [id=c920b19c5b2041dd915de732f5b0c640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.940847 5364 tablet_service.cc:1558] Processing DeleteTablet for tablet 36181512a94c4702ae0a417665919faa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:04.945151 7111 ts_tablet_manager.cc:1929] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:04.944926 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 7b229676c51e42d8bdd473f5d5fb1464 (DEFAULT_TABLE table=default.Table_645d9205892845cdb661a97f3576207e [id=c5b8489d57cf4ceabd115dfec550c9ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.945405 7111 log.cc:1199] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/95726f690a71433ca63f95da4ee750e5
I20260927 13:50:04.945960 7111 ts_tablet_manager.cc:1950] T 95726f690a71433ca63f95da4ee750e5 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:04.946864 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c14a6b95c1e460a8e7a299340f09498 with delete_type TABLET_DATA_DELETED (replaced by tablet 8acd411b965c49919dc77c8c94853548) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:04.950865 7111 tablet_replica.cc:333] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:04.951436 7111 raft_consensus.cc:2243] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:04.951865 7111 raft_consensus.cc:2272] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:04.953250 7111 ts_tablet_manager.cc:1916] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:04.967890 5628 tablet_bootstrap.cc:492] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:04.968549 5628 ts_tablet_manager.cc:1403] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.422s user 0.006s sys 0.000s
I20260927 13:50:04.977728 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 95726f690a71433ca63f95da4ee750e5 with delete_type TABLET_DATA_DELETED (replaced by tablet cddf1b48a78e4ff789e0bb0bf75e307b) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.978016 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 992bf643dee64bccaa993a08027aa5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.978193 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 60de1c28618f4e478aae68ad07fbcf98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.978330 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b082227264e442a8b1db7a68fb0c3eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.978459 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 36181512a94c4702ae0a417665919faa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.978592 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c14a6b95c1e460a8e7a299340f09498 with delete_type TABLET_DATA_DELETED (replaced by tablet 8acd411b965c49919dc77c8c94853548) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.978721 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 4211f338c6a648c5b3e36c6df0b3c510 with delete_type TABLET_DATA_DELETED (replaced by tablet 85debab98b0f42a5b50f1b0d132147d3) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.978863 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet a813939920244be781d546311fe8a33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.978997 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a07adcd33414d18ae9720e7a307548a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.979149 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc140bba42a43758fa0c6540d728275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.979310 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c2f814bb9ff41ebab19e8c16cf4affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.979447 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 50fb1288684c45f6a778d809a5e2c160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.979576 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.979700 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet e26a3a50396940cf826442e4ba7356a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.979840 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet b57886cc11a2423983c2b7bac79150a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.979964 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bc839e0fc54839a5d06c176760f618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.980867 5217 tablet_service.cc:1511] Processing CreateTablet for tablet ead437e93bb14a73a820631b0be041aa (DEFAULT_TABLE table=default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:04.990288 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet bb25bb5ee153494d803130f1ad4f7c2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.991892 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 081f18e00af74e5c811f774d29422351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.994699 7182 raft_consensus.cc:493] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:04.994846 7182 raft_consensus.cc:515] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:04.994923 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 3933c0a2fd6547f28528fae7d443a2c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.995086 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet da75a470ec0c4ec9afa7c18a51cd7276 with delete_type TABLET_DATA_DELETED (replaced by tablet bad30e7310c842e6818471272f5d669e) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.995216 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet a0e14fd01a9141cdb2df030ee0dd05db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.995412 7182 leader_election.cc:290] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:04.995411 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet f75847513dcf4c84913a4073176f2507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.995846 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 413d863d9a564e5d8325b4479346730d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.995978 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.996119 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c7919f5076406186000cd4077aadaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.996438 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e3fa4870d5547a2bbffe1745b964504 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.996717 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e1acd618fc44be9169fa1d56fa510a with delete_type TABLET_DATA_DELETED (replaced by tablet 14f5479761f94ee0b339e125d06a808c) from {username='slave'} at 127.0.0.1:44390
W20260927 13:50:04.997150 5182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s user 0.055s sys 0.044s
W20260927 13:50:04.997289 5182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s user 0.055s sys 0.044s
I20260927 13:50:05.020555 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 0880140d99004eb1803d6b5dcf41af13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:04.996263 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 with delete_type TABLET_DATA_DELETED (replaced by tablet cf1a58c67bf54493a3c62fb175acabb8) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:05.024309 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7a90d0fc534ef792788886207b29d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.024613 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead437e93bb14a73a820631b0be041aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.024832 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740245532e274e2bab26dd84a68efa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.028697 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fb1288684c45f6a778d809a5e2c160" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.029052 6779 raft_consensus.cc:493] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.029210 6779 raft_consensus.cc:515] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:05.029361 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13c629908a47368846770c697aebd8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.030269 6779 leader_election.cc:290] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.038169 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3765fe06c664e60a11acf76c825bc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.039021 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e574bc8b544039b440a845966eb1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.039136 5619 tablet_bootstrap.cc:492] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:05.040126 5619 ts_tablet_manager.cc:1403] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.246s user 0.000s sys 0.008s
I20260927 13:50:05.041515 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4099c41981f46758a8f478d7fdb4182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.041776 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e1acd618fc44be9169fa1d56fa510a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.041981 5245 raft_consensus.cc:2468] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:05.042212 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 4b13c629908a47368846770c697aebd8 (table default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]) successfully deleted
I20260927 13:50:05.043843 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c2661998134488a95b4750d0e653a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:05.046481 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b9a1193719e140beb9b492927adeb78c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a1193719e140beb9b492927adeb78c already in progress: creating tablet
W20260927 13:50:05.046756 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 467aa7fb4edf4b1b8dad6514d1d017b1 already in progress: creating tablet
I20260927 13:50:05.050076 6882 raft_consensus.cc:493] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.050230 6882 raft_consensus.cc:515] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:05.050859 6882 leader_election.cc:290] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:05.051419 7125 raft_consensus.cc:493] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.051575 7125 raft_consensus.cc:515] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.051769 6882 raft_consensus.cc:493] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.051883 6882 raft_consensus.cc:515] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.052120 7125 leader_election.cc:290] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.052397 6882 leader_election.cc:290] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.054589 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.058476 6793 raft_consensus.cc:493] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.058619 6793 raft_consensus.cc:515] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.059126 6793 leader_election.cc:290] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:05.059540 5319 consensus_peers.cc:597] T 80fe8af2068948c78feac4641a7525be P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:05.061503 7098 ts_tablet_manager.cc:1929] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:05.067236 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de346dcbaa7433db7ee0f23b6e7df45. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:05.069399 5319 leader_election.cc:343] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.069999 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a76346f33b4041b100bf2d736ae21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.070487 5319 leader_election.cc:304] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:05.070833 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b229676c51e42d8bdd473f5d5fb1464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.071046 7098 log.cc:1199] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/36181512a94c4702ae0a417665919faa
I20260927 13:50:05.071628 7098 ts_tablet_manager.cc:1950] T 36181512a94c4702ae0a417665919faa P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:05.071803 6882 raft_consensus.cc:2804] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:05.071918 6882 raft_consensus.cc:493] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:05.072016 6882 raft_consensus.cc:3060] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.074765 6882 raft_consensus.cc:515] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.075399 6882 leader_election.cc:290] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:05.077488 5319 leader_election.cc:343] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.078219 7098 tablet_replica.cc:333] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:05.078516 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 36181512a94c4702ae0a417665919faa (table default.Table_06b04cbe300b4373813df57694d32684 [id=ed3f5ac2c7fe4efeaa58e8a11100851b]) successfully deleted
I20260927 13:50:05.079831 6455 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 1b4494b7e895454f81fef308950729ef
I20260927 13:50:05.081111 6441 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet f46f45a0a13b4e05802a08880d7f6a01
I20260927 13:50:05.081918 6441 catalog_manager.cc:6934] ReplaceTablet: tablet f46f45a0a13b4e05802a08880d7f6a01 deleted and replaced by tablet b594c65e18d94d1dba45b34dc520823c
I20260927 13:50:05.082391 6441 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_0eb2310657374b4c9746296895007026"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:05.083280 6441 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0eb2310657374b4c9746296895007026 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:05.082031 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet f46f45a0a13b4e05802a08880d7f6a01 with delete_type TABLET_DATA_DELETED (replaced by tablet b594c65e18d94d1dba45b34dc520823c) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:05.085031 7098 raft_consensus.cc:2243] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:05.085212 7098 raft_consensus.cc:2272] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.085747 7098 ts_tablet_manager.cc:1916] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.085909 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b4494b7e895454f81fef308950729ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:05.086088 6449 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet a6596ed8c4d44ad58a7ec495a665d1e9
I20260927 13:50:05.086352 6447 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 58d9274ad0934f19a7c36325eee3dd59
W20260927 13:50:05.087386 5319 consensus_peers.cc:597] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:50:05.087649 5319 consensus_peers.cc:597] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:05.087682 6449 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_0973bd1ed2dc4cb6b285aae2c97ad9af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:05.088263 6447 catalog_manager.cc:6934] ReplaceTablet: tablet 58d9274ad0934f19a7c36325eee3dd59 deleted and replaced by tablet 0dbdc347bc9845b2b577f551577d070b
I20260927 13:50:05.088250 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 58d9274ad0934f19a7c36325eee3dd59 with delete_type TABLET_DATA_DELETED (replaced by tablet 0dbdc347bc9845b2b577f551577d070b) from {username='slave'} at 127.0.0.1:39028
W20260927 13:50:05.088587 5319 consensus_peers.cc:597] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:05.089027 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e917382b6f3d4e009fa159ed38c342d8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.089044 6447 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_f2000b1332564779b99fef20acf75a9a" } new_table_name: "default.Table_eabbc608c09045b095cdfe05e9660ac7" modify_external_catalogs: true
I20260927 13:50:05.089596 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.089769 5385 raft_consensus.cc:2468] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:05.089807 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6073174dbb4ca1933685b7bd3a22e1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.090034 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3b98290dc74d88856e13f003a1e4c7" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.090153 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9872d637765b4d719e2de63ae1eb3196" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.090448 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85130d7ea68545518ca3c255e28a20d3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.091187 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet a6596ed8c4d44ad58a7ec495a665d1e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:05.091959 6453 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_8492d36517214d8185232485f0741f6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:05.092545 6453 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8492d36517214d8185232485f0741f6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 13:50:05.088338 6449 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0973bd1ed2dc4cb6b285aae2c97ad9af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:05.093672 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e730a00ad2e646a4ba594ba9434c3b50" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.093837 5382 raft_consensus.cc:2468] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:05.094198 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a9f864e4274666a86baed43e1623cd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.094250 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709e969569b43a7aace8d7cfe4e64c5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.094348 5379 raft_consensus.cc:2468] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:05.094061 5384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6a4cf5ee2b43158d8db4c7cdd4a42e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.094715 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f702b0a6380543a8ac539125d4334cd5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:05.102425 5229 consensus_meta.cc:287] T 319a788b7d9542f6a2ae11e21bc8af55 P 79c1646c9659434b9a659382d2eb1d8a: Time spent flushing consensus metadata: real 1.120s user 0.018s sys 0.008s
I20260927 13:50:05.102818 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8c3b0f8fa64faca825311f0b46237f (DEFAULT_TABLE table=default.Table_65dc116e5f0344ce81993d560de66aa0 [id=90838db7424349b49570981575c98363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.103299 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8c3b0f8fa64faca825311f0b46237f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.104691 6896 raft_consensus.cc:493] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.104830 6896 raft_consensus.cc:515] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:05.105357 6896 leader_election.cc:290] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.111869 6779 raft_consensus.cc:493] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.112012 6779 raft_consensus.cc:515] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.112610 6779 leader_election.cc:290] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:05.113656 5185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s user 0.001s sys 0.007s
W20260927 13:50:05.113750 5185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s user 0.001s sys 0.007s
I20260927 13:50:05.115159 5628 raft_consensus.cc:359] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.115345 5628 raft_consensus.cc:385] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.115396 5628 raft_consensus.cc:740] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.115582 5628 consensus_queue.cc:260] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.117946 5080 tablet_service.cc:1511] Processing CreateTablet for tablet d2400a1cbeb34308ad7dd08972b674b2 (DEFAULT_TABLE table=default.Table_58d22b166d164bd7baa193ee9ccae8ff [id=c2ad020146d44fdba457c196fb8df980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.118362 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2400a1cbeb34308ad7dd08972b674b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.119355 5628 ts_tablet_manager.cc:1434] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.150s user 0.000s sys 0.004s
I20260927 13:50:05.119659 5628 tablet_bootstrap.cc:492] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:05.121157 7190 tablet_replica.cc:333] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:05.121452 7190 raft_consensus.cc:2243] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:05.121449 5619 raft_consensus.cc:359] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.121624 5619 raft_consensus.cc:385] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.121675 5619 raft_consensus.cc:740] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.121914 7190 pending_rounds.cc:70] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:50:05.122011 7190 pending_rounds.cc:77] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957648606076928 op_type: NO_OP noop_request { }
I20260927 13:50:05.122184 7190 raft_consensus.cc:2889] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:05.122334 7190 raft_consensus.cc:2272] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.122961 7190 ts_tablet_manager.cc:1916] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.125216 5089 tablet_service.cc:1511] Processing CreateTablet for tablet c4211f416028480b82bfa19d53876a50 (DEFAULT_TABLE table=default.Table_3272a4a26c764ccfa98301a594aacfba [id=05b90438d57a494d8abf553d5adf1a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.127624 5619 consensus_queue.cc:260] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.128154 5619 ts_tablet_manager.cc:1434] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.087s user 0.001s sys 0.004s
I20260927 13:50:05.128988 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4211f416028480b82bfa19d53876a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.134898 5626 tablet_bootstrap.cc:492] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:05.135032 5626 ts_tablet_manager.cc:1403] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.848s user 0.014s sys 0.004s
I20260927 13:50:05.135070 5072 tablet_service.cc:1511] Processing CreateTablet for tablet 32ca9090b94e410ba02e9dfae8026b1e (DEFAULT_TABLE table=default.Table_5e9055a0823846ddae6164cecbf5a882 [id=154506f9cdea4a50a78c108ece75d78e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.135428 5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ca9090b94e410ba02e9dfae8026b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.138592 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6073174dbb4ca1933685b7bd3a22e1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.141557 5619 tablet_bootstrap.cc:492] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:05.142913 6779 raft_consensus.cc:493] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.143071 6779 raft_consensus.cc:515] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.143210 5619 tablet_bootstrap.cc:654] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.143640 6779 leader_election.cc:290] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.123390 5229 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44390 (request call id 23) took 1164 ms. Trace:
I20260927 13:50:05.146729 5229 rpcz_store.cc:276] 0927 13:50:03.958857 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:03.960919 (+ 2062us) service_pool.cc:224] Handling call
0927 13:50:03.961393 (+ 474us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0927 13:50:03.961415 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0927 13:50:03.982334 (+ 20919us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.102609 (+1120275us) tablet_replica.cc:206] Creating consensus instance
0927 13:50:05.123371 (+ 20762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260927 13:50:05.147918 5628 tablet_bootstrap.cc:654] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:05.150672 6429 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 38a34074d833424bae6035d9e437ad3e because the tablet was not found. No further retry: Not found: Tablet not found: 38a34074d833424bae6035d9e437ad3e
I20260927 13:50:05.153438 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a9f864e4274666a86baed43e1623cd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:05.153609 5106 raft_consensus.cc:2468] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:05.154165 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 95726f690a71433ca63f95da4ee750e5 (table default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e]) successfully deleted
I20260927 13:50:05.154708 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54cf8c485324f798d59edf65d52d7b5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:05.154892 5106 raft_consensus.cc:2468] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:05.155611 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e730a00ad2e646a4ba594ba9434c3b50" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:05.155745 5106 raft_consensus.cc:2468] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:05.158033 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca5b5f9ca1e44eb8cc8bb9e1ff11102" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:05.158293 5106 raft_consensus.cc:2468] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:05.162695 5089 tablet_service.cc:1511] Processing CreateTablet for tablet 193e5d1a257f4600a29cb5e46128f456 (DEFAULT_TABLE table=default.Table_46120fb594064efdb49bfbe4e64d3598 [id=1584101ee2f244a9ad0f71330b76f54e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.163461 5067 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:55650 (request call id 148) took 1130 ms. Trace:
I20260927 13:50:05.163664 5067 rpcz_store.cc:276] 0927 13:50:04.032581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.059137 (+ 26556us) service_pool.cc:224] Handling call
0927 13:50:05.163399 (+1104262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384}
I20260927 13:50:05.165433 5619 tablet_bootstrap.cc:492] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:05.165560 5619 ts_tablet_manager.cc:1403] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20260927 13:50:05.166218 5619 raft_consensus.cc:359] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.166394 5619 raft_consensus.cc:385] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.166445 5619 raft_consensus.cc:740] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.166654 5619 consensus_queue.cc:260] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.168169 5619 ts_tablet_manager.cc:1434] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:05.168499 5619 tablet_bootstrap.cc:492] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:05.170500 5619 tablet_bootstrap.cc:654] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.176544 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 5678703b72c8471583147786f49122a5 (table default.Table_f3c5680fa304438d9df88d573453cd6f [id=0d85f9f0d28e43debda43f83a3e59637]). Expected version 2 got 0
I20260927 13:50:05.176808 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
I20260927 13:50:05.177042 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:05.177237 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:05.177397 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_b68a6b76e8684ab9ab1e52fbfaad3740 [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 2 got 0
I20260927 13:50:05.177630 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:05.177867 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]). Expected version 1 got 0
I20260927 13:50:05.178033 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]). Expected version 2 got 0
I20260927 13:50:05.184496 7190 ts_tablet_manager.cc:1929] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:05.184640 7190 log.cc:1199] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/95726f690a71433ca63f95da4ee750e5
I20260927 13:50:05.185887 5628 tablet_bootstrap.cc:492] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:05.186291 5628 ts_tablet_manager.cc:1403] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.067s user 0.001s sys 0.015s
I20260927 13:50:05.188036 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a9f864e4274666a86baed43e1623cd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.188459 5619 tablet_bootstrap.cc:492] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:05.188676 5619 ts_tablet_manager.cc:1403] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.001s
I20260927 13:50:05.188937 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:50:05.190068 5619 raft_consensus.cc:359] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.190668 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]). Expected version 1 got 0
W20260927 13:50:05.191848 5045 leader_election.cc:343] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.191596 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_cfdab7814ecc495089389612e0a7e4fe [id=ae170bbebc4e460fb58beb7f95f013a2]). Expected version 2 got 0
I20260927 13:50:05.191963 5045 leader_election.cc:304] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:05.192312 6779 raft_consensus.cc:2749] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:05.192236 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]). Expected version 5 got 0
I20260927 13:50:05.193142 5045 leader_election.cc:304] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:05.193002 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:50:05.193373 6779 raft_consensus.cc:2804] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:05.193445 6779 raft_consensus.cc:493] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:05.193506 6779 raft_consensus.cc:3060] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.196187 6779 raft_consensus.cc:515] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.197321 6779 leader_election.cc:290] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.197830 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85130d7ea68545518ca3c255e28a20d3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.198030 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3b98290dc74d88856e13f003a1e4c7" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.198314 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.199383 5072 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0597e8f5ba4bc6b54850f0d1a13954 (DEFAULT_TABLE table=default.Table_9e90cb3d6f55432795b8bcde5584712a [id=a4c98ec66922406aa2d944c9ff95f7d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.199960 7190 ts_tablet_manager.cc:1950] T 95726f690a71433ca63f95da4ee750e5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:05.201004 5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193e5d1a257f4600a29cb5e46128f456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.201660 5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0597e8f5ba4bc6b54850f0d1a13954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.202505 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9872d637765b4d719e2de63ae1eb3196" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.197844 5626 raft_consensus.cc:359] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:05.204216 5626 raft_consensus.cc:385] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.204281 5626 raft_consensus.cc:740] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.204473 5628 raft_consensus.cc:359] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.190390 5619 raft_consensus.cc:385] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.206573 5619 raft_consensus.cc:740] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.207794 7111 ts_tablet_manager.cc:1929] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:05.210196 5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709e969569b43a7aace8d7cfe4e64c5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.210285 5247 raft_consensus.cc:3060] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.209910 7111 log.cc:1199] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/992bf643dee64bccaa993a08027aa5fc
I20260927 13:50:05.211321 5628 raft_consensus.cc:385] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.193660 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:50:05.211606 5628 raft_consensus.cc:740] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.211850 5619 consensus_queue.cc:260] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.214923 5628 consensus_queue.cc:260] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.215356 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]). Expected version 2 got 0
I20260927 13:50:05.218670 7098 ts_tablet_manager.cc:1929] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:50:05.219056 5045 leader_election.cc:343] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.219251 5628 ts_tablet_manager.cc:1434] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.033s user 0.000s sys 0.003s
W20260927 13:50:05.219599 5045 leader_election.cc:343] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.220685 7190 tablet_replica.cc:333] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:05.220698 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f702b0a6380543a8ac539125d4334cd5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.219355 7098 log.cc:1199] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/5aed7fe630f64213846ad37d904f6516
I20260927 13:50:05.218441 7111 ts_tablet_manager.cc:1950] T 992bf643dee64bccaa993a08027aa5fc P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:50:05.222090 5045 leader_election.cc:343] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.222445 5628 tablet_bootstrap.cc:492] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:50:05.222468 5045 leader_election.cc:343] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.222865 7098 ts_tablet_manager.cc:1950] T 5aed7fe630f64213846ad37d904f6516 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:05.223172 5045 leader_election.cc:304] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:05.223625 6779 raft_consensus.cc:2804] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:05.223707 6779 raft_consensus.cc:493] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:05.223783 6779 raft_consensus.cc:3060] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.224360 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6a4cf5ee2b43158d8db4c7cdd4a42e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.225144 5626 consensus_queue.cc:260] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:05.225553 5626 ts_tablet_manager.cc:1434] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.090s user 0.001s sys 0.001s
I20260927 13:50:05.225816 5626 tablet_bootstrap.cc:492] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:05.226194 5249 raft_consensus.cc:2468] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:05.226823 6779 raft_consensus.cc:515] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.228885 7190 raft_consensus.cc:2243] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:05.229044 7190 raft_consensus.cc:2272] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.229300 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54cf8c485324f798d59edf65d52d7b5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.229490 6779 leader_election.cc:290] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.229580 7190 ts_tablet_manager.cc:1916] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.230010 5628 tablet_bootstrap.cc:654] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.228952 5619 ts_tablet_manager.cc:1434] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.040s user 0.003s sys 0.000s
I20260927 13:50:05.230973 5077 tablet_service.cc:1511] Processing CreateTablet for tablet c0da7bbfbaf248d78156192ee4baa5b1 (DEFAULT_TABLE table=default.Table_17de044576d64b0ca0eb9ca7f930b964 [id=d4b83cc485804e15b1cca7074bd9a910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.231863 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0da7bbfbaf248d78156192ee4baa5b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.232532 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b4494b7e895454f81fef308950729ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:05.232847 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet f46f45a0a13b4e05802a08880d7f6a01 with delete_type TABLET_DATA_DELETED (replaced by tablet b594c65e18d94d1dba45b34dc520823c) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:05.233518 6779 raft_consensus.cc:493] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.233646 6779 raft_consensus.cc:515] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.234727 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e730a00ad2e646a4ba594ba9434c3b50" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.235543 6779 leader_election.cc:290] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.235877 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet a6596ed8c4d44ad58a7ec495a665d1e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:05.235893 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca5b5f9ca1e44eb8cc8bb9e1ff11102" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.236188 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a9f864e4274666a86baed43e1623cd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.236340 5249 raft_consensus.cc:2468] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:05.236420 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 58d9274ad0934f19a7c36325eee3dd59 with delete_type TABLET_DATA_DELETED (replaced by tablet 0dbdc347bc9845b2b577f551577d070b) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:05.236945 7098 tablet_replica.cc:333] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:05.237217 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 5aed7fe630f64213846ad37d904f6516 (table default.Table_f439e2a6434440ef981d41bcd6ef33c1 [id=a57ba63945bb44e6a950410b44233523]) successfully deleted
I20260927 13:50:05.237548 5241 raft_consensus.cc:3060] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.238241 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8c3b0f8fa64faca825311f0b46237f (DEFAULT_TABLE table=default.Table_65dc116e5f0344ce81993d560de66aa0 [id=90838db7424349b49570981575c98363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.238695 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8c3b0f8fa64faca825311f0b46237f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.241760 7190 ts_tablet_manager.cc:1929] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:05.244057 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]). Expected version 1 got 0
I20260927 13:50:05.241991 5246 raft_consensus.cc:3060] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.242049 5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e730a00ad2e646a4ba594ba9434c3b50" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.245373 5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e1acd618fc44be9169fa1d56fa510a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:05.245509 5240 raft_consensus.cc:3060] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.242714 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54cf8c485324f798d59edf65d52d7b5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.242791 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d85213c05c465abda78cc49c70d36f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.249416 7111 tablet_replica.cc:333] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:05.249647 7111 raft_consensus.cc:2243] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:05.249815 7111 pending_rounds.cc:70] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:50:05.249866 7111 pending_rounds.cc:77] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7333957652264820736 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "60de1c28618f4e478aae68ad07fbcf98" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_4ce714062e7c4acf8c4945dc787ca610" dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" new_extra_config { } }
W20260927 13:50:05.250216 7111 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35946: Aborted: Op aborted
I20260927 13:50:05.250913 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.251163 6896 consensus_queue.cc:1048] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:05.251629 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e730a00ad2e646a4ba594ba9434c3b50" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:05.255079 5240 raft_consensus.cc:2468] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:05.257241 7111 raft_consensus.cc:2272] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.258773 7111 ts_tablet_manager.cc:1916] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.259306 5626 tablet_bootstrap.cc:654] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.250643 5619 tablet_bootstrap.cc:492] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:05.261054 5619 tablet_bootstrap.cc:654] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.243156 7190 log.cc:1199] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/60de1c28618f4e478aae68ad07fbcf98
I20260927 13:50:05.244869 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:05.265305 7190 ts_tablet_manager.cc:1950] T 60de1c28618f4e478aae68ad07fbcf98 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:05.266265 7190 tablet_replica.cc:333] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:05.266464 7190 raft_consensus.cc:2243] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:05.266638 7190 raft_consensus.cc:2272] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.267189 7190 ts_tablet_manager.cc:1916] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:05.285909 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 38a34074d833424bae6035d9e437ad3e because the tablet was not found. No further retry: Not found: Tablet not found: 38a34074d833424bae6035d9e437ad3e
I20260927 13:50:05.286501 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_954f47d3ef8846b8ade030d87002460e [id=750521adcb384c75841d7e1ff89af83d]). Expected version 2 got 0
I20260927 13:50:05.287338 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]). Expected version 1 got 0
I20260927 13:50:05.289621 5619 tablet_bootstrap.cc:492] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:05.293781 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_6ac0611179c743808ff8a129f463dd61 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 3 got 0
I20260927 13:50:05.295643 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]). Expected version 3 got 0
I20260927 13:50:05.297286 5619 ts_tablet_manager.cc:1403] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.000s
I20260927 13:50:05.304484 5350 tablet_service.cc:1511] Processing CreateTablet for tablet c4211f416028480b82bfa19d53876a50 (DEFAULT_TABLE table=default.Table_3272a4a26c764ccfa98301a594aacfba [id=05b90438d57a494d8abf553d5adf1a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.304921 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4211f416028480b82bfa19d53876a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.299362 6449 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_22e17296fde940779eb9160306ff386d" } new_table_name: "default.Table_5c96e3711de04429a590499eb47d5784" modify_external_catalogs: true
I20260927 13:50:05.306452 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 90fb369fec2d43149080ab2ad94ecc57 (table default.Table_7b19583e86df4689a2e40ce5a9148e19 [id=23ffbb0d3240465cb12a09ffec1f8163]). Expected version 1 got 0
I20260927 13:50:05.302593 6453 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f" } new_table_name: "default.Table_5bade20242f84b61b8c6a9639fe4d9a6" modify_external_catalogs: true
I20260927 13:50:05.307432 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 95726f690a71433ca63f95da4ee750e5 (table default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e]) successfully deleted
I20260927 13:50:05.306932 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]). Expected version 1 got 0
W20260927 13:50:05.308003 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 992bf643dee64bccaa993a08027aa5fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 992bf643dee64bccaa993a08027aa5fc already in progress: creating tablet
I20260927 13:50:05.308229 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 564f5c92bf144fa1bfc2e1e07132dd69 (table default.Table_b927618f29db4aa49333c257a59c9aa3 [id=c81f7b3016144fd7a7329fbf31049d93]). Expected version 1 got 0
I20260927 13:50:05.309010 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]). Expected version 1 got 0
I20260927 13:50:05.309194 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]). Expected version 2 got 0
I20260927 13:50:05.309514 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]). Expected version 2 got 0
I20260927 13:50:05.322914 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a4099c41981f46758a8f478d7fdb4182 (table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]). Expected version 1 got 0
I20260927 13:50:05.323560 5619 raft_consensus.cc:359] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.323793 5619 raft_consensus.cc:385] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.323843 5619 raft_consensus.cc:740] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.256373 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 75e31315ff0a4294b53ee2cd27d77acb (DEFAULT_TABLE table=default.Table_a061fe9a0f414f838517412afe01641f [id=6bf846307d4d4aa5b601afaa48b75db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.263316 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715b9af057f6425eb664e2399677890f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:05.266609 5073 tablet_service.cc:1511] Processing CreateTablet for tablet 215e8527403d4cefae6ba55ac3292ed5 (DEFAULT_TABLE table=default.Table_a70fd3b1b9fc480586fd49c1d4cc00c6 [id=9691385a15f84e8ab52a6577c9312d81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.325134 7098 raft_consensus.cc:2243] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:05.325196 5109 raft_consensus.cc:2393] T 715b9af057f6425eb664e2399677890f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:05.325296 7098 raft_consensus.cc:2272] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.325377 5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 215e8527403d4cefae6ba55ac3292ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.325583 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e31315ff0a4294b53ee2cd27d77acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.268750 5078 tablet_service.cc:1511] Processing CreateTablet for tablet b5c6369b55e2419184f7e8159f555660 (DEFAULT_TABLE table=default.Table_2ce0e4a2f8844a6e8c93e8e94551bd4d [id=ac4d18e9079d467e9cf4769d6dacda71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.325830 7098 ts_tablet_manager.cc:1916] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.325886 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c6369b55e2419184f7e8159f555660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.327378 7190 ts_tablet_manager.cc:1929] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:05.327487 7190 log.cc:1199] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/2b082227264e442a8b1db7a68fb0c3eb
I20260927 13:50:05.328488 5364 tablet_service.cc:1511] Processing CreateTablet for tablet 193e5d1a257f4600a29cb5e46128f456 (DEFAULT_TABLE table=default.Table_46120fb594064efdb49bfbe4e64d3598 [id=1584101ee2f244a9ad0f71330b76f54e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.328888 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193e5d1a257f4600a29cb5e46128f456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.271382 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 0c63fdf379b540138e37344f4bc68b19 (DEFAULT_TABLE table=default.Table_8e016376cfaf4dd299110321dbf67554 [id=bab5c4c4c5f64604bf3a7a01da6f15c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.330364 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c63fdf379b540138e37344f4bc68b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.334184 5619 consensus_queue.cc:260] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.335480 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 32ca9090b94e410ba02e9dfae8026b1e (DEFAULT_TABLE table=default.Table_5e9055a0823846ddae6164cecbf5a882 [id=154506f9cdea4a50a78c108ece75d78e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.335903 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ca9090b94e410ba02e9dfae8026b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.336935 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:05.337756 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 2cc7301d09b245328a851a0734669965 (table default.Table_7a5a607e5463433eb93aedb9f76696db [id=1f268483d3c7447abfe7a024dd0aec58]). Expected version 1 got 0
I20260927 13:50:05.338636 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]). Expected version 1 got 0
I20260927 13:50:05.339593 5619 ts_tablet_manager.cc:1434] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.041s user 0.002s sys 0.000s
I20260927 13:50:05.340559 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:05.340981 7190 ts_tablet_manager.cc:1950] T 2b082227264e442a8b1db7a68fb0c3eb P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:05.343889 5070 tablet_service.cc:1511] Processing CreateTablet for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6 (DEFAULT_TABLE table=default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.344398 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.345075 5619 tablet_bootstrap.cc:492] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:05.345335 5364 tablet_service.cc:1511] Processing CreateTablet for tablet c0da7bbfbaf248d78156192ee4baa5b1 (DEFAULT_TABLE table=default.Table_17de044576d64b0ca0eb9ca7f930b964 [id=d4b83cc485804e15b1cca7074bd9a910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.345790 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0da7bbfbaf248d78156192ee4baa5b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.346222 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]). Expected version 1 got 0
I20260927 13:50:05.347048 5619 tablet_bootstrap.cc:654] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.347779 7190 tablet_replica.cc:333] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:05.348260 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 97b46497d8254a248df8d421d0b09d8d (table default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815]). Expected version 1 got 0
I20260927 13:50:05.349483 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]). Expected version 2 got 0
I20260927 13:50:05.350688 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]). Expected version 1 got 0
I20260927 13:50:05.352993 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]). Expected version 1 got 0
I20260927 13:50:05.354081 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]). Expected version 1 got 0
I20260927 13:50:05.358860 5082 tablet_service.cc:1511] Processing CreateTablet for tablet c52e4368561e4da49c7a5cc0ecc93bc1 (DEFAULT_TABLE table=default.Table_82bed47438394acea3b96b95d18f862e [id=6153f7dbd45344fcab7747b14601fddc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.359032 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 75e31315ff0a4294b53ee2cd27d77acb (DEFAULT_TABLE table=default.Table_a061fe9a0f414f838517412afe01641f [id=6bf846307d4d4aa5b601afaa48b75db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.359277 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52e4368561e4da49c7a5cc0ecc93bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.359412 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e31315ff0a4294b53ee2cd27d77acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.362576 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]). Expected version 1 got 0
I20260927 13:50:05.363197 5086 tablet_service.cc:1511] Processing CreateTablet for tablet e77aba9467864ad7ac9c1931c2162eef (DEFAULT_TABLE table=default.Table_1b2791929bad4aaea7fcd8e2b206334d [id=03a2b911229f4ca989e3c0a76374ddb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.363556 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77aba9467864ad7ac9c1931c2162eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.366514 5365 tablet_service.cc:1511] Processing CreateTablet for tablet b5c6369b55e2419184f7e8159f555660 (DEFAULT_TABLE table=default.Table_2ce0e4a2f8844a6e8c93e8e94551bd4d [id=ac4d18e9079d467e9cf4769d6dacda71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.366604 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]). Expected version 1 got 0
I20260927 13:50:05.366884 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c6369b55e2419184f7e8159f555660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.367596 5080 tablet_service.cc:1511] Processing CreateTablet for tablet a128a8934b4f47969fc1f8e75d00ea68 (DEFAULT_TABLE table=default.Table_60c8613aadad4742b6ede2feb6f3d1a6 [id=ac4f364858e64745a7e3b68c8af7b5d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.367687 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]). Expected version 1 got 0
I20260927 13:50:05.367954 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a128a8934b4f47969fc1f8e75d00ea68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.367921 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]). Expected version 1 got 0
I20260927 13:50:05.368096 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]). Expected version 1 got 0
I20260927 13:50:05.368383 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 9e808336f5b746d486d375695536c052 (table default.Table_36609f3408124349b504ae9eb3275d87 [id=d088563f44224b01a3eba63ce70e5681]). Expected version 1 got 0
I20260927 13:50:05.368678 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 187b3ceeccb142c4b798947e584d6044 (table default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82]). Expected version 1 got 0
I20260927 13:50:05.369002 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]). Expected version 2 got 0
I20260927 13:50:05.369166 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
I20260927 13:50:05.369362 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]). Expected version 1 got 0
I20260927 13:50:05.369596 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
I20260927 13:50:05.369798 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]). Expected version 1 got 0
I20260927 13:50:05.371924 7016 raft_consensus.cc:493] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.372043 7016 raft_consensus.cc:515] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.372690 7016 leader_election.cc:290] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.373299 7111 ts_tablet_manager.cc:1929] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:50:05.373417 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 215e8527403d4cefae6ba55ac3292ed5 (DEFAULT_TABLE table=default.Table_a70fd3b1b9fc480586fd49c1d4cc00c6 [id=9691385a15f84e8ab52a6577c9312d81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.373780 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 215e8527403d4cefae6ba55ac3292ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.374322 5619 tablet_bootstrap.cc:492] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:05.374480 5619 ts_tablet_manager.cc:1403] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.001s
I20260927 13:50:05.378944 5082 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4c2377b3e44eeb9830affa3ba8b788 (DEFAULT_TABLE table=default.Table_55bbacce10ca46659231c8bd691d7cef [id=d6cace8288b04d52b87823ce04aab0b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.379493 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4c2377b3e44eeb9830affa3ba8b788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.380726 5361 tablet_service.cc:1511] Processing CreateTablet for tablet d2400a1cbeb34308ad7dd08972b674b2 (DEFAULT_TABLE table=default.Table_58d22b166d164bd7baa193ee9ccae8ff [id=c2ad020146d44fdba457c196fb8df980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.381103 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2400a1cbeb34308ad7dd08972b674b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.279240 6779 raft_consensus.cc:493] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.384842 6779 raft_consensus.cc:515] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.385775 5360 tablet_service.cc:1511] Processing CreateTablet for tablet f544d1ca2c5943359031ad5d0c289935 (DEFAULT_TABLE table=default.Table_b952c6ebeaf8497899bffc38582cb9cb [id=54f0895db9ea46fb9e291d509ebe5b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.386147 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f544d1ca2c5943359031ad5d0c289935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.386253 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 0c63fdf379b540138e37344f4bc68b19 (DEFAULT_TABLE table=default.Table_8e016376cfaf4dd299110321dbf67554 [id=bab5c4c4c5f64604bf3a7a01da6f15c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.386550 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c63fdf379b540138e37344f4bc68b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.388172 5619 raft_consensus.cc:359] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.388379 5619 raft_consensus.cc:385] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.388437 5619 raft_consensus.cc:740] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.388629 5619 consensus_queue.cc:260] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.390380 5352 tablet_service.cc:1511] Processing CreateTablet for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6 (DEFAULT_TABLE table=default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.390676 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.394377 5354 tablet_service.cc:1511] Processing CreateTablet for tablet c52e4368561e4da49c7a5cc0ecc93bc1 (DEFAULT_TABLE table=default.Table_82bed47438394acea3b96b95d18f862e [id=6153f7dbd45344fcab7747b14601fddc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.394692 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52e4368561e4da49c7a5cc0ecc93bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.398448 5356 tablet_service.cc:1511] Processing CreateTablet for tablet e77aba9467864ad7ac9c1931c2162eef (DEFAULT_TABLE table=default.Table_1b2791929bad4aaea7fcd8e2b206334d [id=03a2b911229f4ca989e3c0a76374ddb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.398780 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77aba9467864ad7ac9c1931c2162eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.402433 5349 tablet_service.cc:1511] Processing CreateTablet for tablet a128a8934b4f47969fc1f8e75d00ea68 (DEFAULT_TABLE table=default.Table_60c8613aadad4742b6ede2feb6f3d1a6 [id=ac4f364858e64745a7e3b68c8af7b5d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.402828 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a128a8934b4f47969fc1f8e75d00ea68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.404615 5619 ts_tablet_manager.cc:1434] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.030s user 0.001s sys 0.002s
I20260927 13:50:05.406332 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]). Expected version 1 got 0
W20260927 13:50:05.406492 6427 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 90fb369fec2d43149080ab2ad94ecc57 (table default.Table_7b19583e86df4689a2e40ce5a9148e19 [id=23ffbb0d3240465cb12a09ffec1f8163], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 90fb369fec2d43149080ab2ad94ecc57 consensus state has no leader
I20260927 13:50:05.407079 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
I20260927 13:50:05.407410 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:05.407660 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:05.408241 6779 leader_election.cc:290] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.408488 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
I20260927 13:50:05.408789 6793 raft_consensus.cc:493] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.408869 6442 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 0d54e51b5c104c75b938aba55cecf890 (table default.Table_a02033f4b12c4cdd986cd855cb148309 [id=0c14f160c8ab4321b14a35fc5f8d3b56]). Expected version 1 got 0
I20260927 13:50:05.408919 6793 raft_consensus.cc:515] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.409492 6451 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 362f660cac76436aba54bb707d8a991c
I20260927 13:50:05.410446 6451 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_406a7314de1d4a08a6842bc717404371" } new_table_name: "default.Table_c74dcd01d43b41babf48734ca8244f9f" modify_external_catalogs: true
I20260927 13:50:05.413398 6793 leader_election.cc:290] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.413487 5074 tablet_service.cc:1511] Processing CreateTablet for tablet ad2b4316eeb643cc8c2440ed04191a57 (DEFAULT_TABLE table=default.Table_e349439f77f540cd8fc369d3f4217757 [id=740644d5da164e1f99a37b02ab614292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.414001 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2b4316eeb643cc8c2440ed04191a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.414608 5348 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4c2377b3e44eeb9830affa3ba8b788 (DEFAULT_TABLE table=default.Table_55bbacce10ca46659231c8bd691d7cef [id=d6cace8288b04d52b87823ce04aab0b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.415628 5319 leader_election.cc:304] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:05.415930 7125 raft_consensus.cc:2749] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:05.404914 5619 tablet_bootstrap.cc:492] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:05.423110 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 362f660cac76436aba54bb707d8a991c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:05.423758 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 07830b76d7e14ff0b6b1b1523dda21bc (DEFAULT_TABLE table=default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.424296 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07830b76d7e14ff0b6b1b1523dda21bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.433864 5074 tablet_service.cc:1511] Processing CreateTablet for tablet 6657ff16861043daa2652597bcf26271 (DEFAULT_TABLE table=default.Table_db70ad184fab4e5984d1777fecae5518 [id=c6230203df764e97a3fd3c8117177db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.433933 5088 tablet_service.cc:1511] Processing CreateTablet for tablet fc25ff5c6a3545759e7de977f91a9453 (DEFAULT_TABLE table=default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.434448 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc25ff5c6a3545759e7de977f91a9453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.438776 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0597e8f5ba4bc6b54850f0d1a13954 (DEFAULT_TABLE table=default.Table_9e90cb3d6f55432795b8bcde5584712a [id=a4c98ec66922406aa2d944c9ff95f7d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.441279 6882 raft_consensus.cc:493] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.441460 6882 raft_consensus.cc:515] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:05.446071 5319 leader_election.cc:343] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 4b13c629908a47368846770c697aebd8
I20260927 13:50:05.373428 7111 log.cc:1199] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/60de1c28618f4e478aae68ad07fbcf98
I20260927 13:50:05.446204 5319 leader_election.cc:304] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:50:05.456125 5319 raft_consensus.cc:2686] T 4b13c629908a47368846770c697aebd8 P bb28c54312c94d7dafb1c2abf7870735: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:50:05.449384 7111 ts_tablet_manager.cc:1950] T 60de1c28618f4e478aae68ad07fbcf98 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:05.448724 6882 leader_election.cc:290] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.455476 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4c2377b3e44eeb9830affa3ba8b788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.456869 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0597e8f5ba4bc6b54850f0d1a13954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.458271 5619 tablet_bootstrap.cc:654] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.471398 6896 raft_consensus.cc:493] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.471542 6896 raft_consensus.cc:515] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.472031 6896 leader_election.cc:290] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.472640 5225 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b4494b7e895454f81fef308950729ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:05.472745 5210 tablet_service.cc:1558] Processing DeleteTablet for tablet f46f45a0a13b4e05802a08880d7f6a01 with delete_type TABLET_DATA_DELETED (replaced by tablet b594c65e18d94d1dba45b34dc520823c) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:05.473078 5210 tablet_service.cc:1558] Processing DeleteTablet for tablet a6596ed8c4d44ad58a7ec495a665d1e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:05.473500 5210 tablet_service.cc:1558] Processing DeleteTablet for tablet 58d9274ad0934f19a7c36325eee3dd59 with delete_type TABLET_DATA_DELETED (replaced by tablet 0dbdc347bc9845b2b577f551577d070b) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:05.474344 5210 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8c3b0f8fa64faca825311f0b46237f (DEFAULT_TABLE table=default.Table_65dc116e5f0344ce81993d560de66aa0 [id=90838db7424349b49570981575c98363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.474869 5210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8c3b0f8fa64faca825311f0b46237f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.438086 7098 ts_tablet_manager.cc:1929] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:05.487887 7098 log.cc:1199] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/bb7b3a35b2e94bbea6be4b4a8f158593
I20260927 13:50:05.488476 7098 ts_tablet_manager.cc:1950] T bb7b3a35b2e94bbea6be4b4a8f158593 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:05.438673 5082 tablet_service.cc:1511] Processing CreateTablet for tablet bfebdee6f9ce49ccb64b8d0feb78bfea (DEFAULT_TABLE table=default.Table_d6067ca7e0a04380a6629bf8edeb93d9 [id=995d3ab30eb749c1bc495b8aca68a910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.488956 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 79) took 1122 ms. Trace:
I20260927 13:50:05.489135 7098 rpcz_store.cc:276] 0927 13:50:04.366009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.525349 (+159340us) service_pool.cc:224] Handling call
0927 13:50:05.236894 (+711545us) ts_tablet_manager.cc:1151] Deleting tablet bb7b3a35b2e94bbea6be4b4a8f158593
0927 13:50:05.236907 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:05.357909 (+121002us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.438040 (+ 80131us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.488934 (+ 50894us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":711415}
I20260927 13:50:05.489957 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet bb7b3a35b2e94bbea6be4b4a8f158593 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]) successfully deleted
I20260927 13:50:05.443517 5083 tablet_service.cc:1511] Processing CreateTablet for tablet e70f64e0b71a481d8b3b1aafafa0c65a (DEFAULT_TABLE table=default.Table_4f0c853ca7b6461a8c933b047b632834 [id=b9412018f6cc4e9c8e8091d38d62f1e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.445266 5080 tablet_service.cc:1511] Processing CreateTablet for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc (DEFAULT_TABLE table=default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.444751 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 7064ca91a1154aed87e679794c1739c6 (DEFAULT_TABLE table=default.Table_47c17bb336c34c678a4dfe8ada8a1d95 [id=f66668ed3988492b958d26785ababc44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.445454 5078 tablet_service.cc:1511] Processing CreateTablet for tablet a583d84f0f9247c68f330149b41e65ae (DEFAULT_TABLE table=default.Table_789c5549472f4bf8ab1581eb3903953a [id=1af7add99a3441a5888daac021a65214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.445628 5072 tablet_service.cc:1511] Processing CreateTablet for tablet f544d1ca2c5943359031ad5d0c289935 (DEFAULT_TABLE table=default.Table_b952c6ebeaf8497899bffc38582cb9cb [id=54f0895db9ea46fb9e291d509ebe5b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.438827 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6657ff16861043daa2652597bcf26271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.491873 5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfebdee6f9ce49ccb64b8d0feb78bfea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.444437 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 06b645b4ac5a4597b5d2028dd711f9b6 (DEFAULT_TABLE table=default.Table_cd89222a85234585a71b762f7e592e9f [id=d5451e93d6264995a3e1fdda623d9908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.494477 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b645b4ac5a4597b5d2028dd711f9b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:05.494695 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 48630.9us
W20260927 13:50:05.495085 5319 leader_election.cc:343] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 51e1acd618fc44be9169fa1d56fa510a
I20260927 13:50:05.495858 6882 consensus_queue.cc:1048] T e5b04acc39f3436384fbb69cebdc35cd P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:05.496342 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70f64e0b71a481d8b3b1aafafa0c65a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.498225 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7064ca91a1154aed87e679794c1739c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.502214 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.510428 5078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a583d84f0f9247c68f330149b41e65ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.514217 5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f544d1ca2c5943359031ad5d0c289935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.518769 7098 tablet_replica.cc:333] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:05.519001 7098 raft_consensus.cc:2243] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:05.519177 7098 raft_consensus.cc:2272] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.519716 7098 ts_tablet_manager.cc:1916] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.532855 7111 tablet_replica.cc:333] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:05.533159 7111 raft_consensus.cc:2243] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:05.533378 7111 pending_rounds.cc:70] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:50:05.533437 7111 pending_rounds.cc:77] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7333957652377939968 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "36181512a94c4702ae0a417665919faa" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_06b04cbe300b4373813df57694d32684" dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" new_extra_config { } }
W20260927 13:50:05.533773 7111 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35946: Aborted: Op aborted
I20260927 13:50:05.534363 7190 raft_consensus.cc:2243] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:05.534809 7190 pending_rounds.cc:70] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:50:05.534888 7190 pending_rounds.cc:77] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7333957652377939968 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "36181512a94c4702ae0a417665919faa" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_06b04cbe300b4373813df57694d32684" dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" new_extra_config { } }
I20260927 13:50:05.535331 7190 raft_consensus.cc:2272] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.536646 7111 raft_consensus.cc:2272] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.538487 7111 ts_tablet_manager.cc:1916] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:05.539613 5044 leader_election.cc:343] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.539739 5044 leader_election.cc:304] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:05.540231 6451 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6b1e7169cdd4f6b8dced0a807bc17e8 has no consensus state
I20260927 13:50:05.540623 6451 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_a4d76e32d0c349abafc8f800e4acb8c7" } new_table_name: "default.Table_6d795d7a66ee42f3a7fb0cef447cddba" modify_external_catalogs: true
I20260927 13:50:05.540743 6779 raft_consensus.cc:2749] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:05.541870 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715b9af057f6425eb664e2399677890f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.545349 5210 tablet_service.cc:1511] Processing CreateTablet for tablet d2400a1cbeb34308ad7dd08972b674b2 (DEFAULT_TABLE table=default.Table_58d22b166d164bd7baa193ee9ccae8ff [id=c2ad020146d44fdba457c196fb8df980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.545972 5210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2400a1cbeb34308ad7dd08972b674b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.546728 7111 ts_tablet_manager.cc:1929] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:50:05.546840 7111 log.cc:1199] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/36181512a94c4702ae0a417665919faa
I20260927 13:50:05.547197 7111 ts_tablet_manager.cc:1950] T 36181512a94c4702ae0a417665919faa P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:05.548348 7111 tablet_replica.cc:333] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:05.548548 7111 raft_consensus.cc:2243] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:05.548702 7111 pending_rounds.cc:70] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:50:05.548777 7111 pending_rounds.cc:77] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7333957652378472448 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "f46f45a0a13b4e05802a08880d7f6a01" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_e969ed1c04384e2cbafb90d72cbdef52" dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" new_extra_config { } }
W20260927 13:50:05.548985 7111 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35946: Aborted: Op aborted
I20260927 13:50:05.549216 7111 raft_consensus.cc:2272] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.550931 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]). Expected version 2 got 0
I20260927 13:50:05.551544 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_cfdab7814ecc495089389612e0a7e4fe [id=ae170bbebc4e460fb58beb7f95f013a2]). Expected version 2 got 0
I20260927 13:50:05.551868 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]). Expected version 2 got 0
I20260927 13:50:05.552238 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]). Expected version 1 got 0
I20260927 13:50:05.552561 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_954f47d3ef8846b8ade030d87002460e [id=750521adcb384c75841d7e1ff89af83d]). Expected version 2 got 0
I20260927 13:50:05.553081 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]). Expected version 1 got 0
I20260927 13:50:05.553385 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]). Expected version 1 got 0
I20260927 13:50:05.553815 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:50:05.555141 5628 tablet_bootstrap.cc:492] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:05.555298 5628 ts_tablet_manager.cc:1403] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.336s user 0.005s sys 0.006s
I20260927 13:50:05.555472 6455 catalog_manager.cc:5838] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:50:05.556401 5628 raft_consensus.cc:359] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.556602 5628 raft_consensus.cc:385] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.556667 5628 raft_consensus.cc:740] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.556888 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_6ac0611179c743808ff8a129f463dd61 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 3 got 0
I20260927 13:50:05.556932 5628 consensus_queue.cc:260] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.557458 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:50:05.558904 5628 ts_tablet_manager.cc:1434] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:50:05.561071 5211 tablet_service.cc:1511] Processing CreateTablet for tablet 32ca9090b94e410ba02e9dfae8026b1e (DEFAULT_TABLE table=default.Table_5e9055a0823846ddae6164cecbf5a882 [id=154506f9cdea4a50a78c108ece75d78e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.561448 5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ca9090b94e410ba02e9dfae8026b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.562611 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]). Expected version 3 got 0
I20260927 13:50:05.563086 5628 tablet_bootstrap.cc:492] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:05.563531 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]). Expected version 1 got 0
I20260927 13:50:05.565630 5626 tablet_bootstrap.cc:492] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:05.565836 5626 ts_tablet_manager.cc:1403] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.340s user 0.028s sys 0.036s
I20260927 13:50:05.561071 5225 tablet_service.cc:1511] Processing CreateTablet for tablet c4211f416028480b82bfa19d53876a50 (DEFAULT_TABLE table=default.Table_3272a4a26c764ccfa98301a594aacfba [id=05b90438d57a494d8abf553d5adf1a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.566640 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4211f416028480b82bfa19d53876a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.568761 6455 catalog_manager.cc:5838] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:50:05.569548 5619 tablet_bootstrap.cc:492] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:05.569674 5619 ts_tablet_manager.cc:1403] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.165s user 0.003s sys 0.011s
I20260927 13:50:05.570437 5619 raft_consensus.cc:359] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.570619 5619 raft_consensus.cc:385] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.570680 5619 raft_consensus.cc:740] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.570713 5628 tablet_bootstrap.cc:654] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.570899 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]). Expected version 5 got 0
I20260927 13:50:05.570920 5619 consensus_queue.cc:260] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.572429 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 90fb369fec2d43149080ab2ad94ecc57 (table default.Table_7b19583e86df4689a2e40ce5a9148e19 [id=23ffbb0d3240465cb12a09ffec1f8163]). Expected version 1 got 0
I20260927 13:50:05.573513 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
I20260927 13:50:05.566653 5626 raft_consensus.cc:359] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.575132 5626 raft_consensus.cc:385] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.575235 5626 raft_consensus.cc:740] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.575490 5626 consensus_queue.cc:260] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.576151 5626 ts_tablet_manager.cc:1434] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.010s user 0.000s sys 0.001s
I20260927 13:50:05.576757 5211 tablet_service.cc:1511] Processing CreateTablet for tablet 193e5d1a257f4600a29cb5e46128f456 (DEFAULT_TABLE table=default.Table_46120fb594064efdb49bfbe4e64d3598 [id=1584101ee2f244a9ad0f71330b76f54e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.577212 5626 tablet_bootstrap.cc:492] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:05.578840 5626 tablet_bootstrap.cc:654] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.580793 7111 ts_tablet_manager.cc:1916] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.581903 5619 ts_tablet_manager.cc:1434] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260927 13:50:05.582270 5619 tablet_bootstrap.cc:492] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:05.583251 7125 raft_consensus.cc:493] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.583392 7125 raft_consensus.cc:515] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.583540 7098 ts_tablet_manager.cc:1929] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:05.583645 7098 log.cc:1199] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b3fbf1e7f5e04122a65f6e192ffdae20
I20260927 13:50:05.583952 7098 ts_tablet_manager.cc:1950] T b3fbf1e7f5e04122a65f6e192ffdae20 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:05.584025 7125 leader_election.cc:290] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.584100 5619 tablet_bootstrap.cc:654] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:05.589046 5044 leader_election.cc:343] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.589167 5044 leader_election.cc:304] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:05.589514 6779 raft_consensus.cc:2749] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:05.589830 5044 leader_election.cc:343] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.589922 5044 leader_election.cc:304] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:05.590242 6779 raft_consensus.cc:2749] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:05.590559 5044 leader_election.cc:343] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:05.590914 5044 leader_election.cc:343] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.591010 5044 leader_election.cc:304] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:05.591291 6779 raft_consensus.cc:2749] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:05.592005 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 96310.6us
I20260927 13:50:05.592339 6882 consensus_queue.cc:1048] T b044fbc166e848f39d17b63db69f63a4 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:05.594084 5319 leader_election.cc:304] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:05.595345 7125 raft_consensus.cc:2804] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:05.595435 7125 raft_consensus.cc:493] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:05.595508 7125 raft_consensus.cc:3060] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:05.595654 5044 leader_election.cc:343] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:05.596633 5044 leader_election.cc:343] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:05.597283 5044 leader_election.cc:343] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:05.598702 5044 leader_election.cc:343] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.599114 5044 leader_election.cc:304] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:05.599136 7125 raft_consensus.cc:515] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.599391 6779 raft_consensus.cc:2804] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:05.599517 6779 raft_consensus.cc:493] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:05.599629 6779 raft_consensus.cc:3060] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.599944 7125 leader_election.cc:290] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.601476 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 564f5c92bf144fa1bfc2e1e07132dd69 (table default.Table_b927618f29db4aa49333c257a59c9aa3 [id=c81f7b3016144fd7a7329fbf31049d93]). Expected version 1 got 0
I20260927 13:50:05.602694 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]). Expected version 1 got 0
I20260927 13:50:05.603065 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]). Expected version 1 got 0
I20260927 13:50:05.603536 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
I20260927 13:50:05.604918 7125 consensus_queue.cc:1048] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:05.607077 5319 leader_election.cc:304] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:05.607366 7125 raft_consensus.cc:2804] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:05.607481 7125 raft_consensus.cc:493] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:05.607597 7125 raft_consensus.cc:3060] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.608956 6779 raft_consensus.cc:515] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:05.611181 5157 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:05.611125 7125 raft_consensus.cc:515] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:05.611505 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 0d54e51b5c104c75b938aba55cecf890 (table default.Table_a02033f4b12c4cdd986cd855cb148309 [id=0c14f160c8ab4321b14a35fc5f8d3b56]). Expected version 1 got 0
I20260927 13:50:05.611752 7125 leader_election.cc:290] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:05.612545 5319 leader_election.cc:304] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:05.612876 5319 leader_election.cc:304] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:05.613350 6882 raft_consensus.cc:2804] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:05.614589 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]). Expected version 1 got 0
I20260927 13:50:05.614744 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]). Expected version 2 got 0
I20260927 13:50:05.614904 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]). Expected version 1 got 0
I20260927 13:50:05.615367 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 9e808336f5b746d486d375695536c052 (table default.Table_36609f3408124349b504ae9eb3275d87 [id=d088563f44224b01a3eba63ce70e5681]). Expected version 1 got 0
I20260927 13:50:05.615564 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]). Expected version 1 got 0
I20260927 13:50:05.615686 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]). Expected version 1 got 0
I20260927 13:50:05.615973 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]). Expected version 2 got 0
I20260927 13:50:05.616132 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]). Expected version 1 got 0
I20260927 13:50:05.616472 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_b68a6b76e8684ab9ab1e52fbfaad3740 [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 2 got 0
I20260927 13:50:05.616778 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]). Expected version 1 got 0
I20260927 13:50:05.617101 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]). Expected version 2 got 0
I20260927 13:50:05.617276 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]). Expected version 1 got 0
I20260927 13:50:05.617352 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 80) took 1250 ms. Trace:
I20260927 13:50:05.617444 7098 rpcz_store.cc:276] 0927 13:50:04.366397 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.525487 (+159090us) service_pool.cc:224] Handling call
0927 13:50:05.518708 (+993221us) ts_tablet_manager.cc:1151] Deleting tablet b3fbf1e7f5e04122a65f6e192ffdae20
0927 13:50:05.518719 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:05.547967 (+ 29248us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.583485 (+ 35518us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.617331 (+ 33846us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":993055}
I20260927 13:50:05.617637 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_e443efbf29f74ac2ba4ae6894ad2ed5f [id=a160103a454d421c8be6a88afa7c1419]). Expected version 1 got 0
I20260927 13:50:05.617807 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:05.617951 7098 tablet_replica.cc:333] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:05.618160 7098 raft_consensus.cc:2243] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:05.618326 7098 raft_consensus.cc:2272] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.618326 7016 raft_consensus.cc:493] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.618508 7016 raft_consensus.cc:515] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.618958 7098 ts_tablet_manager.cc:1916] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.619055 7016 leader_election.cc:290] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.622711 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b3fbf1e7f5e04122a65f6e192ffdae20 (table default.Table_3614a1889eea43b39d1d94a3211a5473 [id=28c69a82f6db4ae5a5a5f6a608f0c899]) successfully deleted
I20260927 13:50:05.623122 6793 consensus_queue.cc:1048] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:05.623852 6779 leader_election.cc:290] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.625066 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]). Expected version 1 got 0
I20260927 13:50:05.625603 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:50:05.613061 7125 raft_consensus.cc:2804] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:05.626271 7125 raft_consensus.cc:493] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:05.626288 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:05.626449 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 2cc7301d09b245328a851a0734669965 (table default.Table_7a5a607e5463433eb93aedb9f76696db [id=1f268483d3c7447abfe7a024dd0aec58]). Expected version 1 got 0
I20260927 13:50:05.626688 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 187b3ceeccb142c4b798947e584d6044 (table default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82]). Expected version 1 got 0
I20260927 13:50:05.627131 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]). Expected version 1 got 0
I20260927 13:50:05.627226 7125 raft_consensus.cc:3060] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.630872 7125 raft_consensus.cc:515] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.631239 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 97b46497d8254a248df8d421d0b09d8d (table default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815]). Expected version 1 got 0
I20260927 13:50:05.632141 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]). Expected version 1 got 0
I20260927 13:50:05.632735 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]). Expected version 2 got 0
I20260927 13:50:05.581421 5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193e5d1a257f4600a29cb5e46128f456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.633160 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
I20260927 13:50:05.633620 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 5678703b72c8471583147786f49122a5 (table default.Table_f3c5680fa304438d9df88d573453cd6f [id=0d85f9f0d28e43debda43f83a3e59637]). Expected version 2 got 0
I20260927 13:50:05.633987 7098 ts_tablet_manager.cc:1929] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:05.634009 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:05.634073 7098 log.cc:1199] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/ec130d31f6274fd9b730c2bb8bba817e
I20260927 13:50:05.634249 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:05.634428 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:05.581550 7190 ts_tablet_manager.cc:1916] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.634621 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:05.636656 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
I20260927 13:50:05.637046 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:05.639039 5628 tablet_bootstrap.cc:492] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:05.639245 5628 ts_tablet_manager.cc:1403] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.076s user 0.008s sys 0.004s
I20260927 13:50:05.640040 5628 raft_consensus.cc:359] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.640304 5628 raft_consensus.cc:385] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.640367 5628 raft_consensus.cc:740] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.640621 5628 consensus_queue.cc:260] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.641283 5628 ts_tablet_manager.cc:1434] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:05.641811 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
I20260927 13:50:05.644232 5211 tablet_service.cc:1511] Processing CreateTablet for tablet 6657ff16861043daa2652597bcf26271 (DEFAULT_TABLE table=default.Table_db70ad184fab4e5984d1777fecae5518 [id=c6230203df764e97a3fd3c8117177db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.584738 5224 tablet_service.cc:1511] Processing CreateTablet for tablet 75e31315ff0a4294b53ee2cd27d77acb (DEFAULT_TABLE table=default.Table_a061fe9a0f414f838517412afe01641f [id=6bf846307d4d4aa5b601afaa48b75db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.647966 5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e31315ff0a4294b53ee2cd27d77acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.585302 5220 tablet_service.cc:1511] Processing CreateTablet for tablet 215e8527403d4cefae6ba55ac3292ed5 (DEFAULT_TABLE table=default.Table_a70fd3b1b9fc480586fd49c1d4cc00c6 [id=9691385a15f84e8ab52a6577c9312d81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.650391 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 215e8527403d4cefae6ba55ac3292ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.585736 5213 tablet_service.cc:1511] Processing CreateTablet for tablet b5c6369b55e2419184f7e8159f555660 (DEFAULT_TABLE table=default.Table_2ce0e4a2f8844a6e8c93e8e94551bd4d [id=ac4d18e9079d467e9cf4769d6dacda71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.651664 5213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c6369b55e2419184f7e8159f555660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.634459 5319 leader_election.cc:304] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:05.653647 7125 leader_election.cc:290] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.653826 7125 raft_consensus.cc:2804] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:05.653885 7125 raft_consensus.cc:493] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:05.653941 7125 raft_consensus.cc:3060] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.654670 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]). Expected version 1 got 0
I20260927 13:50:05.654963 6455 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]). Expected version 1 got 0
I20260927 13:50:05.586136 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 0c63fdf379b540138e37344f4bc68b19 (DEFAULT_TABLE table=default.Table_8e016376cfaf4dd299110321dbf67554 [id=bab5c4c4c5f64604bf3a7a01da6f15c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.586604 5226 tablet_service.cc:1511] Processing CreateTablet for tablet f544d1ca2c5943359031ad5d0c289935 (DEFAULT_TABLE table=default.Table_b952c6ebeaf8497899bffc38582cb9cb [id=54f0895db9ea46fb9e291d509ebe5b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.586650 5219 tablet_service.cc:1511] Processing CreateTablet for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6 (DEFAULT_TABLE table=default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.587280 5218 tablet_service.cc:1511] Processing CreateTablet for tablet c0da7bbfbaf248d78156192ee4baa5b1 (DEFAULT_TABLE table=default.Table_17de044576d64b0ca0eb9ca7f930b964 [id=d4b83cc485804e15b1cca7074bd9a910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.624732 5222 tablet_service.cc:1511] Processing CreateTablet for tablet c52e4368561e4da49c7a5cc0ecc93bc1 (DEFAULT_TABLE table=default.Table_82bed47438394acea3b96b95d18f862e [id=6153f7dbd45344fcab7747b14601fddc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.625288 5228 tablet_service.cc:1511] Processing CreateTablet for tablet e77aba9467864ad7ac9c1931c2162eef (DEFAULT_TABLE table=default.Table_1b2791929bad4aaea7fcd8e2b206334d [id=03a2b911229f4ca989e3c0a76374ddb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.625722 5227 tablet_service.cc:1511] Processing CreateTablet for tablet a128a8934b4f47969fc1f8e75d00ea68 (DEFAULT_TABLE table=default.Table_60c8613aadad4742b6ede2feb6f3d1a6 [id=ac4f364858e64745a7e3b68c8af7b5d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.626133 5229 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4c2377b3e44eeb9830affa3ba8b788 (DEFAULT_TABLE table=default.Table_55bbacce10ca46659231c8bd691d7cef [id=d6cace8288b04d52b87823ce04aab0b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.655810 5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f544d1ca2c5943359031ad5d0c289935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.626621 5216 tablet_service.cc:1558] Processing DeleteTablet for tablet 362f660cac76436aba54bb707d8a991c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:05.656265 5216 tablet_service.cc:1511] Processing CreateTablet for tablet 7064ca91a1154aed87e679794c1739c6 (DEFAULT_TABLE table=default.Table_47c17bb336c34c678a4dfe8ada8a1d95 [id=f66668ed3988492b958d26785ababc44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.626856 5217 tablet_service.cc:1511] Processing CreateTablet for tablet a583d84f0f9247c68f330149b41e65ae (DEFAULT_TABLE table=default.Table_789c5549472f4bf8ab1581eb3903953a [id=1af7add99a3441a5888daac021a65214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.627004 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 07830b76d7e14ff0b6b1b1523dda21bc (DEFAULT_TABLE table=default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.657333 6442 catalog_manager.cc:6391] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: default.Table_dcdd264dd7c84641aac8566bae2bf8b6 [id=6b9a7948d0b34aa89f9f7c58a2cd2a0e] alter complete (version 2)
I20260927 13:50:05.626627 5221 tablet_service.cc:1511] Processing CreateTablet for tablet bfebdee6f9ce49ccb64b8d0feb78bfea (DEFAULT_TABLE table=default.Table_d6067ca7e0a04380a6629bf8edeb93d9 [id=995d3ab30eb749c1bc495b8aca68a910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.658464 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52e4368561e4da49c7a5cc0ecc93bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.627434 5214 tablet_service.cc:1511] Processing CreateTablet for tablet ad2b4316eeb643cc8c2440ed04191a57 (DEFAULT_TABLE table=default.Table_e349439f77f540cd8fc369d3f4217757 [id=740644d5da164e1f99a37b02ab614292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.627841 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 06b645b4ac5a4597b5d2028dd711f9b6 (DEFAULT_TABLE table=default.Table_cd89222a85234585a71b762f7e592e9f [id=d5451e93d6264995a3e1fdda623d9908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.662346 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77aba9467864ad7ac9c1931c2162eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.662524 5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4c2377b3e44eeb9830affa3ba8b788. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:05.662649 6447 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0fe47041b75d492bbce62c95d90de021 consensus state has no leader
I20260927 13:50:05.665838 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b645b4ac5a4597b5d2028dd711f9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.666455 7098 ts_tablet_manager.cc:1950] T ec130d31f6274fd9b730c2bb8bba817e P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:05.671444 6454 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 269cda0876e346149512e0b4985c6890
I20260927 13:50:05.671813 5215 tablet_service.cc:1511] Processing CreateTablet for tablet fc25ff5c6a3545759e7de977f91a9453 (DEFAULT_TABLE table=default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.672071 6454 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34390 (request call id 73) took 1183 ms. Trace:
I20260927 13:50:05.672168 6454 rpcz_store.cc:276] 0927 13:50:04.489058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.631044 (+141986us) service_pool.cc:224] Handling call
0927 13:50:04.638361 (+ 7317us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00007fe748a7c65d 00007fe748a7c753 00007fe7455f9db1 00007fe74d3eda7d 00007fe74d57de96 00007fe743f4a9d6 00007fe743f4a705 00007fe74064c63e 00007fe74064b51e 00007fe740651758 00007fe7406520bf
0927 13:50:04.638752 (+ 391us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:04.638889 (+ 137us) catalog_manager.cc:2854] Modifying in-memory table state
0927 13:50:04.638959 (+ 70us) catalog_manager.cc:2863] Locking tablets
0927 13:50:04.868115 (+229156us) catalog_manager.cc:2877] Removing table and tablets from system table
0927 13:50:04.920798 (+ 52683us) catalog_manager.cc:2895] Removing table from by-name map
0927 13:50:05.091594 (+170796us) catalog_manager.cc:2911] Committing in-memory state
0927 13:50:05.671390 (+579796us) catalog_manager.cc:2915] Aborting table tasks
0927 13:50:05.672011 (+ 621us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:04.869124 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:04.869281 (+ 157us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:04.869289 (+ 8us) write_op.cc:435] Acquired schema lock
0927 13:50:04.869293 (+ 4us) tablet.cc:662] Decoding operations
0927 13:50:04.869494 (+ 201us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:04.869510 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:04.869518 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:04.869652 (+ 134us) tablet.cc:701] Row locks acquired
0927 13:50:04.869656 (+ 4us) write_op.cc:260] PREPARE: finished
0927 13:50:04.869698 (+ 42us) write_op.cc:270] Start()
0927 13:50:04.869751 (+ 53us) write_op.cc:276] Timestamp: P: 1790517004869658 usec, L: 0
0927 13:50:04.869757 (+ 6us) op_driver.cc:348] REPLICATION: starting
0927 13:50:04.870023 (+ 266us) log.cc:844] Serialized 728 byte log entry
0927 13:50:04.872778 (+ 2755us) op_driver.cc:464] REPLICATION: finished
0927 13:50:04.873573 (+ 795us) write_op.cc:301] APPLY: starting
0927 13:50:04.873595 (+ 22us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:04.873734 (+ 139us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:04.873853 (+ 119us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:04.877786 (+ 3933us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:04.888012 (+ 10226us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:50:04.888035 (+ 23us) write_op.cc:312] APPLY: finished
0927 13:50:04.910303 (+ 22268us) log.cc:844] Serialized 29 byte log entry
0927 13:50:04.913716 (+ 3413us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:04.915742 (+ 2026us) write_op.cc:454] Released schema lock
0927 13:50:04.916700 (+ 958us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:04.926599 (+ 9899us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:04.927719 (+ 1120us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":16224000,"child_traces":[["op",{"apply.queue_time_us":625,"apply.run_cpu_time_us":1299,"apply.run_wall_time_us":51202,"num_ops":2,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":1034,"prepare.run_wall_time_us":1579,"raft.queue_time_us":187,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":379,"replication_time_us":2986}]]}
I20260927 13:50:05.673318 6454 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_32256dc4657d4f4fafd87e3ce74dbea3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:05.673941 6454 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32256dc4657d4f4fafd87e3ce74dbea3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:05.675540 7016 raft_consensus.cc:493] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.675684 7016 raft_consensus.cc:515] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.676335 7016 leader_election.cc:290] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.678004 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 269cda0876e346149512e0b4985c6890 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:05.678720 6444 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 9fdef4f56d9647118afe83ac3cd364fd
I20260927 13:50:05.679346 6444 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34390 (request call id 75) took 1151 ms. Trace:
I20260927 13:50:05.679467 6444 rpcz_store.cc:276] 0927 13:50:04.527988 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.645947 (+117959us) service_pool.cc:224] Handling call
0927 13:50:04.665580 (+ 19633us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00007fe748a7c65d 00007fe748a7c753 00007fe7455f9db1 00007fe74d3eda7d 00007fe74d57de96 00007fe743f4a9d6 00007fe743f4a705 00007fe74064c63e 00007fe74064b51e 00007fe740651758 00007fe7406520bf
0927 13:50:04.666089 (+ 509us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:04.666255 (+ 166us) catalog_manager.cc:2854] Modifying in-memory table state
0927 13:50:04.666322 (+ 67us) catalog_manager.cc:2863] Locking tablets
0927 13:50:04.934128 (+267806us) catalog_manager.cc:2877] Removing table and tablets from system table
0927 13:50:05.007068 (+ 72940us) catalog_manager.cc:2895] Removing table from by-name map
0927 13:50:05.091454 (+ 84386us) catalog_manager.cc:2911] Committing in-memory state
0927 13:50:05.678648 (+587194us) catalog_manager.cc:2915] Aborting table tasks
0927 13:50:05.679308 (+ 660us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:04.935021 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:04.935195 (+ 174us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:04.935202 (+ 7us) write_op.cc:435] Acquired schema lock
0927 13:50:04.935206 (+ 4us) tablet.cc:662] Decoding operations
0927 13:50:04.935406 (+ 200us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:04.935419 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:04.935444 (+ 25us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:04.935645 (+ 201us) tablet.cc:701] Row locks acquired
0927 13:50:04.935648 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:04.935707 (+ 59us) write_op.cc:270] Start()
0927 13:50:04.935768 (+ 61us) write_op.cc:276] Timestamp: P: 1790517004935643 usec, L: 0
0927 13:50:04.935773 (+ 5us) op_driver.cc:348] REPLICATION: starting
0927 13:50:04.936064 (+ 291us) log.cc:844] Serialized 759 byte log entry
0927 13:50:05.005384 (+ 69320us) op_driver.cc:464] REPLICATION: finished
0927 13:50:05.005678 (+ 294us) write_op.cc:301] APPLY: starting
0927 13:50:05.005694 (+ 16us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:05.005731 (+ 37us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:05.005758 (+ 27us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:05.005824 (+ 66us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:05.005853 (+ 29us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:50:05.005859 (+ 6us) write_op.cc:312] APPLY: finished
0927 13:50:05.005922 (+ 63us) log.cc:844] Serialized 29 byte log entry
0927 13:50:05.005973 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.005988 (+ 15us) write_op.cc:454] Released schema lock
0927 13:50:05.005994 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:05.006050 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.006053 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":44597504,"child_traces":[["op",{"apply.queue_time_us":248,"apply.run_cpu_time_us":366,"apply.run_wall_time_us":365,"num_ops":2,"prepare.queue_time_us":91,"prepare.run_cpu_time_us":1024,"prepare.run_wall_time_us":11300,"raft.queue_time_us":166,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":4,"replication_time_us":69586}]]}
I20260927 13:50:05.680335 5228 tablet_service.cc:1511] Processing CreateTablet for tablet e70f64e0b71a481d8b3b1aafafa0c65a (DEFAULT_TABLE table=default.Table_4f0c853ca7b6461a8c933b047b632834 [id=b9412018f6cc4e9c8e8091d38d62f1e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.674602 5222 tablet_service.cc:1511] Processing CreateTablet for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc (DEFAULT_TABLE table=default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.640970 7111 ts_tablet_manager.cc:1929] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:50:05.641832 5619 tablet_bootstrap.cc:492] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:05.645550 7231 raft_consensus.cc:493] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.686921 7231 raft_consensus.cc:515] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.687639 7231 leader_election.cc:290] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.688402 5619 ts_tablet_manager.cc:1403] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.000s
I20260927 13:50:05.690305 5619 raft_consensus.cc:359] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.690829 5619 raft_consensus.cc:385] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.691040 5619 raft_consensus.cc:740] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.691597 5619 consensus_queue.cc:260] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.696480 5619 ts_tablet_manager.cc:1434] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260927 13:50:05.697602 7111 log.cc:1199] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/f46f45a0a13b4e05802a08880d7f6a01
W20260927 13:50:05.699111 6449 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c655651f9cb24310a5aa2e5b84c2a455 consensus state has no leader
W20260927 13:50:05.701195 6451 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 78719428d7b34f28a99722b093f6ab54 consensus state has no leader
I20260927 13:50:05.706558 5619 tablet_bootstrap.cc:492] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:05.709972 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fdef4f56d9647118afe83ac3cd364fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:39028
W20260927 13:50:05.713560 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 79110.6us
W20260927 13:50:05.714233 5319 leader_election.cc:343] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 51e1acd618fc44be9169fa1d56fa510a
W20260927 13:50:05.715652 5045 leader_election.cc:343] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.715808 5045 leader_election.cc:304] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:05.716310 7016 raft_consensus.cc:2749] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:05.717373 5045 leader_election.cc:343] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.717487 5045 leader_election.cc:304] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:05.717904 7016 raft_consensus.cc:2749] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:05.718457 5045 leader_election.cc:343] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.718562 5045 leader_election.cc:304] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:05.718962 7016 raft_consensus.cc:2749] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:05.672132 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc25ff5c6a3545759e7de977f91a9453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.724525 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 992bf643dee64bccaa993a08027aa5fc (table default.Table_85388904282441d09642d64019688c97 [id=00fdc87b0cbf4bc091a92db3004b4397]) successfully deleted
I20260927 13:50:05.724844 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07830b76d7e14ff0b6b1b1523dda21bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:05.724872 6429 catalog_manager.cc:5142] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): alter failed for tablet 60de1c28618f4e478aae68ad07fbcf98 (table default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]): Aborted: Op aborted
I20260927 13:50:05.725045 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfebdee6f9ce49ccb64b8d0feb78bfea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.725214 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.725780 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0da7bbfbaf248d78156192ee4baa5b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.726162 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a583d84f0f9247c68f330149b41e65ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.726681 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.727283 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a128a8934b4f47969fc1f8e75d00ea68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.728343 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70f64e0b71a481d8b3b1aafafa0c65a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.728574 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c63fdf379b540138e37344f4bc68b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.729552 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7064ca91a1154aed87e679794c1739c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.730695 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2b4316eeb643cc8c2440ed04191a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.733361 6882 raft_consensus.cc:493] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:05.734637 5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6657ff16861043daa2652597bcf26271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.740737 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff7d501f7704e69b696053cb1b1ffe5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.741163 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c69163fb77442be9215f8f285b904ef" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.743937 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 60de1c28618f4e478aae68ad07fbcf98 (table default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]) successfully deleted
I20260927 13:50:05.744288 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0827a26334c42728545a9eaa006fae0" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.744870 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 36181512a94c4702ae0a417665919faa (table default.Table_06b04cbe300b4373813df57694d32684 [id=ed3f5ac2c7fe4efeaa58e8a11100851b]) successfully deleted
W20260927 13:50:05.745129 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 8c14a6b95c1e460a8e7a299340f09498 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c14a6b95c1e460a8e7a299340f09498 already in progress: creating tablet
W20260927 13:50:05.745337 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 1b4494b7e895454f81fef308950729ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b4494b7e895454f81fef308950729ef already in progress: creating tablet
W20260927 13:50:05.745890 5044 leader_election.cc:343] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:05.746078 5044 leader_election.cc:343] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.747862 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:50:05.748823 5044 leader_election.cc:343] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:05.749037 5044 leader_election.cc:343] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.749190 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a9f864e4274666a86baed43e1623cd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:50:05.749228 5044 leader_election.cc:343] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.733630 7111 ts_tablet_manager.cc:1950] T f46f45a0a13b4e05802a08880d7f6a01 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:05.749325 5249 raft_consensus.cc:3060] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.735759 7125 raft_consensus.cc:515] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.751428 7125 leader_election.cc:290] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.737536 5619 tablet_bootstrap.cc:654] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.752934 6882 raft_consensus.cc:3060] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.752983 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54cf8c485324f798d59edf65d52d7b5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:05.755555 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1087ad60dade46bb9d38f52a94dd536b" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.763058 5619 tablet_bootstrap.cc:492] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:05.763219 5619 ts_tablet_manager.cc:1403] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.000s
I20260927 13:50:05.764024 5619 raft_consensus.cc:359] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.764194 5619 raft_consensus.cc:385] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.764279 5619 raft_consensus.cc:740] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.764477 5619 consensus_queue.cc:260] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.764539 5249 raft_consensus.cc:2468] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:05.770463 5619 ts_tablet_manager.cc:1434] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 13:50:05.771006 7235 raft_consensus.cc:493] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.773419 7235 raft_consensus.cc:515] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.774016 7235 leader_election.cc:290] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.774410 5619 tablet_bootstrap.cc:492] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:05.777498 5619 tablet_bootstrap.cc:654] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.784802 5109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c69163fb77442be9215f8f285b904ef" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:05.785006 5109 raft_consensus.cc:2468] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:05.785213 5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0827a26334c42728545a9eaa006fae0" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:05.785356 5104 raft_consensus.cc:2468] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:05.785471 5097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54cf8c485324f798d59edf65d52d7b5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:05.785610 5097 raft_consensus.cc:3060] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:05.786590 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:05.786808 5100 raft_consensus.cc:2393] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:50:05.786994 5098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a9f864e4274666a86baed43e1623cd" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:05.787210 5098 raft_consensus.cc:2393] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:50:05.789175 5097 raft_consensus.cc:2468] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:05.791795 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff7d501f7704e69b696053cb1b1ffe5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:05.791947 5107 raft_consensus.cc:2468] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:50:05.775701 5319 consensus_peers.cc:597] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:50:05.804916 5319 consensus_peers.cc:597] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:50:05.806535 5319 leader_election.cc:343] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:05.806828 5319 leader_election.cc:343] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:05.807320 5319 leader_election.cc:343] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.807618 5319 leader_election.cc:304] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:05.808422 7231 raft_consensus.cc:2804] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:05.808564 7231 raft_consensus.cc:697] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:05.808848 7231 consensus_queue.cc:237] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.780009 6882 raft_consensus.cc:515] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.781482 6793 raft_consensus.cc:493] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.819942 6793 raft_consensus.cc:515] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.820775 6793 leader_election.cc:290] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.821398 6882 leader_election.cc:290] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.821763 5628 tablet_bootstrap.cc:492] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:50:05.628144 5184 consensus_peers.cc:597] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4211f338c6a648c5b3e36c6df0b3c510. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:05.584069 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0597e8f5ba4bc6b54850f0d1a13954 (DEFAULT_TABLE table=default.Table_9e90cb3d6f55432795b8bcde5584712a [id=a4c98ec66922406aa2d944c9ff95f7d7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:50:05.823097 5184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 194986us
W20260927 13:50:05.823318 5184 leader_election.cc:343] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2885e0829d014765b54124a0eb23a4dc
I20260927 13:50:05.823376 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0597e8f5ba4bc6b54850f0d1a13954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.823449 5628 tablet_bootstrap.cc:654] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:05.823619 5184 consensus_peers.cc:597] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da75a470ec0c4ec9afa7c18a51cd7276. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:50:05.823827 5184 consensus_peers.cc:597] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f75847513dcf4c84913a4073176f2507. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:05.647639 7190 ts_tablet_manager.cc:1929] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260927 13:50:05.824386 5184 consensus_peers.cc:597] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a07adcd33414d18ae9720e7a307548a. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:05.824429 7190 log.cc:1199] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/36181512a94c4702ae0a417665919faa
I20260927 13:50:05.824600 6896 consensus_queue.cc:1048] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:05.824787 7190 ts_tablet_manager.cc:1950] T 36181512a94c4702ae0a417665919faa P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:05.822834 7235 consensus_queue.cc:1048] T 715b9af057f6425eb664e2399677890f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:05.825584 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 78) took 1469 ms. Trace:
I20260927 13:50:05.825662 7190 rpcz_store.cc:276] 0927 13:50:04.355975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.978434 (+622459us) service_pool.cc:224] Handling call
0927 13:50:05.347715 (+369281us) ts_tablet_manager.cc:1151] Deleting tablet 36181512a94c4702ae0a417665919faa
0927 13:50:05.347736 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:05.534727 (+186991us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x6160000a2454. stack: 00007ffbc05a95c6 00007ffbc05a9380 00007ffbbf5b134d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007ffbcc69da70 00007ffbcda265d3 00007ffbd05f38b7 00007ffbd0626a64 00007ffbd06073a0 00007ffbd060712d 0000000000aaef9c 00007ffbc05efaef 00007ffbc05f2deb 00007ffbc05f2c68
0927 13:50:05.644723 (+109996us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.647594 (+ 2871us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.825554 (+177960us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426226560,"tablet-delete.queue_time_us":369163}
I20260927 13:50:05.826406 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 79) took 1214 ms. Trace:
I20260927 13:50:05.826493 7190 rpcz_store.cc:276] 0927 13:50:04.612451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.978565 (+366114us) service_pool.cc:224] Handling call
0927 13:50:05.826060 (+847495us) ts_tablet_manager.cc:1151] Deleting tablet 8c14a6b95c1e460a8e7a299340f09498
0927 13:50:05.826072 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:05.826386 (+ 314us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":847376}
I20260927 13:50:05.826800 7190 tablet_replica.cc:333] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:05.827033 7190 raft_consensus.cc:2243] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:05.827271 7190 pending_rounds.cc:70] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:50:05.827316 7190 pending_rounds.cc:77] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957646479572992 op_type: NO_OP noop_request { }
I20260927 13:50:05.827410 7190 raft_consensus.cc:2889] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:05.827494 7190 raft_consensus.cc:2272] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.828104 7190 ts_tablet_manager.cc:1916] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.829064 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 81) took 1462 ms. Trace:
I20260927 13:50:05.829182 7098 rpcz_store.cc:276] 0927 13:50:04.366740 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.525670 (+158930us) service_pool.cc:224] Handling call
0927 13:50:05.617901 (+1092231us) ts_tablet_manager.cc:1151] Deleting tablet ec130d31f6274fd9b730c2bb8bba817e
0927 13:50:05.617911 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:05.631008 (+ 13097us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.633943 (+ 2935us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.829040 (+195097us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1092094}
I20260927 13:50:05.829557 7098 tablet_replica.cc:333] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:05.829790 7098 raft_consensus.cc:2243] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:05.829952 7098 raft_consensus.cc:2272] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.830559 7098 ts_tablet_manager.cc:1916] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.831822 7250 tablet.cc:1751] T 564f5c92bf144fa1bfc2e1e07132dd69 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:05.840956 6896 consensus_queue.cc:1048] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:05.841776 5184 leader_election.cc:343] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 03a1f13b31934baa8ce18fc499e94806
I20260927 13:50:05.842872 6896 consensus_queue.cc:1048] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:05.844233 7098 ts_tablet_manager.cc:1929] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:05.845202 7098 log.cc:1199] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/12dd91ddaeff4f2a9d7a0761c08fc192
I20260927 13:50:05.850358 7098 ts_tablet_manager.cc:1950] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:05.824951 5619 tablet_bootstrap.cc:492] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:05.856098 5619 ts_tablet_manager.cc:1403] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.082s user 0.002s sys 0.002s
I20260927 13:50:05.863988 7125 consensus_queue.cc:1048] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:05.864946 7186 raft_consensus.cc:493] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.865087 7186 raft_consensus.cc:515] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:05.865720 7186 leader_election.cc:290] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.867102 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71268fb7aa9646639ea41dc8ccebfc5c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.867677 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b0349bfaa4a9c8b7d280177f1ecae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.868633 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a9f864e4274666a86baed43e1623cd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:05.868832 5249 raft_consensus.cc:2393] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34fc5fe0a32d42ab83f4aa6d07341409 in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:05.869179 5619 raft_consensus.cc:359] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.869349 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "467aa7fb4edf4b1b8dad6514d1d017b1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:05.869391 5619 raft_consensus.cc:385] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.869451 5619 raft_consensus.cc:740] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.869654 5619 consensus_queue.cc:260] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.870173 5619 ts_tablet_manager.cc:1434] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260927 13:50:05.870471 5619 tablet_bootstrap.cc:492] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:05.871091 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b4f8a3b92e44cba7ea9e2b48aa70bb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:05.872710 5319 leader_election.cc:343] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:05.872889 5319 leader_election.cc:343] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:05.873129 5319 leader_election.cc:343] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.873215 7186 consensus_queue.cc:1048] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:05.873412 5319 leader_election.cc:343] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.874147 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 82) took 1506 ms. Trace:
W20260927 13:50:05.874399 5185 leader_election.cc:343] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 2885e0829d014765b54124a0eb23a4dc
I20260927 13:50:05.874583 5185 leader_election.cc:304] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:05.874704 5319 leader_election.cc:343] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:05.874850 5319 leader_election.cc:343] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:05.874905 7186 raft_consensus.cc:2749] T 2885e0829d014765b54124a0eb23a4dc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:05.875756 7125 raft_consensus.cc:493] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.876049 7125 raft_consensus.cc:515] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.876678 7125 leader_election.cc:290] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.835144 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet ec130d31f6274fd9b730c2bb8bba817e (table default.Table_6ca18492261b4eac898eb7838d59e717 [id=aea372366a9b4cb19097683fc81c1793]) successfully deleted
I20260927 13:50:05.877534 7251 tablet.cc:1751] T 0d54e51b5c104c75b938aba55cecf890 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:05.877666 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 60de1c28618f4e478aae68ad07fbcf98 (table default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]) successfully deleted
I20260927 13:50:05.874979 5319 leader_election.cc:304] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:05.881458 7125 raft_consensus.cc:2804] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:05.881659 7125 raft_consensus.cc:697] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:05.882009 7125 consensus_queue.cc:237] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:05.884224 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 2b082227264e442a8b1db7a68fb0c3eb (table default.Table_967519598f9b4c999e93c6f358381116 [id=701057885bc4473193538947593d74e3]) successfully deleted
I20260927 13:50:05.885330 7250 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35946 (request call id 88) took 1268 ms. Trace:
I20260927 13:50:05.885423 7250 rpcz_store.cc:276] 0927 13:50:04.616765 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.947037 (+330272us) service_pool.cc:224] Handling call
0927 13:50:05.885315 (+938278us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:04.990856 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0927 13:50:04.991112 (+ 256us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 13:50:04.991124 (+ 12us) alter_schema_op.cc:66] Acquired schema lock
0927 13:50:04.991159 (+ 35us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0927 13:50:04.991243 (+ 84us) alter_schema_op.cc:128] START. Timestamp: 1790517004991137
0927 13:50:04.991247 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:04.991687 (+ 440us) log.cc:844] Serialized 173 byte log entry
0927 13:50:05.825766 (+834079us) op_driver.cc:464] REPLICATION: finished
0927 13:50:05.831796 (+ 6030us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0927 13:50:05.832386 (+ 590us) log.cc:844] Serialized 5 byte log entry
0927 13:50:05.884754 (+ 52368us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.885048 (+ 294us) log.cc:844] Serialized 14 byte log entry
0927 13:50:05.885271 (+ 223us) alter_schema_op.cc:73] Released schema lock
0927 13:50:05.885281 (+ 10us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":5962,"prepare.queue_time_us":43492,"prepare.run_cpu_time_us":2010,"prepare.run_wall_time_us":23190,"replication_time_us":834486,"thread_start_us":80041,"threads_started":3,"wal-append.queue_time_us":21851}]]}
I20260927 13:50:05.886730 7190 ts_tablet_manager.cc:1929] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:05.886889 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d85213c05c465abda78cc49c70d36f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.886992 7190 log.cc:1199] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/4211f338c6a648c5b3e36c6df0b3c510
I20260927 13:50:05.887895 7190 ts_tablet_manager.cc:1950] T 4211f338c6a648c5b3e36c6df0b3c510 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:05.874425 7098 rpcz_store.cc:276] 0927 13:50:04.367532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.525840 (+158308us) service_pool.cc:224] Handling call
0927 13:50:05.829507 (+1303667us) ts_tablet_manager.cc:1151] Deleting tablet 12dd91ddaeff4f2a9d7a0761c08fc192
0927 13:50:05.829518 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:05.833886 (+ 4368us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.841183 (+ 7297us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.874059 (+ 32876us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1303454}
I20260927 13:50:05.894752 7098 tablet_replica.cc:333] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:05.894896 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54cf8c485324f798d59edf65d52d7b5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.895112 5379 raft_consensus.cc:2393] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34fc5fe0a32d42ab83f4aa6d07341409 in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:05.895618 7098 raft_consensus.cc:2243] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:05.896098 7098 raft_consensus.cc:2272] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.896440 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 12dd91ddaeff4f2a9d7a0761c08fc192 (table default.Table_473c4114525b4bea85fd83367cd4c376 [id=2c3a6aa3a59242ab831f9a72740f8879]) successfully deleted
I20260927 13:50:05.896620 5619 tablet_bootstrap.cc:654] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.897650 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:05.897859 5379 raft_consensus.cc:2393] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34fc5fe0a32d42ab83f4aa6d07341409 in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:05.898331 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e730a00ad2e646a4ba594ba9434c3b50" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:05.898535 5379 raft_consensus.cc:2393] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34fc5fe0a32d42ab83f4aa6d07341409 in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:05.899583 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.900400 5626 tablet_bootstrap.cc:492] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:05.900695 5626 ts_tablet_manager.cc:1403] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.324s user 0.002s sys 0.002s
I20260927 13:50:05.901002 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71268fb7aa9646639ea41dc8ccebfc5c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.901738 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b0349bfaa4a9c8b7d280177f1ecae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.902384 5382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a9f864e4274666a86baed43e1623cd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:05.902637 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "467aa7fb4edf4b1b8dad6514d1d017b1" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.902375 5626 raft_consensus.cc:359] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.903228 5350 tablet_service.cc:1511] Processing CreateTablet for tablet bfebdee6f9ce49ccb64b8d0feb78bfea (DEFAULT_TABLE table=default.Table_d6067ca7e0a04380a6629bf8edeb93d9 [id=995d3ab30eb749c1bc495b8aca68a910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.903306 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b4f8a3b92e44cba7ea9e2b48aa70bb" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:05.903151 5626 raft_consensus.cc:385] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.903767 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfebdee6f9ce49ccb64b8d0feb78bfea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.905267 5348 tablet_service.cc:1511] Processing CreateTablet for tablet a583d84f0f9247c68f330149b41e65ae (DEFAULT_TABLE table=default.Table_789c5549472f4bf8ab1581eb3903953a [id=1af7add99a3441a5888daac021a65214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.905647 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a583d84f0f9247c68f330149b41e65ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.905797 7016 raft_consensus.cc:493] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.905918 7016 raft_consensus.cc:515] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.906477 7016 leader_election.cc:290] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:05.912917 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 36181512a94c4702ae0a417665919faa (table default.Table_06b04cbe300b4373813df57694d32684 [id=ed3f5ac2c7fe4efeaa58e8a11100851b]) successfully deleted
W20260927 13:50:05.914577 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 8c14a6b95c1e460a8e7a299340f09498 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c14a6b95c1e460a8e7a299340f09498 already in progress: creating tablet
I20260927 13:50:05.903438 5626 raft_consensus.cc:740] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.917308 5626 consensus_queue.cc:260] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.918008 7098 ts_tablet_manager.cc:1916] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.918918 5626 ts_tablet_manager.cc:1434] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.018s user 0.000s sys 0.003s
I20260927 13:50:05.919603 5626 tablet_bootstrap.cc:492] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:05.920194 5432 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:05.921891 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 80) took 1288 ms. Trace:
I20260927 13:50:05.922068 7190 rpcz_store.cc:276] 0927 13:50:04.633117 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.978692 (+345575us) service_pool.cc:224] Handling call
0927 13:50:05.826754 (+848062us) ts_tablet_manager.cc:1151] Deleting tablet 4211f338c6a648c5b3e36c6df0b3c510
0927 13:50:05.826765 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:05.880619 (+ 53854us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.886641 (+ 6022us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.921869 (+ 35228us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":847938}
W20260927 13:50:05.876852 5185 consensus_peers.cc:597] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a -> Peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Couldn't send request to peer bb28c54312c94d7dafb1c2abf7870735. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50bc839e0fc54839a5d06c176760f618. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:50:05.927067 5185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 50402.9us
W20260927 13:50:05.927980 5185 consensus_peers.cc:597] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a -> Peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Couldn't send request to peer bb28c54312c94d7dafb1c2abf7870735. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da75a470ec0c4ec9afa7c18a51cd7276. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:05.929180 7203 consensus_queue.cc:1048] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:05.932574 7231 raft_consensus.cc:493] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.932780 7231 raft_consensus.cc:515] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.933425 7190 tablet_replica.cc:333] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:05.933488 7231 leader_election.cc:290] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.933795 7190 raft_consensus.cc:2243] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:05.939103 5628 tablet_bootstrap.cc:492] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:05.939257 5628 ts_tablet_manager.cc:1403] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.118s user 0.007s sys 0.002s
I20260927 13:50:05.941737 6453 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:34390 (request call id 89) took 1076 ms. Trace:
I20260927 13:50:05.937950 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 362f660cac76436aba54bb707d8a991c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:05.941936 6453 rpcz_store.cc:276] 0927 13:50:04.865723 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.302408 (+436685us) service_pool.cc:224] Handling call
0927 13:50:05.307183 (+ 4775us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:05.307372 (+ 189us) catalog_manager.cc:3764] Apply alter schema
0927 13:50:05.307514 (+ 142us) catalog_manager.cc:3796] Acquired catalog manager lock
0927 13:50:05.307566 (+ 52us) catalog_manager.cc:3954] Updating metadata on disk
0927 13:50:05.446770 (+139204us) catalog_manager.cc:3985] Committing alterations to in-memory state
0927 13:50:05.941656 (+494886us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:05.308148 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:05.308268 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:05.308273 (+ 5us) write_op.cc:435] Acquired schema lock
0927 13:50:05.308276 (+ 3us) tablet.cc:662] Decoding operations
0927 13:50:05.308361 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:05.308370 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:05.308374 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:50:05.308450 (+ 76us) tablet.cc:701] Row locks acquired
0927 13:50:05.308453 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:05.308491 (+ 38us) write_op.cc:270] Start()
0927 13:50:05.308519 (+ 28us) write_op.cc:276] Timestamp: P: 1790517005308467 usec, L: 0
0927 13:50:05.308522 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:05.308684 (+ 162us) log.cc:844] Serialized 405 byte log entry
0927 13:50:05.444881 (+136197us) op_driver.cc:464] REPLICATION: finished
0927 13:50:05.445793 (+ 912us) write_op.cc:301] APPLY: starting
0927 13:50:05.445802 (+ 9us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:05.445827 (+ 25us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:05.445858 (+ 31us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:05.445896 (+ 38us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:05.445918 (+ 22us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:05.445924 (+ 6us) write_op.cc:312] APPLY: finished
0927 13:50:05.445991 (+ 67us) log.cc:844] Serialized 23 byte log entry
0927 13:50:05.446027 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.446039 (+ 12us) write_op.cc:454] Released schema lock
0927 13:50:05.446044 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:05.534630 (+ 88586us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.534642 (+ 12us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":875,"apply.run_cpu_time_us":306,"apply.run_wall_time_us":305,"num_ops":1,"prepare.queue_time_us":229,"prepare.run_cpu_time_us":30037,"prepare.run_wall_time_us":226455,"raft.queue_time_us":745,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":7,"replication_time_us":136335,"thread_start_us":225388,"threads_started":1}]]}
I20260927 13:50:05.944375 6447 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:34390 (request call id 86) took 1140 ms. Trace:
I20260927 13:50:05.944535 6447 rpcz_store.cc:276] 0927 13:50:04.803561 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.088877 (+285316us) service_pool.cc:224] Handling call
0927 13:50:05.089205 (+ 328us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:05.089393 (+ 188us) catalog_manager.cc:3764] Apply alter schema
0927 13:50:05.090490 (+ 1097us) catalog_manager.cc:3796] Acquired catalog manager lock
0927 13:50:05.090612 (+ 122us) catalog_manager.cc:3954] Updating metadata on disk
0927 13:50:05.175318 (+ 84706us) catalog_manager.cc:3985] Committing alterations to in-memory state
0927 13:50:05.944310 (+768992us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:05.095745 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:05.095872 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:05.095880 (+ 8us) write_op.cc:435] Acquired schema lock
0927 13:50:05.095882 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:05.095974 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:05.095984 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:05.095988 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:50:05.096167 (+ 179us) tablet.cc:701] Row locks acquired
0927 13:50:05.096169 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:50:05.096209 (+ 40us) write_op.cc:270] Start()
0927 13:50:05.096248 (+ 39us) write_op.cc:276] Timestamp: P: 1790517005096149 usec, L: 0
0927 13:50:05.096252 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:05.096461 (+ 209us) log.cc:844] Serialized 405 byte log entry
0927 13:50:05.173313 (+ 76852us) op_driver.cc:464] REPLICATION: finished
0927 13:50:05.173493 (+ 180us) write_op.cc:301] APPLY: starting
0927 13:50:05.173506 (+ 13us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:05.173539 (+ 33us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:05.173572 (+ 33us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:05.173622 (+ 50us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:05.173651 (+ 29us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:05.173659 (+ 8us) write_op.cc:312] APPLY: finished
0927 13:50:05.173737 (+ 78us) log.cc:844] Serialized 23 byte log entry
0927 13:50:05.173793 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.173808 (+ 15us) write_op.cc:454] Released schema lock
0927 13:50:05.173815 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:05.173889 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.173895 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":133,"apply.run_cpu_time_us":388,"apply.run_wall_time_us":388,"num_ops":1,"prepare.queue_time_us":4643,"prepare.run_cpu_time_us":742,"prepare.run_wall_time_us":1161,"raft.queue_time_us":925,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":7,"replication_time_us":77031}]]}
I20260927 13:50:05.944957 6896 consensus_queue.cc:1048] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:05.946131 6447 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_3895042624e24a5bb7f7a7b8d19b2808"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:05.947386 6447 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3895042624e24a5bb7f7a7b8d19b2808 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:05.948810 7186 raft_consensus.cc:493] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.948942 7186 raft_consensus.cc:515] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.949539 7186 leader_election.cc:290] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:05.949756 7190 raft_consensus.cc:2272] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:05.950232 5225 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fdef4f56d9647118afe83ac3cd364fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:05.950417 7190 ts_tablet_manager.cc:1916] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:05.950470 6453 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_b551e47328c044599ac2b4be3901aa7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:05.950975 6453 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b551e47328c044599ac2b4be3901aa7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:05.951193 5227 tablet_service.cc:1558] Processing DeleteTablet for tablet 269cda0876e346149512e0b4985c6890 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:05.951947 5348 tablet_service.cc:1511] Processing CreateTablet for tablet 07830b76d7e14ff0b6b1b1523dda21bc (DEFAULT_TABLE table=default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.952080 5350 tablet_service.cc:1511] Processing CreateTablet for tablet ad2b4316eeb643cc8c2440ed04191a57 (DEFAULT_TABLE table=default.Table_e349439f77f540cd8fc369d3f4217757 [id=740644d5da164e1f99a37b02ab614292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.952423 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07830b76d7e14ff0b6b1b1523dda21bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.952922 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2b4316eeb643cc8c2440ed04191a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.955070 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 4211f338c6a648c5b3e36c6df0b3c510 (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]) successfully deleted
W20260927 13:50:05.956296 5185 leader_election.cc:343] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 03a1f13b31934baa8ce18fc499e94806
I20260927 13:50:05.956424 5185 leader_election.cc:304] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:05.956640 6896 raft_consensus.cc:2749] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:05.957280 5185 leader_election.cc:304] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:05.957491 6896 raft_consensus.cc:2749] T 715b9af057f6425eb664e2399677890f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:05.959506 5626 tablet_bootstrap.cc:654] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.959676 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 06b645b4ac5a4597b5d2028dd711f9b6 (DEFAULT_TABLE table=default.Table_cd89222a85234585a71b762f7e592e9f [id=d5451e93d6264995a3e1fdda623d9908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.960088 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b645b4ac5a4597b5d2028dd711f9b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:05.962776 5184 leader_election.cc:343] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f3e0e8d6bc744d69a9f41d45459d3b2b
I20260927 13:50:05.964936 6449 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:34390 (request call id 88) took 1107 ms. Trace:
I20260927 13:50:05.965054 6449 rpcz_store.cc:276] 0927 13:50:04.834302 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.299114 (+464812us) service_pool.cc:224] Handling call
0927 13:50:05.306261 (+ 7147us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:05.306573 (+ 312us) catalog_manager.cc:3764] Apply alter schema
0927 13:50:05.306739 (+ 166us) catalog_manager.cc:3796] Acquired catalog manager lock
0927 13:50:05.306811 (+ 72us) catalog_manager.cc:3954] Updating metadata on disk
0927 13:50:05.446512 (+139701us) catalog_manager.cc:3985] Committing alterations to in-memory state
0927 13:50:05.941672 (+495160us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:05.307430 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:05.307504 (+ 74us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:05.307512 (+ 8us) write_op.cc:435] Acquired schema lock
0927 13:50:05.307514 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:05.307615 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:05.307630 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:05.307634 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:50:05.307701 (+ 67us) tablet.cc:701] Row locks acquired
0927 13:50:05.307704 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:05.307743 (+ 39us) write_op.cc:270] Start()
0927 13:50:05.307778 (+ 35us) write_op.cc:276] Timestamp: P: 1790517005307717 usec, L: 0
0927 13:50:05.307782 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:05.307993 (+ 211us) log.cc:844] Serialized 405 byte log entry
0927 13:50:05.444786 (+136793us) op_driver.cc:464] REPLICATION: finished
0927 13:50:05.445136 (+ 350us) write_op.cc:301] APPLY: starting
0927 13:50:05.445160 (+ 24us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:05.445214 (+ 54us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:05.445260 (+ 46us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:05.445327 (+ 67us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:05.445373 (+ 46us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:05.445386 (+ 13us) write_op.cc:312] APPLY: finished
0927 13:50:05.445500 (+ 114us) log.cc:844] Serialized 23 byte log entry
0927 13:50:05.445579 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.445607 (+ 28us) write_op.cc:454] Released schema lock
0927 13:50:05.445618 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:05.445708 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.445715 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":282,"apply.run_cpu_time_us":559,"apply.run_wall_time_us":559,"num_ops":1,"prepare.queue_time_us":59,"prepare.run_cpu_time_us":689,"prepare.run_wall_time_us":689,"raft.queue_time_us":1436,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":265,"replication_time_us":136960}]]}
I20260927 13:50:05.966415 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 6657ff16861043daa2652597bcf26271 (DEFAULT_TABLE table=default.Table_db70ad184fab4e5984d1777fecae5518 [id=c6230203df764e97a3fd3c8117177db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.966401 6449 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_5df4d50c0d744dafa316d51755abfcb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:05.966898 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6657ff16861043daa2652597bcf26271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.967140 7251 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35946 (request call id 85) took 1350 ms. Trace:
W20260927 13:50:05.967988 6449 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5df4d50c0d744dafa316d51755abfcb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:05.967415 7251 rpcz_store.cc:276] 0927 13:50:04.616465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.942518 (+326053us) service_pool.cc:224] Handling call
0927 13:50:05.967118 (+1024600us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:04.976117 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0927 13:50:04.976300 (+ 183us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 13:50:04.976310 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0927 13:50:04.976318 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0927 13:50:04.976389 (+ 71us) alter_schema_op.cc:128] START. Timestamp: 1790517004976321
0927 13:50:04.976419 (+ 30us) op_driver.cc:348] REPLICATION: starting
0927 13:50:04.976694 (+ 275us) log.cc:844] Serialized 173 byte log entry
0927 13:50:05.850430 (+873736us) op_driver.cc:464] REPLICATION: finished
0927 13:50:05.877507 (+ 27077us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0927 13:50:05.878095 (+ 588us) log.cc:844] Serialized 5 byte log entry
0927 13:50:05.966433 (+ 88338us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.966723 (+ 290us) log.cc:844] Serialized 14 byte log entry
0927 13:50:05.967010 (+ 287us) alter_schema_op.cc:73] Released schema lock
0927 13:50:05.967047 (+ 37us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":27006,"prepare.queue_time_us":33218,"prepare.run_cpu_time_us":10376,"prepare.run_wall_time_us":132687,"replication_time_us":873965,"thread_start_us":239942,"threads_started":3,"wal-append.queue_time_us":126173}]]}
I20260927 13:50:05.970177 7125 raft_consensus.cc:493] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:05.970386 7125 raft_consensus.cc:515] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.971120 7125 leader_election.cc:290] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:05.974870 5185 leader_election.cc:343] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: f3e0e8d6bc744d69a9f41d45459d3b2b
I20260927 13:50:05.975041 5185 leader_election.cc:304] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:05.975296 7186 raft_consensus.cc:2749] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:05.976336 5628 raft_consensus.cc:359] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.976517 5628 raft_consensus.cc:385] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.976576 5628 raft_consensus.cc:740] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.976816 5628 consensus_queue.cc:260] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.977463 5628 ts_tablet_manager.cc:1434] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20260927 13:50:05.977731 5628 tablet_bootstrap.cc:492] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:05.979265 5628 tablet_bootstrap.cc:654] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:05.979305 5619 tablet_bootstrap.cc:492] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:05.979432 5619 ts_tablet_manager.cc:1403] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.109s user 0.003s sys 0.000s
I20260927 13:50:05.979835 5626 tablet_bootstrap.cc:492] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:05.980290 5626 ts_tablet_manager.cc:1403] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.003s
I20260927 13:50:05.980237 5619 raft_consensus.cc:359] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.980399 5619 raft_consensus.cc:385] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:05.980449 5619 raft_consensus.cc:740] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:05.980674 5619 consensus_queue.cc:260] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:05.981142 5619 ts_tablet_manager.cc:1434] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:05.981410 5619 tablet_bootstrap.cc:492] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:05.982422 5360 tablet_service.cc:1511] Processing CreateTablet for tablet fc25ff5c6a3545759e7de977f91a9453 (DEFAULT_TABLE table=default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.982798 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc25ff5c6a3545759e7de977f91a9453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.982719 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 7064ca91a1154aed87e679794c1739c6 (DEFAULT_TABLE table=default.Table_47c17bb336c34c678a4dfe8ada8a1d95 [id=f66668ed3988492b958d26785ababc44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.983635 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7064ca91a1154aed87e679794c1739c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.986932 6451 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:34390 (request call id 91) took 1064 ms. Trace:
I20260927 13:50:05.987125 6451 rpcz_store.cc:276] 0927 13:50:04.877715 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.540436 (+662721us) service_pool.cc:224] Handling call
0927 13:50:05.540820 (+ 384us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:05.541029 (+ 209us) catalog_manager.cc:3764] Apply alter schema
0927 13:50:05.541338 (+ 309us) catalog_manager.cc:3796] Acquired catalog manager lock
0927 13:50:05.541419 (+ 81us) catalog_manager.cc:3954] Updating metadata on disk
0927 13:50:05.560244 (+ 18825us) catalog_manager.cc:3985] Committing alterations to in-memory state
0927 13:50:05.941662 (+381418us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:05.542873 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:05.542969 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:05.542974 (+ 5us) write_op.cc:435] Acquired schema lock
0927 13:50:05.542976 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:05.543064 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:05.543074 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:05.543079 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:50:05.543145 (+ 66us) tablet.cc:701] Row locks acquired
0927 13:50:05.543150 (+ 5us) write_op.cc:260] PREPARE: finished
0927 13:50:05.543187 (+ 37us) write_op.cc:270] Start()
0927 13:50:05.543232 (+ 45us) write_op.cc:276] Timestamp: P: 1790517005543139 usec, L: 0
0927 13:50:05.543236 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:05.543388 (+ 152us) log.cc:844] Serialized 405 byte log entry
0927 13:50:05.559543 (+ 16155us) op_driver.cc:464] REPLICATION: finished
0927 13:50:05.559639 (+ 96us) write_op.cc:301] APPLY: starting
0927 13:50:05.559658 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:05.559694 (+ 36us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:05.559719 (+ 25us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:05.559765 (+ 46us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:05.559793 (+ 28us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:05.559800 (+ 7us) write_op.cc:312] APPLY: finished
0927 13:50:05.559875 (+ 75us) log.cc:844] Serialized 23 byte log entry
0927 13:50:05.559932 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.559952 (+ 20us) write_op.cc:454] Released schema lock
0927 13:50:05.559959 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":218,"child_traces":[["op",{"apply.queue_time_us":47,"apply.run_cpu_time_us":375,"apply.run_wall_time_us":375,"num_ops":1,"prepare.queue_time_us":956,"prepare.run_cpu_time_us":642,"prepare.run_wall_time_us":3827,"raft.queue_time_us":36,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":16270}]]}
I20260927 13:50:05.989593 6451 master_service.cc:960] ReplaceTablet: received request to replace tablet 0076228c3f224d1f9d76ccf2dd7064ae from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:05.990372 5360 tablet_service.cc:1511] Processing CreateTablet for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc (DEFAULT_TABLE table=default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.990835 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:05.998219 5349 tablet_service.cc:1511] Processing CreateTablet for tablet e70f64e0b71a481d8b3b1aafafa0c65a (DEFAULT_TABLE table=default.Table_4f0c853ca7b6461a8c933b047b632834 [id=b9412018f6cc4e9c8e8091d38d62f1e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:05.998409 6454 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34390 (request call id 92) took 1095 ms. Trace:
I20260927 13:50:05.998875 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 269cda0876e346149512e0b4985c6890 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:05.998522 6454 rpcz_store.cc:276] 0927 13:50:04.903128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.672997 (+769869us) service_pool.cc:224] Handling call
0927 13:50:05.941694 (+268697us) catalog_manager.cc:2140] Acquired catalog manager lock
0927 13:50:05.942353 (+ 659us) catalog_manager.cc:2186] Created new table and tablet info
0927 13:50:05.951400 (+ 9047us) catalog_manager.cc:2246] Wrote table and tablets to system table
0927 13:50:05.998206 (+ 46806us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0927 13:50:05.998326 (+ 120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:05.943063 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:05.943227 (+ 164us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:05.943236 (+ 9us) write_op.cc:435] Acquired schema lock
0927 13:50:05.943240 (+ 4us) tablet.cc:662] Decoding operations
0927 13:50:05.943379 (+ 139us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:05.943399 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:05.943407 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:05.943532 (+ 125us) tablet.cc:701] Row locks acquired
0927 13:50:05.943536 (+ 4us) write_op.cc:260] PREPARE: finished
0927 13:50:05.943578 (+ 42us) write_op.cc:270] Start()
0927 13:50:05.943625 (+ 47us) write_op.cc:276] Timestamp: P: 1790517005943551 usec, L: 0
0927 13:50:05.943631 (+ 6us) op_driver.cc:348] REPLICATION: starting
0927 13:50:05.943884 (+ 253us) log.cc:844] Serialized 433 byte log entry
0927 13:50:05.946990 (+ 3106us) op_driver.cc:464] REPLICATION: finished
0927 13:50:05.947113 (+ 123us) write_op.cc:301] APPLY: starting
0927 13:50:05.947128 (+ 15us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:05.947171 (+ 43us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:05.947204 (+ 33us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:05.947328 (+ 124us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:05.947364 (+ 36us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 13:50:05.947376 (+ 12us) write_op.cc:312] APPLY: finished
0927 13:50:05.947481 (+ 105us) log.cc:844] Serialized 29 byte log entry
0927 13:50:05.947551 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.947573 (+ 22us) write_op.cc:454] Released schema lock
0927 13:50:05.947581 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:05.947655 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.947659 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":75,"apply.run_cpu_time_us":533,"apply.run_wall_time_us":533,"num_ops":2,"prepare.queue_time_us":61,"prepare.run_cpu_time_us":982,"prepare.run_wall_time_us":982,"raft.queue_time_us":211,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":359,"replication_time_us":3329,"spinlock_wait_cycles":105856}]]}
I20260927 13:50:05.999604 6454 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_c37d485f00e04ab79a168180c2e1ae88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:05.999791 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fdef4f56d9647118afe83ac3cd364fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.001682 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca5b5f9ca1e44eb8cc8bb9e1ff11102" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:06.004276 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca5b5f9ca1e44eb8cc8bb9e1ff11102" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:05.986545 5626 raft_consensus.cc:359] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.004545 5626 raft_consensus.cc:385] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.004593 5107 raft_consensus.cc:3060] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.004719 5626 raft_consensus.cc:740] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.005157 5626 consensus_queue.cc:260] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:06.013625 5044 leader_election.cc:343] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:06.013876 5044 leader_election.cc:343] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:06.014245 5044 leader_election.cc:343] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:06.015249 5044 leader_election.cc:343] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:06.015441 5044 consensus_peers.cc:597] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:06.018498 5107 raft_consensus.cc:2468] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:50:06.022341 5184 leader_election.cc:343] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 46537e1b33f24d50b705d53f6978da3c
I20260927 13:50:06.022642 6453 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34390 (request call id 93) took 1102 ms. Trace:
W20260927 13:50:06.024492 5184 leader_election.cc:343] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2cec272546cb4373bf69e3ab344c46e1
I20260927 13:50:06.025485 7269 raft_consensus.cc:493] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.025673 7269 raft_consensus.cc:515] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.026832 7269 leader_election.cc:290] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.022794 6453 rpcz_store.cc:276] 0927 13:50:04.920008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.943660 (+1023652us) service_pool.cc:224] Handling call
0927 13:50:05.946104 (+ 2444us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00007fe748a7c65d 00007fe748a7c753 00007fe7455f9db1 00007fe74d3eda7d 00007fe74d57cea3 00007fe743f48d16 00007fe743f48a45 00007fe74064c63e 00007fe74064b51e 00007fe740651758 00007fe7406520bf
0927 13:50:05.996947 (+ 50843us) catalog_manager.cc:2140] Acquired catalog manager lock
0927 13:50:05.997601 (+ 654us) catalog_manager.cc:2186] Created new table and tablet info
0927 13:50:06.021567 (+ 23966us) catalog_manager.cc:2246] Wrote table and tablets to system table
0927 13:50:06.022478 (+ 911us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0927 13:50:06.022584 (+ 106us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:05.998901 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:05.999017 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:05.999024 (+ 7us) write_op.cc:435] Acquired schema lock
0927 13:50:05.999027 (+ 3us) tablet.cc:662] Decoding operations
0927 13:50:05.999096 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:05.999108 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:05.999112 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:05.999182 (+ 70us) tablet.cc:701] Row locks acquired
0927 13:50:05.999184 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:50:05.999231 (+ 47us) write_op.cc:270] Start()
0927 13:50:05.999261 (+ 30us) write_op.cc:276] Timestamp: P: 1790517005999201 usec, L: 0
0927 13:50:05.999264 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:05.999421 (+ 157us) log.cc:844] Serialized 433 byte log entry
0927 13:50:06.017455 (+ 18034us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.018368 (+ 913us) write_op.cc:301] APPLY: starting
0927 13:50:06.018376 (+ 8us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.018400 (+ 24us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.018430 (+ 30us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.018538 (+ 108us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.018575 (+ 37us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 13:50:06.018587 (+ 12us) write_op.cc:312] APPLY: finished
0927 13:50:06.018649 (+ 62us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.018696 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.018717 (+ 21us) write_op.cc:454] Released schema lock
0927 13:50:06.018725 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":5074048,"child_traces":[["op",{"apply.queue_time_us":884,"apply.run_cpu_time_us":419,"apply.run_wall_time_us":419,"num_ops":2,"prepare.queue_time_us":763,"prepare.run_cpu_time_us":611,"prepare.run_wall_time_us":610,"raft.queue_time_us":1809,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":18173,"thread_start_us":3670,"threads_started":1}]]}
I20260927 13:50:06.028000 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9503dd46ccf472581d1a667eea300ed" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.028568 6453 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_3920ec6b5dbd4624a1ceeee9d17a8f4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:06.028781 5626 ts_tablet_manager.cc:1434] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.048s user 0.001s sys 0.003s
I20260927 13:50:06.029065 5626 tablet_bootstrap.cc:492] T 78c4bbb0512c4411916eb4c48731f32f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:06.030412 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6985779674646f4abe18cdf7c063c90" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.034162 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e730a00ad2e646a4ba594ba9434c3b50" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:06.034317 5244 raft_consensus.cc:3060] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.035715 6449 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34390 (request call id 95) took 1093 ms. Trace:
I20260927 13:50:06.035921 6449 rpcz_store.cc:276] 0927 13:50:04.941805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.966195 (+1024390us) service_pool.cc:224] Handling call
0927 13:50:05.997033 (+ 30838us) catalog_manager.cc:2140] Acquired catalog manager lock
0927 13:50:05.997511 (+ 478us) catalog_manager.cc:2186] Created new table and tablet info
0927 13:50:06.034893 (+ 37382us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.034904 (+ 11us) write_op.cc:454] Released schema lock
0927 13:50:06.035181 (+ 277us) catalog_manager.cc:2246] Wrote table and tablets to system table
0927 13:50:06.035425 (+ 244us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0927 13:50:06.035593 (+ 168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:05.998145 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:05.998241 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:05.998249 (+ 8us) write_op.cc:435] Acquired schema lock
0927 13:50:05.998253 (+ 4us) tablet.cc:662] Decoding operations
0927 13:50:05.998345 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:05.998364 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:05.998369 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:05.998469 (+ 100us) tablet.cc:701] Row locks acquired
0927 13:50:05.998471 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:50:05.998507 (+ 36us) write_op.cc:270] Start()
0927 13:50:05.998550 (+ 43us) write_op.cc:276] Timestamp: P: 1790517005998475 usec, L: 0
0927 13:50:05.998553 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:05.998734 (+ 181us) log.cc:844] Serialized 433 byte log entry
0927 13:50:06.017375 (+ 18641us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.017700 (+ 325us) write_op.cc:301] APPLY: starting
0927 13:50:06.017719 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.017765 (+ 46us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.017800 (+ 35us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.017968 (+ 168us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.018016 (+ 48us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 13:50:06.018027 (+ 11us) write_op.cc:312] APPLY: finished
0927 13:50:06.018157 (+ 130us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.018238 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.018267 (+ 29us) write_op.cc:454] Released schema lock
0927 13:50:06.018278 (+ 11us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":269,"apply.run_cpu_time_us":643,"apply.run_wall_time_us":642,"num_ops":2,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":702,"prepare.run_wall_time_us":718,"raft.queue_time_us":2536,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":252,"replication_time_us":18790}]]}
I20260927 13:50:06.037411 5244 raft_consensus.cc:2468] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:06.038285 6449 master_service.cc:960] ReplaceTablet: received request to replace tablet e1e574bc8b544039b440a845966eb1d4 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:06.039076 6447 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34390 (request call id 94) took 1097 ms. Trace:
I20260927 13:50:06.039232 6447 rpcz_store.cc:276] 0927 13:50:04.941656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.945814 (+1004158us) service_pool.cc:224] Handling call
0927 13:50:05.947681 (+ 1867us) catalog_manager.cc:2140] Acquired catalog manager lock
0927 13:50:05.948100 (+ 419us) catalog_manager.cc:2186] Created new table and tablet info
0927 13:50:05.958174 (+ 10074us) catalog_manager.cc:2246] Wrote table and tablets to system table
0927 13:50:06.038838 (+ 80664us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0927 13:50:06.038979 (+ 141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:05.948554 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:05.948649 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:05.948656 (+ 7us) write_op.cc:435] Acquired schema lock
0927 13:50:05.948658 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:05.948735 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:05.948745 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:05.948750 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:05.948812 (+ 62us) tablet.cc:701] Row locks acquired
0927 13:50:05.948815 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:05.948841 (+ 26us) write_op.cc:270] Start()
0927 13:50:05.948884 (+ 43us) write_op.cc:276] Timestamp: P: 1790517005948818 usec, L: 0
0927 13:50:05.948889 (+ 5us) op_driver.cc:348] REPLICATION: starting
0927 13:50:05.949035 (+ 146us) log.cc:844] Serialized 433 byte log entry
0927 13:50:05.952536 (+ 3501us) op_driver.cc:464] REPLICATION: finished
0927 13:50:05.952678 (+ 142us) write_op.cc:301] APPLY: starting
0927 13:50:05.952691 (+ 13us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:05.952723 (+ 32us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:05.952783 (+ 60us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:05.952953 (+ 170us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:05.952984 (+ 31us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 13:50:05.952999 (+ 15us) write_op.cc:312] APPLY: finished
0927 13:50:05.953060 (+ 61us) log.cc:844] Serialized 29 byte log entry
0927 13:50:05.953114 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.953133 (+ 19us) write_op.cc:454] Released schema lock
0927 13:50:05.953139 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:05.953198 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.953202 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":94976,"child_traces":[["op",{"apply.queue_time_us":100,"apply.run_cpu_time_us":514,"apply.run_wall_time_us":513,"num_ops":2,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":563,"prepare.run_wall_time_us":563,"raft.queue_time_us":60,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":3618}]]}
I20260927 13:50:06.040378 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e730a00ad2e646a4ba594ba9434c3b50" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:06.040623 5108 raft_consensus.cc:2393] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:50:06.040915 6447 master_service.cc:960] ReplaceTablet: received request to replace tablet 8ed33e78ee5448bcae633cc874c3e171 from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:06.042829 5628 tablet_bootstrap.cc:492] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:06.042982 5628 ts_tablet_manager.cc:1403] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.000s
I20260927 13:50:06.044116 5628 raft_consensus.cc:359] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.044298 5628 raft_consensus.cc:385] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.044368 5628 raft_consensus.cc:740] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.044535 5102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6985779674646f4abe18cdf7c063c90" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:06.044747 5102 raft_consensus.cc:2468] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:06.046466 5101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9503dd46ccf472581d1a667eea300ed" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:06.046620 5101 raft_consensus.cc:2468] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:05.970744 7190 ts_tablet_manager.cc:1929] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:06.050225 5619 tablet_bootstrap.cc:654] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.050033 7190 log.cc:1199] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/a813939920244be781d546311fe8a33e
I20260927 13:50:06.050807 7190 ts_tablet_manager.cc:1950] T a813939920244be781d546311fe8a33e P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:06.059108 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70f64e0b71a481d8b3b1aafafa0c65a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.044551 5628 consensus_queue.cc:260] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.076650 5628 ts_tablet_manager.cc:1434] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
W20260927 13:50:06.079046 5045 leader_election.cc:343] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.081079 5045 leader_election.cc:304] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.081725 5045 leader_election.cc:304] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.081987 7016 raft_consensus.cc:2749] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.082387 7016 raft_consensus.cc:2749] T b54cf8c485324f798d59edf65d52d7b5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.082854 5045 leader_election.cc:304] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.083145 6779 raft_consensus.cc:2749] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.083577 5045 leader_election.cc:304] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.084164 6779 raft_consensus.cc:2749] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260927 13:50:06.084637 5045 leader_election.cc:343] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.084806 5045 leader_election.cc:304] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.085083 6779 raft_consensus.cc:2749] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.085506 6779 raft_consensus.cc:493] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.085637 6779 raft_consensus.cc:515] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.086431 6779 leader_election.cc:290] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:06.087472 5045 leader_election.cc:343] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.087641 5045 leader_election.cc:304] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.087970 6779 raft_consensus.cc:2749] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:06.088477 5045 leader_election.cc:343] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.088660 5045 leader_election.cc:304] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.088923 6779 raft_consensus.cc:2749] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.091389 5628 tablet_bootstrap.cc:492] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:06.098865 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008516a474cc40f2b9de77b2f3e762cf" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:06.099073 5107 raft_consensus.cc:2468] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:06.054605 5626 tablet_bootstrap.cc:654] T 78c4bbb0512c4411916eb4c48731f32f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.080279 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008516a474cc40f2b9de77b2f3e762cf" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.099661 7275 tablet.cc:1751] T 564f5c92bf144fa1bfc2e1e07132dd69 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:06.100629 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 81) took 1402 ms. Trace:
I20260927 13:50:06.100835 7190 rpcz_store.cc:276] 0927 13:50:04.697800 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.978834 (+281034us) service_pool.cc:224] Handling call
0927 13:50:05.922599 (+943765us) ts_tablet_manager.cc:1151] Deleting tablet a813939920244be781d546311fe8a33e
0927 13:50:05.933362 (+ 10763us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:05.954015 (+ 20653us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:05.970695 (+ 16680us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.100604 (+129909us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14694,"tablet-delete.queue_time_us":943637}
I20260927 13:50:06.101387 7190 tablet_replica.cc:333] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:06.101553 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet a813939920244be781d546311fe8a33e (table default.Table_86f890e6a07c4dbda356960e42168324 [id=e6628f5e1e7448fe80da09bdd45dd251]) successfully deleted
I20260927 13:50:06.101650 7190 raft_consensus.cc:2243] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:06.101902 7190 pending_rounds.cc:70] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:50:06.102020 7190 pending_rounds.cc:77] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957646595747840 op_type: NO_OP noop_request { }
I20260927 13:50:06.102221 7190 raft_consensus.cc:2889] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:06.102394 7190 raft_consensus.cc:2272] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.103796 7190 ts_tablet_manager.cc:1916] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.104501 5045 leader_election.cc:304] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.105263 5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.001403 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet f46f45a0a13b4e05802a08880d7f6a01 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]) successfully deleted
W20260927 13:50:06.105351 5045 leader_election.cc:343] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:06.105432 6454 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c37d485f00e04ab79a168180c2e1ae88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:06.105495 5045 leader_election.cc:304] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:06.105479 6429 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 104091us
I20260927 13:50:06.105708 6779 raft_consensus.cc:2749] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260927 13:50:06.105769 6429 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a6596ed8c4d44ad58a7ec495a665d1e9 because the tablet was not found. No further retry: Not found: Tablet not found: a6596ed8c4d44ad58a7ec495a665d1e9
I20260927 13:50:06.105893 6779 raft_consensus.cc:2749] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:06.106057 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 58d9274ad0934f19a7c36325eee3dd59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58d9274ad0934f19a7c36325eee3dd59 already in progress: creating tablet
W20260927 13:50:06.107275 5045 leader_election.cc:343] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.107465 5045 leader_election.cc:304] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.107710 6779 raft_consensus.cc:2749] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.108976 5628 tablet_bootstrap.cc:654] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.111455 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.112891 5626 tablet_bootstrap.cc:492] T 78c4bbb0512c4411916eb4c48731f32f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:06.113265 5626 ts_tablet_manager.cc:1403] T 78c4bbb0512c4411916eb4c48731f32f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.007s
I20260927 13:50:06.114315 5626 raft_consensus.cc:359] T 78c4bbb0512c4411916eb4c48731f32f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.114609 5626 raft_consensus.cc:385] T 78c4bbb0512c4411916eb4c48731f32f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.114728 5626 raft_consensus.cc:740] T 78c4bbb0512c4411916eb4c48731f32f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.115124 5626 consensus_queue.cc:260] T 78c4bbb0512c4411916eb4c48731f32f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.115816 5626 ts_tablet_manager.cc:1434] T 78c4bbb0512c4411916eb4c48731f32f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:06.116147 5626 tablet_bootstrap.cc:492] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:06.118474 6454 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34390 (request call id 97) took 1093 ms. Trace:
I20260927 13:50:06.118603 6454 rpcz_store.cc:276] 0927 13:50:05.024967 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.999374 (+974407us) service_pool.cc:224] Handling call
0927 13:50:06.105555 (+106181us) catalog_manager.cc:2140] Acquired catalog manager lock
0927 13:50:06.106058 (+ 503us) catalog_manager.cc:2186] Created new table and tablet info
0927 13:50:06.118177 (+ 12119us) catalog_manager.cc:2246] Wrote table and tablets to system table
0927 13:50:06.118297 (+ 120us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0927 13:50:06.118408 (+ 111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.106639 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.106754 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.106760 (+ 6us) write_op.cc:435] Acquired schema lock
0927 13:50:06.106762 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:06.106872 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.106887 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.106892 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.106979 (+ 87us) tablet.cc:701] Row locks acquired
0927 13:50:06.106982 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:06.107020 (+ 38us) write_op.cc:270] Start()
0927 13:50:06.107053 (+ 33us) write_op.cc:276] Timestamp: P: 1790517006106978 usec, L: 0
0927 13:50:06.107056 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.107258 (+ 202us) log.cc:844] Serialized 433 byte log entry
0927 13:50:06.110778 (+ 3520us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.117262 (+ 6484us) write_op.cc:301] APPLY: starting
0927 13:50:06.117283 (+ 21us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.117327 (+ 44us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.117395 (+ 68us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.117510 (+ 115us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.117544 (+ 34us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 13:50:06.117552 (+ 8us) write_op.cc:312] APPLY: finished
0927 13:50:06.117636 (+ 84us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.117918 (+ 282us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.117943 (+ 25us) write_op.cc:454] Released schema lock
0927 13:50:06.117952 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:06.118045 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.118049 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":6407,"apply.run_cpu_time_us":591,"apply.run_wall_time_us":772,"num_ops":2,"prepare.queue_time_us":45,"prepare.run_cpu_time_us":734,"prepare.run_wall_time_us":735,"raft.queue_time_us":884,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":263,"replication_time_us":3693}]]}
I20260927 13:50:06.119220 5101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44dc61b4003469e8f404b73f22f7291" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:06.119392 5101 raft_consensus.cc:2468] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:06.118643 5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44dc61b4003469e8f404b73f22f7291" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.120208 6454 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_8bd375289d574bfeba1cc363b93ad32f" } modify_external_catalogs: true
I20260927 13:50:06.120397 6454 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_8bd375289d574bfeba1cc363b93ad32f" } modify_external_catalogs: true
I20260927 13:50:06.120764 7098 ts_tablet_manager.cc:1929] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:06.120930 7098 log.cc:1199] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/496cffc2a8774185a0e0f63208bed8a5
I20260927 13:50:06.121393 7098 ts_tablet_manager.cc:1950] T 496cffc2a8774185a0e0f63208bed8a5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:06.122017 5626 tablet_bootstrap.cc:654] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.122191 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 83) took 1753 ms. Trace:
I20260927 13:50:06.122319 7098 rpcz_store.cc:276] 0927 13:50:04.368578 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.526100 (+157522us) service_pool.cc:224] Handling call
0927 13:50:05.894621 (+1368521us) ts_tablet_manager.cc:1151] Deleting tablet 496cffc2a8774185a0e0f63208bed8a5
0927 13:50:05.894634 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:05.937231 (+ 42597us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.120701 (+183470us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.122172 (+ 1471us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1368070}
I20260927 13:50:06.122748 7098 tablet_replica.cc:333] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:06.122978 7098 raft_consensus.cc:2243] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.123306 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 496cffc2a8774185a0e0f63208bed8a5 (table default.Table_e5f8007fdae74bbe92a5c011cf80f361 [id=d6bdeaa183ee42c3ba0895927bda5096]) successfully deleted
W20260927 13:50:06.127406 6453 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3920ec6b5dbd4624a1ceeee9d17a8f4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:06.124776 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5848740410d74e749ad6c44591ab0d24" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.128746 7125 consensus_queue.cc:1048] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:06.129516 5319 leader_election.cc:304] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:06.129818 7125 raft_consensus.cc:2804] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:06.129940 7125 raft_consensus.cc:493] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:06.130069 7125 raft_consensus.cc:3060] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.133317 7125 raft_consensus.cc:515] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:06.133656 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 362f660cac76436aba54bb707d8a991c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 362f660cac76436aba54bb707d8a991c already in progress: creating tablet
I20260927 13:50:06.134063 7125 leader_election.cc:290] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.135003 5319 leader_election.cc:304] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:06.135311 6453 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34390 (request call id 98) took 1101 ms. Trace:
I20260927 13:50:06.135484 5319 leader_election.cc:304] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:06.135743 7231 raft_consensus.cc:2804] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:06.135811 7231 raft_consensus.cc:493] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:06.135869 7231 raft_consensus.cc:3060] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.135453 6453 rpcz_store.cc:276] 0927 13:50:05.033651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.028227 (+994576us) service_pool.cc:224] Handling call
0927 13:50:06.127553 (+ 99326us) catalog_manager.cc:2140] Acquired catalog manager lock
0927 13:50:06.128044 (+ 491us) catalog_manager.cc:2186] Created new table and tablet info
0927 13:50:06.135055 (+ 7011us) catalog_manager.cc:2246] Wrote table and tablets to system table
0927 13:50:06.135166 (+ 111us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0927 13:50:06.135253 (+ 87us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.128627 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.128737 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.128742 (+ 5us) write_op.cc:435] Acquired schema lock
0927 13:50:06.128744 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:06.128829 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.128840 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.128845 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.128926 (+ 81us) tablet.cc:701] Row locks acquired
0927 13:50:06.128928 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:50:06.128963 (+ 35us) write_op.cc:270] Start()
0927 13:50:06.128990 (+ 27us) write_op.cc:276] Timestamp: P: 1790517006128920 usec, L: 0
0927 13:50:06.128994 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.129131 (+ 137us) log.cc:844] Serialized 433 byte log entry
0927 13:50:06.132481 (+ 3350us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.134305 (+ 1824us) write_op.cc:301] APPLY: starting
0927 13:50:06.134319 (+ 14us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.134350 (+ 31us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.134384 (+ 34us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.134523 (+ 139us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.134565 (+ 42us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 13:50:06.134576 (+ 11us) write_op.cc:312] APPLY: finished
0927 13:50:06.134652 (+ 76us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.134873 (+ 221us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.134892 (+ 19us) write_op.cc:454] Released schema lock
0927 13:50:06.134898 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:06.134963 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.134966 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1772,"apply.run_cpu_time_us":503,"apply.run_wall_time_us":653,"num_ops":2,"prepare.queue_time_us":44,"prepare.run_cpu_time_us":611,"prepare.run_wall_time_us":610,"raft.queue_time_us":1015,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":246,"replication_time_us":3452}]]}
I20260927 13:50:06.136143 7282 tablet.cc:1751] T 0d54e51b5c104c75b938aba55cecf890 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:06.136670 6453 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_6c77468a637b4f33a5122599e6ad6d5f" } modify_external_catalogs: true
I20260927 13:50:06.136830 6453 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_6c77468a637b4f33a5122599e6ad6d5f" } modify_external_catalogs: true
W20260927 13:50:06.139312 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet a82284e3fd1f4a2f95c7e47320abb30c consensus state has no leader
I20260927 13:50:06.139256 7231 raft_consensus.cc:515] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:06.139681 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 3ee18063dc634385b9e61fae3b3ece99 consensus state has no leader
I20260927 13:50:06.140071 7231 leader_election.cc:290] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:06.140110 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb consensus state has no leader
I20260927 13:50:06.140316 7231 raft_consensus.cc:2749] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260927 13:50:06.140758 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5230aab9688e45b79bd0064716378152 consensus state has no leader
W20260927 13:50:06.143260 5319 leader_election.cc:343] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 1087ad60dade46bb9d38f52a94dd536b
I20260927 13:50:06.143476 5319 leader_election.cc:304] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:06.143869 5319 leader_election.cc:304] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:06.144132 7231 raft_consensus.cc:2749] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.144384 7231 raft_consensus.cc:2804] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:06.145136 7231 raft_consensus.cc:697] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
W20260927 13:50:06.125648 5185 leader_election.cc:343] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 46537e1b33f24d50b705d53f6978da3c
I20260927 13:50:06.145499 5185 leader_election.cc:304] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.145627 7231 consensus_queue.cc:237] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.145859 7203 raft_consensus.cc:2749] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:06.146044 5185 leader_election.cc:343] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 2cec272546cb4373bf69e3ab344c46e1
I20260927 13:50:06.146232 5185 leader_election.cc:304] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.146552 7203 raft_consensus.cc:2749] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.127722 5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e6bf85bf1434ab6ce42e751d31c6f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:06.126946 5044 leader_election.cc:343] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.154695 7098 raft_consensus.cc:2272] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.155344 7098 ts_tablet_manager.cc:1916] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.159754 7268 raft_consensus.cc:493] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.159884 7268 raft_consensus.cc:515] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.160615 7268 leader_election.cc:290] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.167109 5319 leader_election.cc:304] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:50:06.168056 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b6985779674646f4abe18cdf7c063c90 consensus state has no leader
W20260927 13:50:06.168391 5185 leader_election.cc:343] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 1ae6b1e46bdc4c28a2d0a2633d40f92a
W20260927 13:50:06.169095 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 992bf643dee64bccaa993a08027aa5fc (table default.Table_85388904282441d09642d64019688c97 [id=00fdc87b0cbf4bc091a92db3004b4397], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 992bf643dee64bccaa993a08027aa5fc consensus state has no leader
W20260927 13:50:06.169878 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 95726f690a71433ca63f95da4ee750e5 (table default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 95726f690a71433ca63f95da4ee750e5 consensus state has no leader
I20260927 13:50:06.128979 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:06.157397 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.158000 5072 tablet_service.cc:1558] Processing DeleteTablet for tablet 50fb1288684c45f6a778d809a5e2c160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.159051 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet bb7b3a35b2e94bbea6be4b4a8f158593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.170323 5107 raft_consensus.cc:2468] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:06.159335 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 008516a474cc40f2b9de77b2f3e762cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39028
W20260927 13:50:06.159447 5044 leader_election.cc:343] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:06.170666 5044 leader_election.cc:343] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.160640 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 with delete_type TABLET_DATA_DELETED (replaced by tablet c0d3e3f86440448a88404f0ac06e0c0c) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.161357 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 5978cb78bd974d669817def05007d0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.161389 5101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae6b1e46bdc4c28a2d0a2633d40f92a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
W20260927 13:50:06.170955 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d237de6ef27c49c4a330c07cb75c103d consensus state has no leader
I20260927 13:50:06.171085 5101 raft_consensus.cc:2393] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:06.161729 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet e25f5898369f46fba32b7df27b334b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.171463 7125 raft_consensus.cc:2804] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:06.171546 7125 raft_consensus.cc:493] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:06.171607 7125 raft_consensus.cc:3060] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.171630 5184 leader_election.cc:304] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.172165 7203 raft_consensus.cc:3060] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.174937 7203 raft_consensus.cc:2749] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.175184 5626 tablet_bootstrap.cc:492] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:06.175308 5626 ts_tablet_manager.cc:1403] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.007s
I20260927 13:50:06.176131 5626 raft_consensus.cc:359] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.176292 5626 raft_consensus.cc:385] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.176337 5626 raft_consensus.cc:740] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.176533 5626 consensus_queue.cc:260] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.176844 7125 raft_consensus.cc:515] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.177016 5626 ts_tablet_manager.cc:1434] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:50:06.177286 5626 tablet_bootstrap.cc:492] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:06.177644 7125 leader_election.cc:290] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.178730 5619 tablet_bootstrap.cc:492] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:06.178856 5619 ts_tablet_manager.cc:1403] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.198s user 0.004s sys 0.004s
I20260927 13:50:06.179020 5626 tablet_bootstrap.cc:654] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.185550 7190 ts_tablet_manager.cc:1929] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:06.185668 7190 log.cc:1199] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/3a07adcd33414d18ae9720e7a307548a
I20260927 13:50:06.186024 7190 ts_tablet_manager.cc:1950] T 3a07adcd33414d18ae9720e7a307548a P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:06.186305 7282 tablet.cc:1751] T 03917a40b5884401a6bc09c7925fd1ae P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:50:06.187999 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet f3f6a9c5e4be480796f433a68945dd72 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef5969312044a2bab451841ec65aa84) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.188181 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet bf557ac29964453583f224b46178c7dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.188385 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 84d9c94ee0af46e8aea12adac57829f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.188539 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39028
W20260927 13:50:06.192757 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 34cd6225aaf34bdbbec06df453d57301 consensus state has no leader
I20260927 13:50:06.194518 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 417b99e95ab4422d96b606fc76698324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.194598 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet b5a9f864e4274666a86baed43e1623cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.194792 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 334b0349bfaa4a9c8b7d280177f1ecae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39028
W20260927 13:50:06.194834 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a5feae3a28cd44ff9392a1574a444db3 consensus state has no leader
I20260927 13:50:06.194545 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 95726f690a71433ca63f95da4ee750e5 with delete_type TABLET_DATA_DELETED (replaced by tablet cddf1b48a78e4ff789e0bb0bf75e307b) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.196309 5626 tablet_bootstrap.cc:492] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:06.196504 5626 ts_tablet_manager.cc:1403] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.003s
W20260927 13:50:06.197162 6429 consensus_peers.cc:597] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c -> Peer 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095): Couldn't send request to peer 802b83f09d3445359cfac825cd87c9de. Status: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260927 13:50:06.197366 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aed7fe630f64213846ad37d904f6516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.197378 5626 raft_consensus.cc:359] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.197468 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet 71268fb7aa9646639ea41dc8ccebfc5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.197541 5626 raft_consensus.cc:385] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.197587 5626 raft_consensus.cc:740] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.197607 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bd9a95e2d24242aba890ee9d01c023 with delete_type TABLET_DATA_DELETED (replaced by tablet ad2b4316eeb643cc8c2440ed04191a57) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.197803 5072 tablet_service.cc:1558] Processing DeleteTablet for tablet e730a00ad2e646a4ba594ba9434c3b50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.197786 5626 consensus_queue.cc:260] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.197988 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b13c629908a47368846770c697aebd8 with delete_type TABLET_DATA_DELETED (replaced by tablet dec7c4c6b46d4b5791d9b7af1a8e55cc) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.198170 5074 tablet_service.cc:1558] Processing DeleteTablet for tablet 73546fba4ac846efbe9a9f4e346e4c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.198367 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 36181512a94c4702ae0a417665919faa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.198665 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 329fa4c25cec48f9830a8eb19794ea72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.198972 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet 614f1af61461466da975bea681162727 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.199133 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet c48ca4b429294782a9e6ed496c6dfb72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.199316 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bc839e0fc54839a5d06c176760f618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.199496 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet f702b0a6380543a8ac539125d4334cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.199831 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet ec130d31f6274fd9b730c2bb8bba817e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.199875 5626 ts_tablet_manager.cc:1434] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:50:06.200491 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet a9503dd46ccf472581d1a667eea300ed with delete_type TABLET_DATA_DELETED (replaced by tablet 4cb71dd1785841b1b031cb09422a505d) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.200846 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.201464 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 496cffc2a8774185a0e0f63208bed8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.201694 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet b9a1193719e140beb9b492927adeb78c with delete_type TABLET_DATA_DELETED (replaced by tablet a583d84f0f9247c68f330149b41e65ae) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.202056 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 370553521753488ab81e40144f2536ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.205783 5626 tablet_bootstrap.cc:492] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:06.207648 5626 tablet_bootstrap.cc:654] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.212121 5319 leader_election.cc:304] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:06.210146 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 82) took 1502 ms. Trace:
I20260927 13:50:06.213608 7190 rpcz_store.cc:276] 0927 13:50:04.707790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.978967 (+271177us) service_pool.cc:224] Handling call
0927 13:50:06.101334 (+1122367us) ts_tablet_manager.cc:1151] Deleting tablet 3a07adcd33414d18ae9720e7a307548a
0927 13:50:06.101345 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.182127 (+ 80782us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.185498 (+ 3371us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.210086 (+ 24588us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1122215}
I20260927 13:50:06.214224 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 3a07adcd33414d18ae9720e7a307548a (table default.Table_c470b14844004302969f3c3a0802ace8 [id=0a8e61eac14b4098a290333fcc01204e]) successfully deleted
I20260927 13:50:06.214641 7190 tablet_replica.cc:333] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:06.214890 7190 raft_consensus.cc:2243] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:06.215272 7190 raft_consensus.cc:2272] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.215867 7190 ts_tablet_manager.cc:1916] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.225854 5628 tablet_bootstrap.cc:492] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:06.226002 5628 ts_tablet_manager.cc:1403] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.135s user 0.001s sys 0.005s
I20260927 13:50:06.226765 5628 raft_consensus.cc:359] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.226951 5628 raft_consensus.cc:385] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.227013 5628 raft_consensus.cc:740] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.227224 5628 consensus_queue.cc:260] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.230022 7235 raft_consensus.cc:2804] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:06.222508 5619 raft_consensus.cc:359] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.237008 5619 raft_consensus.cc:385] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.238322 5619 raft_consensus.cc:740] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.238646 5619 consensus_queue.cc:260] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.244150 7292 tablet.cc:1751] T 03917a40b5884401a6bc09c7925fd1ae P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:50:06.246191 7190 ts_tablet_manager.cc:1929] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:06.246405 7190 log.cc:1199] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/7dc140bba42a43758fa0c6540d728275
I20260927 13:50:06.246846 7190 ts_tablet_manager.cc:1950] T 7dc140bba42a43758fa0c6540d728275 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:06.247633 5626 tablet_bootstrap.cc:492] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:06.247645 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 83) took 1527 ms. Trace:
I20260927 13:50:06.247922 7190 rpcz_store.cc:276] 0927 13:50:04.720713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.979118 (+258405us) service_pool.cc:224] Handling call
0927 13:50:06.214594 (+1235476us) ts_tablet_manager.cc:1151] Deleting tablet 7dc140bba42a43758fa0c6540d728275
0927 13:50:06.214604 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.229067 (+ 14463us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.246096 (+ 17029us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.247628 (+ 1532us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1235327}
I20260927 13:50:06.248327 7190 tablet_replica.cc:333] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:06.248523 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 7dc140bba42a43758fa0c6540d728275 (table default.Table_d19f692aecb1401a8f49d2595a038ce8 [id=b16ea2e5189e45a3a195694fdcd8d218]) successfully deleted
I20260927 13:50:06.248586 7190 raft_consensus.cc:2243] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:06.248883 7190 raft_consensus.cc:2272] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.249444 7190 ts_tablet_manager.cc:1916] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.255493 5619 ts_tablet_manager.cc:1434] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.077s user 0.001s sys 0.001s
I20260927 13:50:06.255858 5619 tablet_bootstrap.cc:492] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:06.247820 5626 ts_tablet_manager.cc:1403] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.005s
I20260927 13:50:06.256981 5626 raft_consensus.cc:359] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.257169 5626 raft_consensus.cc:385] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.257251 5626 raft_consensus.cc:740] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.257478 5626 consensus_queue.cc:260] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.258153 5626 ts_tablet_manager.cc:1434] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:06.258441 5626 tablet_bootstrap.cc:492] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:06.258606 5628 ts_tablet_manager.cc:1434] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.033s user 0.002s sys 0.000s
I20260927 13:50:06.260382 5626 tablet_bootstrap.cc:654] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.268219 5296 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:06.283465 6779 raft_consensus.cc:493] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.283887 6779 raft_consensus.cc:515] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.284793 7190 ts_tablet_manager.cc:1929] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:06.285193 6779 leader_election.cc:290] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.285156 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb0c2c2be04a598e011a9d99c5492a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.285588 7190 log.cc:1199] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/7c2f814bb9ff41ebab19e8c16cf4affa
W20260927 13:50:06.285722 5044 leader_election.cc:343] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.286445 5626 tablet_bootstrap.cc:492] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:06.286626 5626 ts_tablet_manager.cc:1403] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.001s
I20260927 13:50:06.286952 7231 consensus_queue.cc:1048] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:06.287412 5626 raft_consensus.cc:359] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.287695 5626 raft_consensus.cc:385] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.287815 5626 raft_consensus.cc:740] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.288067 7235 raft_consensus.cc:697] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:06.288102 5626 consensus_queue.cc:260] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.288609 7235 consensus_queue.cc:237] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.289059 7190 ts_tablet_manager.cc:1950] T 7c2f814bb9ff41ebab19e8c16cf4affa P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:06.289453 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 84) took 1484 ms. Trace:
I20260927 13:50:06.289569 7190 rpcz_store.cc:276] 0927 13:50:04.804686 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.979280 (+174594us) service_pool.cc:224] Handling call
0927 13:50:06.248281 (+1269001us) ts_tablet_manager.cc:1151] Deleting tablet 7c2f814bb9ff41ebab19e8c16cf4affa
0927 13:50:06.248291 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.253041 (+ 4750us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.284726 (+ 31685us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.289438 (+ 4712us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1268868}
I20260927 13:50:06.290091 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 7c2f814bb9ff41ebab19e8c16cf4affa (table default.Table_e02f217077414076ab9e4f74fdd61b36 [id=578e09c772874fefab419fe01b8672b5]) successfully deleted
I20260927 13:50:06.290287 5628 tablet_bootstrap.cc:492] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:06.290916 5626 ts_tablet_manager.cc:1434] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:50:06.291265 5626 tablet_bootstrap.cc:492] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:06.291997 5628 tablet_bootstrap.cc:654] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.292917 7190 tablet_replica.cc:333] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:06.293145 7190 raft_consensus.cc:2243] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:06.293666 5319 leader_election.cc:304] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:06.293727 7190 raft_consensus.cc:2272] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.293475 5626 tablet_bootstrap.cc:654] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.294010 5319 leader_election.cc:304] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:06.294337 5319 leader_election.cc:304] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:06.294694 5319 leader_election.cc:304] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:06.295210 7305 consensus_queue.cc:1048] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:06.295445 7190 ts_tablet_manager.cc:1916] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.295830 7305 raft_consensus.cc:2804] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:06.295990 7305 raft_consensus.cc:493] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:06.296116 7305 raft_consensus.cc:3060] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.299137 6451 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 0076228c3f224d1f9d76ccf2dd7064ae
I20260927 13:50:06.299571 7305 raft_consensus.cc:515] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.299743 6451 catalog_manager.cc:6934] ReplaceTablet: tablet 0076228c3f224d1f9d76ccf2dd7064ae deleted and replaced by tablet 7710c6561bd84945a9ff017daf74a085
I20260927 13:50:06.299870 6451 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:34390 (request call id 96) took 1308 ms. Trace:
I20260927 13:50:06.300166 7305 leader_election.cc:290] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.300215 5211 tablet_service.cc:1558] Processing DeleteTablet for tablet 0076228c3f224d1f9d76ccf2dd7064ae with delete_type TABLET_DATA_DELETED (replaced by tablet 7710c6561bd84945a9ff017daf74a085) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:06.300304 7305 raft_consensus.cc:2804] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:06.300374 7305 raft_consensus.cc:493] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:06.300428 7305 raft_consensus.cc:3060] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.299973 6451 rpcz_store.cc:276] 0927 13:50:04.991395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.989497 (+998102us) service_pool.cc:224] Handling call
0927 13:50:06.299822 (+310325us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.293811 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.293955 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.293961 (+ 6us) write_op.cc:435] Acquired schema lock
0927 13:50:06.293964 (+ 3us) tablet.cc:662] Decoding operations
0927 13:50:06.294081 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.294096 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.294102 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.294218 (+ 116us) tablet.cc:701] Row locks acquired
0927 13:50:06.294221 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:06.294259 (+ 38us) write_op.cc:270] Start()
0927 13:50:06.294295 (+ 36us) write_op.cc:276] Timestamp: P: 1790517006294233 usec, L: 0
0927 13:50:06.294299 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.294483 (+ 184us) log.cc:844] Serialized 625 byte log entry
0927 13:50:06.297878 (+ 3395us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.298039 (+ 161us) write_op.cc:301] APPLY: starting
0927 13:50:06.298056 (+ 17us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.298126 (+ 70us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.298159 (+ 33us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.298261 (+ 102us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.298311 (+ 50us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:06.298317 (+ 6us) write_op.cc:312] APPLY: finished
0927 13:50:06.298392 (+ 75us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.298454 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.298476 (+ 22us) write_op.cc:454] Released schema lock
0927 13:50:06.298483 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:06.298558 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.298562 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":110,"apply.run_cpu_time_us":509,"apply.run_wall_time_us":507,"num_ops":2,"prepare.queue_time_us":70,"prepare.run_cpu_time_us":777,"prepare.run_wall_time_us":777,"raft.queue_time_us":156,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":261,"replication_time_us":3538}]]}
I20260927 13:50:06.301298 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 0076228c3f224d1f9d76ccf2dd7064ae with delete_type TABLET_DATA_DELETED (replaced by tablet 7710c6561bd84945a9ff017daf74a085) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.301589 7235 raft_consensus.cc:2804] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:06.301659 7235 raft_consensus.cc:493] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:06.301712 7235 raft_consensus.cc:3060] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.305318 7231 raft_consensus.cc:2804] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:06.305476 7231 raft_consensus.cc:493] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:06.305606 7231 raft_consensus.cc:3060] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.308550 7231 raft_consensus.cc:515] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.311393 5626 tablet_bootstrap.cc:492] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:06.311600 5626 ts_tablet_manager.cc:1403] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260927 13:50:06.312409 5626 raft_consensus.cc:359] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:06.315202 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 16743b4513fa4987aee48f03e28cd498 consensus state has no leader
W20260927 13:50:06.317086 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 27131f0e8c9e4f1ea290989155ddcd0b consensus state has no leader
W20260927 13:50:06.317341 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 7e3f7ded9d644d749532e0700844bd62 consensus state has no leader
W20260927 13:50:06.317564 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d897f986d26a44f4894e147a74a90949 consensus state has no leader
W20260927 13:50:06.318046 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 58acd8932a2647a0a20679614cc2b68a consensus state has no leader
I20260927 13:50:06.319054 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e768c83fae54619ac849dfedd5ec654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.319548 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet dd0126a6df14457ca5c62c129f3275f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.319741 7190 ts_tablet_manager.cc:1929] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 13:50:06.319936 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet bd84d3cf740040739d81de2460296d2c consensus state has no leader
W20260927 13:50:06.320147 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet bad30e7310c842e6818471272f5d669e consensus state has no leader
I20260927 13:50:06.320686 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 26a8aca52f8c4566b274d13e6bb13ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39028
W20260927 13:50:06.321053 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 2a2ee02044b64e3eaff8136ac43f02e4 consensus state has no leader
I20260927 13:50:06.321588 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet c99bf2abdfc64f169a3937f3e4499f75 with delete_type TABLET_DATA_DELETED (replaced by tablet d212ee5cd8f7416a840d307b16ba5e28) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.322250 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet a003afa0fbb74d548cfaba51ea6cef58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.322842 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet a0575418f5ea4d82b34112e1bc9ab8b4 with delete_type TABLET_DATA_DELETED (replaced by tablet e3765fe06c664e60a11acf76c825bc42) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.322883 7203 raft_consensus.cc:493] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.323081 7203 raft_consensus.cc:515] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.323421 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a737bef14b4874b61a109305ebb993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.323673 7203 leader_election.cc:290] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:06.323678 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet a4099c41981f46758a8f478d7fdb4182 (table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a4099c41981f46758a8f478d7fdb4182 consensus state has no leader
I20260927 13:50:06.324193 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet bb980bca9f16480ba050971b58aa46f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.324463 5101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d9c94ee0af46e8aea12adac57829f7" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:06.324681 5101 raft_consensus.cc:2393] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:06.324991 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f4bc5cefef448d85ff31b7fafaca74 with delete_type TABLET_DATA_DELETED (replaced by tablet f3e3ebd06dd1429fa5ec20396e4bb5b6) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.325186 7190 log.cc:1199] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/50fb1288684c45f6a778d809a5e2c160
W20260927 13:50:06.325346 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet fb8c993214094940968aba3fcc38855c consensus state has no leader
I20260927 13:50:06.325752 7190 ts_tablet_manager.cc:1950] T 50fb1288684c45f6a778d809a5e2c160 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:06.326078 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet d9cb99ad45d1445cb2e2854319a3d73d with delete_type TABLET_DATA_DELETED (replaced by tablet c16673cfe45f4c81806f4dda3246d476) from {username='slave'} at 127.0.0.1:39028
W20260927 13:50:06.327041 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 01b549d0d21d421cba1c830d8e0bd04d consensus state has no leader
I20260927 13:50:06.328166 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64750141d74d988612304ce050688d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.328166 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ef5969312044a2bab451841ec65aa84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.329705 7098 ts_tablet_manager.cc:1929] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:06.329756 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 85) took 1519 ms. Trace:
I20260927 13:50:06.329854 7190 rpcz_store.cc:276] 0927 13:50:04.810152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.979422 (+169270us) service_pool.cc:224] Handling call
0927 13:50:06.292874 (+1313452us) ts_tablet_manager.cc:1151] Deleting tablet 50fb1288684c45f6a778d809a5e2c160
0927 13:50:06.292883 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.303374 (+ 10491us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.319665 (+ 16291us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.329737 (+ 10072us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1313337}
I20260927 13:50:06.330039 7098 log.cc:1199] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/08798185a7c641f98d7dc6a6b1b72e0a
I20260927 13:50:06.330659 7190 tablet_replica.cc:333] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:06.330871 7190 raft_consensus.cc:2243] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:06.331090 7098 ts_tablet_manager.cc:1950] T 08798185a7c641f98d7dc6a6b1b72e0a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:06.331321 7190 raft_consensus.cc:2272] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.331946 7190 ts_tablet_manager.cc:1916] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.333585 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 84) took 1963 ms. Trace:
I20260927 13:50:06.334066 7098 rpcz_store.cc:276] 0927 13:50:04.369910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.526618 (+156708us) service_pool.cc:224] Handling call
0927 13:50:06.122700 (+1596082us) ts_tablet_manager.cc:1151] Deleting tablet 08798185a7c641f98d7dc6a6b1b72e0a
0927 13:50:06.122710 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.216452 (+ 93742us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.329655 (+113203us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.333564 (+ 3909us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1595696}
I20260927 13:50:06.334592 7231 leader_election.cc:290] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.319681 5619 tablet_bootstrap.cc:654] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.326637 5319 leader_election.cc:304] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:06.337368 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e6bf85bf1434ab6ce42e751d31c6f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:06.337502 7098 tablet_replica.cc:333] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:06.337566 5385 raft_consensus.cc:2468] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:06.337694 7098 raft_consensus.cc:2243] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.337673 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5848740410d74e749ad6c44591ab0d24" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:06.337286 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:06.337942 5381 raft_consensus.cc:2468] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:06.338344 7098 raft_consensus.cc:2272] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.339007 7098 ts_tablet_manager.cc:1916] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.345454 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb0c2c2be04a598e011a9d99c5492a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:06.346237 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d9c94ee0af46e8aea12adac57829f7" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:06.347255 5628 tablet_bootstrap.cc:492] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:06.347411 5628 ts_tablet_manager.cc:1403] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.000s
I20260927 13:50:06.348047 7312 raft_consensus.cc:2804] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:06.348217 7312 raft_consensus.cc:493] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:06.348377 7312 raft_consensus.cc:3060] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.353847 7282 tablet.cc:1751] T 66b0c74e3ff84cc2889de29106c43350 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:06.327476 7235 raft_consensus.cc:515] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.365831 7235 leader_election.cc:290] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.372164 5185 leader_election.cc:304] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.372442 7190 ts_tablet_manager.cc:1929] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:06.372529 7190 log.cc:1199] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/2657276c4b2f43c1ad64a8c1fd58ada9
I20260927 13:50:06.372805 7203 raft_consensus.cc:3060] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.372879 7190 ts_tablet_manager.cc:1950] T 2657276c4b2f43c1ad64a8c1fd58ada9 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:06.374709 5628 raft_consensus.cc:359] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.374893 5628 raft_consensus.cc:385] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.374951 5628 raft_consensus.cc:740] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.376025 7203 raft_consensus.cc:2749] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.375730 5628 consensus_queue.cc:260] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.374573 5626 raft_consensus.cc:385] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.377184 5626 raft_consensus.cc:740] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.377446 5626 consensus_queue.cc:260] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.378509 5102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0827a26334c42728545a9eaa006fae0" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:06.380339 5102 raft_consensus.cc:3060] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.383308 5102 raft_consensus.cc:2468] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:06.383541 5106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff7d501f7704e69b696053cb1b1ffe5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:06.383678 5106 raft_consensus.cc:3060] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.384903 7098 ts_tablet_manager.cc:1929] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:06.384991 7098 log.cc:1199] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/7e3b98290dc74d88856e13f003a1e4c7
I20260927 13:50:06.385277 7098 ts_tablet_manager.cc:1950] T 7e3b98290dc74d88856e13f003a1e4c7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:06.386518 5101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c69163fb77442be9215f8f285b904ef" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:06.386653 5101 raft_consensus.cc:3060] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.387060 7292 tablet.cc:1751] T 66b0c74e3ff84cc2889de29106c43350 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:06.389321 5101 raft_consensus.cc:2468] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:06.390666 7312 raft_consensus.cc:515] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.391405 5106 raft_consensus.cc:2468] T 6ff7d501f7704e69b696053cb1b1ffe5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:06.330459 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 50fb1288684c45f6a778d809a5e2c160 (table default.Table_d7e2b621de8d45e69f6e88b3e51354d5 [id=d472fc89c3d9450c85f175d6443a76f0]) successfully deleted
W20260927 13:50:06.394194 6428 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 63760.1us
I20260927 13:50:06.394631 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 08798185a7c641f98d7dc6a6b1b72e0a (table default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]) successfully deleted
W20260927 13:50:06.371109 6429 catalog_manager.cc:5136] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): alter failed for tablet 36181512a94c4702ae0a417665919faa (table default.Table_06b04cbe300b4373813df57694d32684 [id=ed3f5ac2c7fe4efeaa58e8a11100851b]),no further retry: Not found: Tablet not found: 36181512a94c4702ae0a417665919faa
I20260927 13:50:06.395275 7317 tablet.cc:1751] T 564f5c92bf144fa1bfc2e1e07132dd69 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260927 13:50:06.395802 6429 catalog_manager.cc:5136] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): alter failed for tablet f46f45a0a13b4e05802a08880d7f6a01 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]),no further retry: Not found: Tablet not found: f46f45a0a13b4e05802a08880d7f6a01
I20260927 13:50:06.396185 7319 tablet.cc:1751] T 0d54e51b5c104c75b938aba55cecf890 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260927 13:50:06.396642 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 269cda0876e346149512e0b4985c6890 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 269cda0876e346149512e0b4985c6890 already in progress: creating tablet
W20260927 13:50:06.397367 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 9fdef4f56d9647118afe83ac3cd364fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fdef4f56d9647118afe83ac3cd364fd already in progress: creating tablet
W20260927 13:50:06.398241 6429 catalog_manager.cc:5136] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): alter failed for tablet 60de1c28618f4e478aae68ad07fbcf98 (table default.Table_4ce714062e7c4acf8c4945dc787ca610 [id=bb3d7fe49247480e915884c8fb8db579]),no further retry: Not found: Tablet not found: 60de1c28618f4e478aae68ad07fbcf98
I20260927 13:50:06.398988 7269 raft_consensus.cc:493] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.399112 7269 raft_consensus.cc:515] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.399768 7269 leader_election.cc:290] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.377748 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c69163fb77442be9215f8f285b904ef" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:06.377760 5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0827a26334c42728545a9eaa006fae0" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:06.379096 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff7d501f7704e69b696053cb1b1ffe5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:06.380725 5247 raft_consensus.cc:3060] T 78c4bbb0512c4411916eb4c48731f32f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.400375 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3f7ded9d644d749532e0700844bd62" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.401842 5626 ts_tablet_manager.cc:1434] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.090s user 0.017s sys 0.000s
I20260927 13:50:06.403937 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet d9198ace6a264737a990d6fb573faf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
W20260927 13:50:06.403962 5044 leader_election.cc:343] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.404573 5626 tablet_bootstrap.cc:492] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:06.404481 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 97b46497d8254a248df8d421d0b09d8d (table default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 97b46497d8254a248df8d421d0b09d8d consensus state has no leader
I20260927 13:50:06.399900 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 86) took 1485 ms. Trace:
I20260927 13:50:06.405383 7269 raft_consensus.cc:493] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.405409 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 6964f549d6214ad9a21cf213a9bfa3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.405354 7190 rpcz_store.cc:276] 0927 13:50:04.914807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.979549 (+ 64742us) service_pool.cc:224] Handling call
0927 13:50:06.330614 (+1351065us) ts_tablet_manager.cc:1151] Deleting tablet 2657276c4b2f43c1ad64a8c1fd58ada9
0927 13:50:06.330624 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.347444 (+ 16820us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.372394 (+ 24950us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.399872 (+ 27478us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1350952}
I20260927 13:50:06.405503 7269 raft_consensus.cc:515] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.405793 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 2657276c4b2f43c1ad64a8c1fd58ada9 (table default.Table_b12c6e4211af4ab7b866815072339fe6 [id=3e30b8610f4c4406a115aaeee8abebdf]) successfully deleted
I20260927 13:50:06.405901 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 85) took 2034 ms. Trace:
I20260927 13:50:06.405964 7098 rpcz_store.cc:276] 0927 13:50:04.371274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.527111 (+155837us) service_pool.cc:224] Handling call
0927 13:50:06.337451 (+1810340us) ts_tablet_manager.cc:1151] Deleting tablet 7e3b98290dc74d88856e13f003a1e4c7
0927 13:50:06.337463 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.365678 (+ 28215us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.384852 (+ 19174us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.405883 (+ 21031us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7968,"tablet-delete.queue_time_us":1809935}
I20260927 13:50:06.406078 7190 tablet_replica.cc:333] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:06.406311 7190 raft_consensus.cc:2243] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.406526 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cb1d6091729498698924e6857ebfd6c with delete_type TABLET_DATA_DELETED (replaced by tablet 55f62f4ba23f4b82b9bcde89126ce1e6) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.406078 7269 leader_election.cc:290] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:06.406566 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 502fe193f2034e37a53b245bbf049ae8 consensus state has no leader
I20260927 13:50:06.406785 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 7e3b98290dc74d88856e13f003a1e4c7 (table default.Table_be356ba34c0348f9bf24f85cddfd1e0d [id=24a51641d02d4f49b1a7b093da801017]) successfully deleted
I20260927 13:50:06.407366 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25f5898369f46fba32b7df27b334b28" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.407474 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.407727 7190 raft_consensus.cc:2272] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:06.407775 6424 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet bad30e7310c842e6818471272f5d669e consensus state has no leader
W20260927 13:50:06.407763 5044 leader_election.cc:343] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.408213 7098 tablet_replica.cc:333] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:06.408488 7190 ts_tablet_manager.cc:1916] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:06.408353 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet eed08fbd918b4b78b6ab8f4099506e29 consensus state has no leader
I20260927 13:50:06.409078 5626 tablet_bootstrap.cc:654] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:06.410930 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b54cf8c485324f798d59edf65d52d7b5 consensus state has no leader
I20260927 13:50:06.409376 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 45096e907a9c44b7ace81357cdd575d4 with delete_type TABLET_DATA_DELETED (replaced by tablet fd861e06085e4c7b8bdf1101432bdc31) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.410538 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet ecb5cdc007074e0c8f44d963e527a955 with delete_type TABLET_DATA_DELETED (replaced by tablet fc25ff5c6a3545759e7de977f91a9453) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.411846 7098 raft_consensus.cc:2243] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:50:06.393157 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 9fdef4f56d9647118afe83ac3cd364fd (table default.Table_f9afa72c04394383a22302115766399d [id=c073a79da0b440698186e6856c8c8c68], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 9fdef4f56d9647118afe83ac3cd364fd consensus state has no leader
W20260927 13:50:06.412530 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet eef853d6e6ce4848927c9de884d39ac2 consensus state has no leader
I20260927 13:50:06.412163 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a40f69bb7d842889be30c4629d6786f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
W20260927 13:50:06.413313 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 1b4494b7e895454f81fef308950729ef (table default.Table_3403808c5c374ea394fee64ad76c8d73 [id=ee0789e9d1f34c3791d35794473e2246], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 1b4494b7e895454f81fef308950729ef consensus state has no leader
I20260927 13:50:06.413173 7098 raft_consensus.cc:2272] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:06.415491 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1436bcea966646969789e6e09f91c557 consensus state has no leader
I20260927 13:50:06.416291 7098 ts_tablet_manager.cc:1916] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.424172 5628 ts_tablet_manager.cc:1434] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.077s user 0.002s sys 0.000s
I20260927 13:50:06.426383 7269 raft_consensus.cc:493] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.426514 7269 raft_consensus.cc:515] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.427096 7269 leader_election.cc:290] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.427459 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82284e3fd1f4a2f95c7e47320abb30c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:06.427951 5044 leader_election.cc:343] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.428894 7190 ts_tablet_manager.cc:1929] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:06.433983 5098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6985779674646f4abe18cdf7c063c90" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:06.434194 5098 raft_consensus.cc:3060] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.434502 7016 raft_consensus.cc:493] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.434679 7016 raft_consensus.cc:515] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.435335 7016 leader_election.cc:290] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.437608 5098 raft_consensus.cc:2468] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:06.402467 7251 tablet.cc:1751] T 66b0c74e3ff84cc2889de29106c43350 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:06.442327 7190 log.cc:1199] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/e26a3a50396940cf826442e4ba7356a8
I20260927 13:50:06.442967 7190 ts_tablet_manager.cc:1950] T e26a3a50396940cf826442e4ba7356a8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:06.444224 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 87) took 1519 ms. Trace:
I20260927 13:50:06.437922 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44dc61b4003469e8f404b73f22f7291" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:06.440929 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6985779674646f4abe18cdf7c063c90" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:06.436089 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d897f986d26a44f4894e147a74a90949" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.446131 7190 rpcz_store.cc:276] 0927 13:50:04.924752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.979672 (+ 54920us) service_pool.cc:224] Handling call
0927 13:50:06.406037 (+1426365us) ts_tablet_manager.cc:1151] Deleting tablet e26a3a50396940cf826442e4ba7356a8
0927 13:50:06.406046 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.422604 (+ 16558us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.428848 (+ 6244us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.444206 (+ 15358us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1426249}
I20260927 13:50:06.447009 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet e26a3a50396940cf826442e4ba7356a8 (table default.Table_3c83565e14ba4bdf96fcfceb17acdff3 [id=5f94649e22074c50b31b2156366e8993]) successfully deleted
I20260927 13:50:06.425628 5619 tablet_bootstrap.cc:492] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:06.447424 5619 ts_tablet_manager.cc:1403] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.192s user 0.005s sys 0.001s
I20260927 13:50:06.447985 7190 tablet_replica.cc:333] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:06.448252 5619 raft_consensus.cc:359] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.448359 7190 raft_consensus.cc:2243] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
W20260927 13:50:06.449018 5044 leader_election.cc:343] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.449297 7190 raft_consensus.cc:2272] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.448441 5619 raft_consensus.cc:385] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.450129 5619 raft_consensus.cc:740] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.450435 5619 consensus_queue.cc:260] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.452055 5628 tablet_bootstrap.cc:492] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:06.455129 5628 tablet_bootstrap.cc:654] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.455767 7312 leader_election.cc:290] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.457953 5364 tablet_service.cc:1558] Processing DeleteTablet for tablet 0191cfad4e7a4b088b2ecdc246bfa58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.458040 5360 tablet_service.cc:1558] Processing DeleteTablet for tablet bf557ac29964453583f224b46178c7dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.458606 7304 raft_consensus.cc:493] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.458948 7304 raft_consensus.cc:515] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.459576 7304 leader_election.cc:290] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.459774 5626 tablet_bootstrap.cc:492] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:06.459894 5626 ts_tablet_manager.cc:1403] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.055s user 0.009s sys 0.002s
I20260927 13:50:06.460516 5626 raft_consensus.cc:359] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.460716 5626 raft_consensus.cc:385] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.460804 5626 raft_consensus.cc:740] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.461432 5626 consensus_queue.cc:260] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.462242 5626 ts_tablet_manager.cc:1434] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:06.462647 5626 tablet_bootstrap.cc:492] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:06.464350 5626 tablet_bootstrap.cc:654] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.464856 7268 raft_consensus.cc:493] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.464980 7268 raft_consensus.cc:515] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:06.465349 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 69606adaa96d431791ed5c8455a7c548 consensus state has no leader
I20260927 13:50:06.465468 7268 leader_election.cc:290] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.466446 7305 raft_consensus.cc:515] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:06.468578 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet cc8de5211f7b4d3daa14b825ce17793a consensus state has no leader
W20260927 13:50:06.473059 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 187b3ceeccb142c4b798947e584d6044 (table default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 187b3ceeccb142c4b798947e584d6044 consensus state has no leader
I20260927 13:50:06.466763 5360 tablet_service.cc:1558] Processing DeleteTablet for tablet 334b0349bfaa4a9c8b7d280177f1ecae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.467041 5364 tablet_service.cc:1558] Processing DeleteTablet for tablet 417b99e95ab4422d96b606fc76698324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.467083 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:06.479468 5381 raft_consensus.cc:2393] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:06.467157 5350 tablet_service.cc:1558] Processing DeleteTablet for tablet e25f5898369f46fba32b7df27b334b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.467571 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b082227264e442a8b1db7a68fb0c3eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.467824 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e3fa4870d5547a2bbffe1745b964504 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.468068 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 008516a474cc40f2b9de77b2f3e762cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.468439 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 1087ad60dade46bb9d38f52a94dd536b with delete_type TABLET_DATA_DELETED (replaced by tablet 07830b76d7e14ff0b6b1b1523dda21bc) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.468719 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 with delete_type TABLET_DATA_DELETED (replaced by tablet c0d3e3f86440448a88404f0ac06e0c0c) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.469169 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet 413d863d9a564e5d8325b4479346730d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.469332 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 5978cb78bd974d669817def05007d0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.480020 7111 tablet_replica.cc:333] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:06.480214 7111 raft_consensus.cc:2243] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.480399 7111 raft_consensus.cc:2272] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.481033 7111 ts_tablet_manager.cc:1916] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.469451 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e1acd618fc44be9169fa1d56fa510a with delete_type TABLET_DATA_DELETED (replaced by tablet 14f5479761f94ee0b339e125d06a808c) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.469710 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet c48ca4b429294782a9e6ed496c6dfb72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.469966 5346 tablet_service.cc:1558] Processing DeleteTablet for tablet f3f6a9c5e4be480796f433a68945dd72 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef5969312044a2bab451841ec65aa84) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.470239 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 84d9c94ee0af46e8aea12adac57829f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.470527 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet b5a9f864e4274666a86baed43e1623cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.489048 7111 ts_tablet_manager.cc:1929] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:06.489271 7111 log.cc:1199] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/2b082227264e442a8b1db7a68fb0c3eb
I20260927 13:50:06.489899 7111 ts_tablet_manager.cc:1950] T 2b082227264e442a8b1db7a68fb0c3eb P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:06.491600 7190 ts_tablet_manager.cc:1916] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.457238 5045 leader_election.cc:304] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:50:06.493027 5045 leader_election.cc:343] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.493166 5045 leader_election.cc:304] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.493610 5045 leader_election.cc:304] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:06.457535 5102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44dc61b4003469e8f404b73f22f7291" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:06.460647 7321 raft_consensus.cc:493] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.464184 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet a0e14fd01a9141cdb2df030ee0dd05db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.464797 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 284f6113fa4b443a869bce6d0c15f273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.465979 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:06.496167 5102 raft_consensus.cc:3060] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.466764 7098 ts_tablet_manager.cc:1929] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:06.468083 5077 tablet_service.cc:1558] Processing DeleteTablet for tablet b0d6a3af321049b099e72dbfeb6b7a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.496379 5100 raft_consensus.cc:2393] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:50:06.469635 5074 tablet_service.cc:1558] Processing DeleteTablet for tablet fbde77915c7d4665965bef2298c3491f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.470712 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet a90d9bb192cf4e26812abb9c2ecc3682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.496392 7098 log.cc:1199] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/30bbc6c76a194e5dbd5e9ea08e95f4f7
I20260927 13:50:06.466674 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet b3fbf1e7f5e04122a65f6e192ffdae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.471745 5072 tablet_service.cc:1558] Processing DeleteTablet for tablet 39fa23553c554826ad811ebe2e978ef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.496923 7098 ts_tablet_manager.cc:1950] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:06.496793 7321 raft_consensus.cc:515] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.497579 7321 leader_election.cc:290] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.497689 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 86) took 2124 ms. Trace:
I20260927 13:50:06.497732 7321 raft_consensus.cc:2804] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:06.497779 7098 rpcz_store.cc:276] 0927 13:50:04.372944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.527623 (+154679us) service_pool.cc:224] Handling call
0927 13:50:06.408170 (+1880547us) ts_tablet_manager.cc:1151] Deleting tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7
0927 13:50:06.408179 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.423520 (+ 15341us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.466653 (+ 43133us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.497669 (+ 31016us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1880153}
I20260927 13:50:06.497787 7321 raft_consensus.cc:493] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:06.498288 7321 raft_consensus.cc:3060] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.498392 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 (table default.Table_94c0c28bb2b3422e810d8de243a2ccb2 [id=d226d55db789403b9b31e6a5461c8b5b]) successfully deleted
I20260927 13:50:06.498615 7098 tablet_replica.cc:333] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:06.498826 7098 raft_consensus.cc:2243] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.498948 7269 raft_consensus.cc:2749] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.498953 7098 raft_consensus.cc:2272] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.499130 5102 raft_consensus.cc:2468] T c44dc61b4003469e8f404b73f22f7291 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:06.499547 7098 ts_tablet_manager.cc:1916] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.506608 7321 raft_consensus.cc:515] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.515143 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet cf1a58c67bf54493a3c62fb175acabb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9abb473dbb3d491c9d15a161541fe795) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.515399 5072 tablet_service.cc:1558] Processing DeleteTablet for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.515582 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet 14f5479761f94ee0b339e125d06a808c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.515764 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet d3149f6bbaf043f08970e19fd66c4e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.517088 5086 tablet_service.cc:1558] Processing DeleteTablet for tablet b0827a26334c42728545a9eaa006fae0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5978cb78bd974d669817def05007d0ea) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.517277 5072 tablet_service.cc:1558] Processing DeleteTablet for tablet 60de1c28618f4e478aae68ad07fbcf98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.517431 5080 tablet_service.cc:1558] Processing DeleteTablet for tablet d3b38f40431f47a0acf1e11092d7717b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.517568 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 44d85213c05c465abda78cc49c70d36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.492249 7305 leader_election.cc:290] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.479112 5619 ts_tablet_manager.cc:1434] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260927 13:50:06.521658 5619 tablet_bootstrap.cc:492] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:06.499986 5184 leader_election.cc:304] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.523028 7268 raft_consensus.cc:3060] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.499990 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf557ac29964453583f224b46178c7dd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.511780 5626 tablet_bootstrap.cc:492] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:06.526360 5626 ts_tablet_manager.cc:1403] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.064s user 0.005s sys 0.002s
I20260927 13:50:06.526060 7268 raft_consensus.cc:2749] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.526757 7098 ts_tablet_manager.cc:1929] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:06.526934 7098 log.cc:1199] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/98e2e305b92a4492a0df14a506c768f3
I20260927 13:50:06.527083 5626 raft_consensus.cc:359] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.527277 5626 raft_consensus.cc:385] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.527338 5626 raft_consensus.cc:740] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.527448 7098 ts_tablet_manager.cc:1950] T 98e2e305b92a4492a0df14a506c768f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:06.527549 5626 consensus_queue.cc:260] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.527850 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 87) took 2153 ms. Trace:
I20260927 13:50:06.528075 5626 ts_tablet_manager.cc:1434] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:06.528168 7098 rpcz_store.cc:276] 0927 13:50:04.374224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.528141 (+153917us) service_pool.cc:224] Handling call
0927 13:50:06.498093 (+1969952us) ts_tablet_manager.cc:1151] Deleting tablet 98e2e305b92a4492a0df14a506c768f3
0927 13:50:06.498102 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.503437 (+ 5335us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.526632 (+ 23195us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.527834 (+ 1202us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1969394}
I20260927 13:50:06.528369 5626 tablet_bootstrap.cc:492] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:06.531469 5619 tablet_bootstrap.cc:654] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:06.530004 5044 leader_election.cc:343] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.531893 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 98e2e305b92a4492a0df14a506c768f3 (table default.Table_97f900bc6c8b4b829da15d428de9e4ed [id=6790f313d1d64f38a77d52eebd7ca586]) successfully deleted
I20260927 13:50:06.533398 7098 tablet_replica.cc:333] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:06.533627 7098 raft_consensus.cc:2243] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.533856 7098 raft_consensus.cc:2272] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.533967 7111 tablet_replica.cc:333] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:06.534202 7111 raft_consensus.cc:2243] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.534376 7111 raft_consensus.cc:2272] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.534582 7098 ts_tablet_manager.cc:1916] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.529660 5626 tablet_bootstrap.cc:654] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:06.542088 6445 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1aaffd54534442e1aa6db158d313fab3 consensus state has no leader
I20260927 13:50:06.547008 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bc839e0fc54839a5d06c176760f618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.547516 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 614f1af61461466da975bea681162727 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.548807 6447 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 8ed33e78ee5448bcae633cc874c3e171
I20260927 13:50:06.549364 6447 catalog_manager.cc:6934] ReplaceTablet: tablet 8ed33e78ee5448bcae633cc874c3e171 deleted and replaced by tablet f4cfddedc5cc4ec4a40b071253254703
I20260927 13:50:06.549518 6447 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:34390 (request call id 100) took 1251 ms. Trace:
I20260927 13:50:06.550007 5211 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ed33e78ee5448bcae633cc874c3e171 with delete_type TABLET_DATA_DELETED (replaced by tablet f4cfddedc5cc4ec4a40b071253254703) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:06.549628 6447 rpcz_store.cc:276] 0927 13:50:05.298065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.040689 (+742624us) service_pool.cc:224] Handling call
0927 13:50:06.549459 (+508770us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.359549 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.359716 (+ 167us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.359726 (+ 10us) write_op.cc:435] Acquired schema lock
0927 13:50:06.359731 (+ 5us) tablet.cc:662] Decoding operations
0927 13:50:06.359910 (+ 179us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.359929 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.359937 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.360048 (+ 111us) tablet.cc:701] Row locks acquired
0927 13:50:06.360052 (+ 4us) write_op.cc:260] PREPARE: finished
0927 13:50:06.360094 (+ 42us) write_op.cc:270] Start()
0927 13:50:06.360136 (+ 42us) write_op.cc:276] Timestamp: P: 1790517006360060 usec, L: 0
0927 13:50:06.360141 (+ 5us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.360357 (+ 216us) log.cc:844] Serialized 625 byte log entry
0927 13:50:06.363964 (+ 3607us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.364424 (+ 460us) write_op.cc:301] APPLY: starting
0927 13:50:06.364442 (+ 18us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.364496 (+ 54us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.364547 (+ 51us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.364660 (+ 113us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.364738 (+ 78us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:06.364750 (+ 12us) write_op.cc:312] APPLY: finished
0927 13:50:06.364835 (+ 85us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.364911 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.364929 (+ 18us) write_op.cc:454] Released schema lock
0927 13:50:06.364935 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:06.364999 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.365003 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":406,"apply.run_cpu_time_us":571,"apply.run_wall_time_us":571,"num_ops":2,"prepare.queue_time_us":167,"prepare.run_cpu_time_us":943,"prepare.run_wall_time_us":942,"raft.queue_time_us":195,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":309,"replication_time_us":3791}]]}
I20260927 13:50:06.550258 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ed33e78ee5448bcae633cc874c3e171 with delete_type TABLET_DATA_DELETED (replaced by tablet f4cfddedc5cc4ec4a40b071253254703) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.550891 6447 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_2b497c46186046989a9abb789a03949b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:06.551504 6447 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b497c46186046989a9abb789a03949b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:06.552634 7111 ts_tablet_manager.cc:1916] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.556591 5628 tablet_bootstrap.cc:492] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:06.556833 5628 ts_tablet_manager.cc:1403] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.105s user 0.005s sys 0.000s
I20260927 13:50:06.557194 6449 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet e1e574bc8b544039b440a845966eb1d4
I20260927 13:50:06.557693 5628 raft_consensus.cc:359] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:06.557904 5628 raft_consensus.cc:385] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.558000 5628 raft_consensus.cc:740] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.558053 6449 catalog_manager.cc:6934] ReplaceTablet: tablet e1e574bc8b544039b440a845966eb1d4 deleted and replaced by tablet cc5cb26760e844aab324d5c4f4d2b488
I20260927 13:50:06.558203 6449 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:34390 (request call id 99) took 1391 ms. Trace:
I20260927 13:50:06.558266 5211 tablet_service.cc:1558] Processing DeleteTablet for tablet e1e574bc8b544039b440a845966eb1d4 with delete_type TABLET_DATA_DELETED (replaced by tablet cc5cb26760e844aab324d5c4f4d2b488) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:06.558291 5628 consensus_queue.cc:260] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:06.558796 5628 ts_tablet_manager.cc:1434] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:06.558350 6449 rpcz_store.cc:276] 0927 13:50:05.166646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.038102 (+871456us) service_pool.cc:224] Handling call
0927 13:50:06.558169 (+520067us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.374959 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.375084 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.375090 (+ 6us) write_op.cc:435] Acquired schema lock
0927 13:50:06.375095 (+ 5us) tablet.cc:662] Decoding operations
0927 13:50:06.375264 (+ 169us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.375281 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.375288 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.375388 (+ 100us) tablet.cc:701] Row locks acquired
0927 13:50:06.375392 (+ 4us) write_op.cc:260] PREPARE: finished
0927 13:50:06.375431 (+ 39us) write_op.cc:270] Start()
0927 13:50:06.375468 (+ 37us) write_op.cc:276] Timestamp: P: 1790517006375397 usec, L: 0
0927 13:50:06.375474 (+ 6us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.375669 (+ 195us) log.cc:844] Serialized 625 byte log entry
0927 13:50:06.379308 (+ 3639us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.379784 (+ 476us) write_op.cc:301] APPLY: starting
0927 13:50:06.379800 (+ 16us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.379842 (+ 42us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.379891 (+ 49us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.380010 (+ 119us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.380065 (+ 55us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:06.380077 (+ 12us) write_op.cc:312] APPLY: finished
0927 13:50:06.380166 (+ 89us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.380233 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.380257 (+ 24us) write_op.cc:454] Released schema lock
0927 13:50:06.380266 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:06.380338 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.380341 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":401,"apply.run_cpu_time_us":566,"apply.run_wall_time_us":566,"num_ops":2,"prepare.queue_time_us":87,"prepare.run_cpu_time_us":842,"prepare.run_wall_time_us":1418,"raft.queue_time_us":57,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":322,"replication_time_us":3804}]]}
I20260927 13:50:06.559216 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet e1e574bc8b544039b440a845966eb1d4 with delete_type TABLET_DATA_DELETED (replaced by tablet cc5cb26760e844aab324d5c4f4d2b488) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.559293 5628 tablet_bootstrap.cc:492] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:06.559883 6449 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_01f1e5668a7c4e5da56f8e70a23a7026"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:06.560575 6449 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01f1e5668a7c4e5da56f8e70a23a7026 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:06.560712 5628 tablet_bootstrap.cc:654] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.561666 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet da75a470ec0c4ec9afa7c18a51cd7276 with delete_type TABLET_DATA_DELETED (replaced by tablet bad30e7310c842e6818471272f5d669e) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.561880 6453 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 9f467925221b4cfdafeaa459b5c5adc0
I20260927 13:50:06.562397 6453 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34390 (request call id 102) took 1118 ms. Trace:
I20260927 13:50:06.562556 5211 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f467925221b4cfdafeaa459b5c5adc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:06.562561 6453 rpcz_store.cc:276] 0927 13:50:05.444007 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.136477 (+692470us) service_pool.cc:224] Handling call
0927 13:50:06.136926 (+ 449us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:06.137050 (+ 124us) catalog_manager.cc:2854] Modifying in-memory table state
0927 13:50:06.137111 (+ 61us) catalog_manager.cc:2863] Locking tablets
0927 13:50:06.361657 (+224546us) catalog_manager.cc:2877] Removing table and tablets from system table
0927 13:50:06.370482 (+ 8825us) catalog_manager.cc:2895] Removing table from by-name map
0927 13:50:06.561767 (+191285us) catalog_manager.cc:2911] Committing in-memory state
0927 13:50:06.561804 (+ 37us) catalog_manager.cc:2915] Aborting table tasks
0927 13:50:06.562365 (+ 561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.362356 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.362448 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.362453 (+ 5us) write_op.cc:435] Acquired schema lock
0927 13:50:06.362455 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:06.362578 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.362587 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.362594 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.362716 (+ 122us) tablet.cc:701] Row locks acquired
0927 13:50:06.362720 (+ 4us) write_op.cc:260] PREPARE: finished
0927 13:50:06.362759 (+ 39us) write_op.cc:270] Start()
0927 13:50:06.362794 (+ 35us) write_op.cc:276] Timestamp: P: 1790517006362725 usec, L: 0
0927 13:50:06.362800 (+ 6us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.362968 (+ 168us) log.cc:844] Serialized 728 byte log entry
0927 13:50:06.368218 (+ 5250us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.369974 (+ 1756us) write_op.cc:301] APPLY: starting
0927 13:50:06.370003 (+ 29us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.370037 (+ 34us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.370062 (+ 25us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.370144 (+ 82us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.370174 (+ 30us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:50:06.370182 (+ 8us) write_op.cc:312] APPLY: finished
0927 13:50:06.370246 (+ 64us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.370300 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.370317 (+ 17us) write_op.cc:454] Released schema lock
0927 13:50:06.370322 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:06.370387 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.370390 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1696,"apply.run_cpu_time_us":408,"apply.run_wall_time_us":409,"num_ops":2,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":709,"prepare.run_wall_time_us":773,"raft.queue_time_us":43,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":5392}]]}
I20260927 13:50:06.563118 5087 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f467925221b4cfdafeaa459b5c5adc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.563151 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bd182d7cb414f07944072b0c00ee35c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.563494 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet e26a3a50396940cf826442e4ba7356a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.563814 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 0361e3b244a1437b8e402dd8602528fe with delete_type TABLET_DATA_DELETED (replaced by tablet 187b3ceeccb142c4b798947e584d6044) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.563794 6453 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_6ae053d0df4249988247ca5438c2b0e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 13:50:06.564255 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 4211f338c6a648c5b3e36c6df0b3c510 with delete_type TABLET_DATA_DELETED (replaced by tablet 85debab98b0f42a5b50f1b0d132147d3) from {username='slave'} at 127.0.0.1:35946
W20260927 13:50:06.564343 6453 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ae053d0df4249988247ca5438c2b0e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:06.564663 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet b57886cc11a2423983c2b7bac79150a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.565011 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet a9503dd46ccf472581d1a667eea300ed with delete_type TABLET_DATA_DELETED (replaced by tablet 4cb71dd1785841b1b031cb09422a505d) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.565369 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 with delete_type TABLET_DATA_DELETED (replaced by tablet cf1a58c67bf54493a3c62fb175acabb8) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.565713 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b13c629908a47368846770c697aebd8 with delete_type TABLET_DATA_DELETED (replaced by tablet dec7c4c6b46d4b5791d9b7af1a8e55cc) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.566068 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a07adcd33414d18ae9720e7a307548a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.566449 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet e730a00ad2e646a4ba594ba9434c3b50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.566576 5211 tablet_service.cc:1511] Processing CreateTablet for tablet e6862bea5b6c40f48b5698bd06ae0e9d (DEFAULT_TABLE table=default.Table_0973bd1ed2dc4cb6b285aae2c97ad9af [id=8eae9c1d46ff425cae1ae9bac9b8f2a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.566819 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.567111 5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6862bea5b6c40f48b5698bd06ae0e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.567126 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c2f814bb9ff41ebab19e8c16cf4affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.567435 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet f702b0a6380543a8ac539125d4334cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.567726 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.568013 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet bb25bb5ee153494d803130f1ad4f7c2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.568292 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 0880140d99004eb1803d6b5dcf41af13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.569422 5227 tablet_service.cc:1511] Processing CreateTablet for tablet a0fb91bb86a545c2b0d4ec09e22295f2 (DEFAULT_TABLE table=default.Table_d7281f105585492eba77dc1d7ed95a94 [id=a2308e4d89294b968fdf857e8cf2dc99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.569700 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 36181512a94c4702ae0a417665919faa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.569764 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fb91bb86a545c2b0d4ec09e22295f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.569916 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 4f1016f8a49b4f97acc4d694e4b70d54 (DEFAULT_TABLE table=default.Table_936e6396f4194eea8ed1eff9e6b374bd [id=df1990df6eae40f393a7b982a35b03c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.570248 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1016f8a49b4f97acc4d694e4b70d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.570878 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc140bba42a43758fa0c6540d728275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.574407 5087 tablet_service.cc:1511] Processing CreateTablet for tablet e6862bea5b6c40f48b5698bd06ae0e9d (DEFAULT_TABLE table=default.Table_0973bd1ed2dc4cb6b285aae2c97ad9af [id=8eae9c1d46ff425cae1ae9bac9b8f2a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.574807 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6862bea5b6c40f48b5698bd06ae0e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.575726 7190 ts_tablet_manager.cc:1929] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:06.575809 7190 log.cc:1199] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b57886cc11a2423983c2b7bac79150a0
I20260927 13:50:06.576107 7190 ts_tablet_manager.cc:1950] T b57886cc11a2423983c2b7bac79150a0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:06.576359 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 4f1016f8a49b4f97acc4d694e4b70d54 (DEFAULT_TABLE table=default.Table_936e6396f4194eea8ed1eff9e6b374bd [id=df1990df6eae40f393a7b982a35b03c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.576764 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1016f8a49b4f97acc4d694e4b70d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.580210 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 8facc31d4ccf40d7af7b5f9fbb8e1375 (DEFAULT_TABLE table=default.Table_70b5cd5dfa384bbe96b6cbde391503c7 [id=1036f9d32f1c4c378344d96f41fd0e73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.580804 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 02af11cdfb4144d2b36b66b5f7f4347d (DEFAULT_TABLE table=default.Table_5cf641fb505b46939f594b89b22bb0e3 [id=7e26cea73c0d4237856b2850b417f735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.580957 5072 tablet_service.cc:1511] Processing CreateTablet for tablet a0fb91bb86a545c2b0d4ec09e22295f2 (DEFAULT_TABLE table=default.Table_d7281f105585492eba77dc1d7ed95a94 [id=a2308e4d89294b968fdf857e8cf2dc99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.581246 5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fb91bb86a545c2b0d4ec09e22295f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.585400 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 02af11cdfb4144d2b36b66b5f7f4347d (DEFAULT_TABLE table=default.Table_5cf641fb505b46939f594b89b22bb0e3 [id=7e26cea73c0d4237856b2850b417f735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.585750 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02af11cdfb4144d2b36b66b5f7f4347d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.590389 5074 tablet_service.cc:1511] Processing CreateTablet for tablet 8facc31d4ccf40d7af7b5f9fbb8e1375 (DEFAULT_TABLE table=default.Table_70b5cd5dfa384bbe96b6cbde391503c7 [id=1036f9d32f1c4c378344d96f41fd0e73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.590716 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8facc31d4ccf40d7af7b5f9fbb8e1375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.591459 7321 leader_election.cc:290] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.594399 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 04bf46b67c7e4bc69f4f148898843058 (DEFAULT_TABLE table=default.Table_c6e31b4579c5408d9c10f11b74af4a7b [id=f7d967bdc1d94a569f39f3830b0348d8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:50:06.515903 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 352e564866a747798ad44218133844ba consensus state has no leader
I20260927 13:50:06.596387 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8facc31d4ccf40d7af7b5f9fbb8e1375. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:06.599638 6442 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2], current schema version=4): Not found: failed to reset TS proxy: No leader found: Tablet fcf4c143d5824458be4a42945c338dc9 consensus state has no leader
I20260927 13:50:06.599713 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e6bf85bf1434ab6ce42e751d31c6f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:06.599963 7321 raft_consensus.cc:2804] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:06.600047 7321 raft_consensus.cc:493] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:06.600119 7321 raft_consensus.cc:3060] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:06.600247 5044 leader_election.cc:343] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.600379 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02af11cdfb4144d2b36b66b5f7f4347d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.601670 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 04bf46b67c7e4bc69f4f148898843058 (DEFAULT_TABLE table=default.Table_c6e31b4579c5408d9c10f11b74af4a7b [id=f7d967bdc1d94a569f39f3830b0348d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.602046 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04bf46b67c7e4bc69f4f148898843058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.602806 7321 raft_consensus.cc:515] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.603462 7321 leader_election.cc:290] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:06.603762 5045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 110205us
I20260927 13:50:06.606259 5083 tablet_service.cc:1558] Processing DeleteTablet for tablet d51c3fa3624340059f6508ced1a2220e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.606460 5078 tablet_service.cc:1558] Processing DeleteTablet for tablet 76a397300cdd44eb899f2ef5b9fe8c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 9858d2c788f54e30b67c1235af8f51af) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.606626 5089 tablet_service.cc:1558] Processing DeleteTablet for tablet db75594e5ee0427a80016bb8a19b6703 with delete_type TABLET_DATA_DELETED (replaced by tablet a4099c41981f46758a8f478d7fdb4182) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.606807 5082 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a50f61eec39438f9d2b652f0346a0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.606979 5088 tablet_service.cc:1558] Processing DeleteTablet for tablet c57b60cbc1ca462789fd8e7a235f7119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.607142 5073 tablet_service.cc:1558] Processing DeleteTablet for tablet 3add644bb1f544e1b3c91fecfd6a541b with delete_type TABLET_DATA_DELETED (replaced by tablet c27872794fb24934b723c56935d94702) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.607291 5070 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e3b98290dc74d88856e13f003a1e4c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.607451 5079 tablet_service.cc:1558] Processing DeleteTablet for tablet 715b9af057f6425eb664e2399677890f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.607594 5085 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff7d501f7704e69b696053cb1b1ffe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.607995 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:06.608486 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04bf46b67c7e4bc69f4f148898843058. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:06.608471 5044 leader_election.cc:343] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.611495 5228 tablet_service.cc:1511] Processing CreateTablet for tablet b716b1ad8245487295c04a12b744f7b7 (DEFAULT_TABLE table=default.Table_3aa559bda6e74f04b2700167fb54731f [id=efc9d0e527454e4bad64ce39c8bf2bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.611862 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b716b1ad8245487295c04a12b744f7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.612397 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 329fa4c25cec48f9830a8eb19794ea72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.612756 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 3933c0a2fd6547f28528fae7d443a2c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.613032 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet ec130d31f6274fd9b730c2bb8bba817e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.613287 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet a813939920244be781d546311fe8a33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.613561 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 06c810fde988439c97a8445fc88626b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 0191cfad4e7a4b088b2ecdc246bfa58a) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.613837 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 794da0992403462dbbce644134b8aab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.614099 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet b3fbf1e7f5e04122a65f6e192ffdae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.614454 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e30216e0487496f8efdb8a3b06deb5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.614728 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 98e2e305b92a4492a0df14a506c768f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.615041 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 14f5479761f94ee0b339e125d06a808c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.615346 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 0076228c3f224d1f9d76ccf2dd7064ae with delete_type TABLET_DATA_DELETED (replaced by tablet 7710c6561bd84945a9ff017daf74a085) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.615660 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 26a8aca52f8c4566b274d13e6bb13ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.615957 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 44d85213c05c465abda78cc49c70d36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.616240 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 60de1c28618f4e478aae68ad07fbcf98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.616731 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet cf1a58c67bf54493a3c62fb175acabb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9abb473dbb3d491c9d15a161541fe795) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.617065 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet d9cb99ad45d1445cb2e2854319a3d73d with delete_type TABLET_DATA_DELETED (replaced by tablet c16673cfe45f4c81806f4dda3246d476) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.618319 5619 tablet_bootstrap.cc:492] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:06.618556 5619 ts_tablet_manager.cc:1403] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.097s user 0.001s sys 0.004s
I20260927 13:50:06.619423 5619 raft_consensus.cc:359] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.619984 5619 raft_consensus.cc:385] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.620126 5619 raft_consensus.cc:740] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.620441 5619 consensus_queue.cc:260] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.621448 5619 ts_tablet_manager.cc:1434] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:50:06.621742 5619 tablet_bootstrap.cc:492] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:06.621722 7321 raft_consensus.cc:493] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.621840 7321 raft_consensus.cc:515] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.622992 7321 leader_election.cc:290] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.623498 5619 tablet_bootstrap.cc:654] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:06.624872 5185 consensus_peers.cc:597] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a -> Peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Couldn't send request to peer bb28c54312c94d7dafb1c2abf7870735. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:06.625095 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bba86a18504fc1ae2a3aef7f7c5a39" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.625124 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 88) took 1698 ms. Trace:
I20260927 13:50:06.625211 7190 rpcz_store.cc:276] 0927 13:50:04.926631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.979801 (+ 53170us) service_pool.cc:224] Handling call
0927 13:50:06.447938 (+1468137us) ts_tablet_manager.cc:1151] Deleting tablet b57886cc11a2423983c2b7bac79150a0
0927 13:50:06.447948 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.572912 (+124964us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.575682 (+ 2770us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.625103 (+ 49421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41600,"tablet-delete.queue_time_us":1468016}
W20260927 13:50:06.625700 5044 leader_election.cc:343] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.625970 7190 tablet_replica.cc:333] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:06.626225 7190 raft_consensus.cc:2243] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:06.626569 7190 raft_consensus.cc:2272] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.627082 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet a003afa0fbb74d548cfaba51ea6cef58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.627458 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet c99bf2abdfc64f169a3937f3e4499f75 with delete_type TABLET_DATA_DELETED (replaced by tablet d212ee5cd8f7416a840d307b16ba5e28) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.628579 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet f04b3a942c404f3894fbbd6ece24a727 with delete_type TABLET_DATA_DELETED (replaced by tablet 6657ff16861043daa2652597bcf26271) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.629069 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 39fa23553c554826ad811ebe2e978ef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.629042 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b57886cc11a2423983c2b7bac79150a0 (table default.Table_020de70ec7bc4e119d5c6a3e22d8d32d [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
I20260927 13:50:06.629750 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 45096e907a9c44b7ace81357cdd575d4 with delete_type TABLET_DATA_DELETED (replaced by tablet fd861e06085e4c7b8bdf1101432bdc31) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.634168 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet b0d6a3af321049b099e72dbfeb6b7a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.634552 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet a0e14fd01a9141cdb2df030ee0dd05db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.636232 7111 ts_tablet_manager.cc:1929] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:06.639767 7190 ts_tablet_manager.cc:1916] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.643448 7321 raft_consensus.cc:493] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.643586 7321 raft_consensus.cc:515] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.636562 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet b9a1193719e140beb9b492927adeb78c with delete_type TABLET_DATA_DELETED (replaced by tablet a583d84f0f9247c68f330149b41e65ae) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.636831 5355 tablet_service.cc:1558] Processing DeleteTablet for tablet 284f6113fa4b443a869bce6d0c15f273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.637123 5363 tablet_service.cc:1558] Processing DeleteTablet for tablet 370553521753488ab81e40144f2536ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.637405 5346 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cb1d6091729498698924e6857ebfd6c with delete_type TABLET_DATA_DELETED (replaced by tablet 55f62f4ba23f4b82b9bcde89126ce1e6) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.644163 7321 leader_election.cc:290] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.637640 5359 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a737bef14b4874b61a109305ebb993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.637916 5365 tablet_service.cc:1558] Processing DeleteTablet for tablet ecb5cdc007074e0c8f44d963e527a955 with delete_type TABLET_DATA_DELETED (replaced by tablet fc25ff5c6a3545759e7de977f91a9453) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.638207 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 496cffc2a8774185a0e0f63208bed8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.638334 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e3b98290dc74d88856e13f003a1e4c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.638597 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.638851 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet dd0126a6df14457ca5c62c129f3275f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.643627 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e768c83fae54619ac849dfedd5ec654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.644730 7111 log.cc:1199] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/5e3fa4870d5547a2bbffe1745b964504
I20260927 13:50:06.644815 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.645135 7111 ts_tablet_manager.cc:1950] T 5e3fa4870d5547a2bbffe1745b964504 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:50:06.645390 5044 leader_election.cc:343] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.646049 7111 tablet_replica.cc:333] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:06.646291 7111 raft_consensus.cc:2243] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.646447 7111 raft_consensus.cc:2272] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.646965 7111 ts_tablet_manager.cc:1916] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:06.647928 6429 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111) [suppressed 12 similar messages]
I20260927 13:50:06.648044 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f4bc5cefef448d85ff31b7fafaca74 with delete_type TABLET_DATA_DELETED (replaced by tablet f3e3ebd06dd1429fa5ec20396e4bb5b6) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.648888 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 71268fb7aa9646639ea41dc8ccebfc5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.649549 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bd9a95e2d24242aba890ee9d01c023 with delete_type TABLET_DATA_DELETED (replaced by tablet ad2b4316eeb643cc8c2440ed04191a57) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.650208 6453 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34390 (request call id 105) took 1149 ms. Trace:
I20260927 13:50:06.650249 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet a90d9bb192cf4e26812abb9c2ecc3682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.651463 6449 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34390 (request call id 104) took 1150 ms. Trace:
I20260927 13:50:06.651584 6449 rpcz_store.cc:276] 0927 13:50:05.500521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.559663 (+1059142us) service_pool.cc:224] Handling call
0927 13:50:06.560743 (+ 1080us) catalog_manager.cc:2140] Acquired catalog manager lock
0927 13:50:06.561236 (+ 493us) catalog_manager.cc:2186] Created new table and tablet info
0927 13:50:06.651234 (+ 89998us) catalog_manager.cc:2246] Wrote table and tablets to system table
0927 13:50:06.651354 (+ 120us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0927 13:50:06.651427 (+ 73us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.585074 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.585164 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.585170 (+ 6us) write_op.cc:435] Acquired schema lock
0927 13:50:06.585172 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:06.585247 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.585256 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.585261 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.585326 (+ 65us) tablet.cc:701] Row locks acquired
0927 13:50:06.585328 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:50:06.585357 (+ 29us) write_op.cc:270] Start()
0927 13:50:06.585386 (+ 29us) write_op.cc:276] Timestamp: P: 1790517006585305 usec, L: 0
0927 13:50:06.585389 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.585552 (+ 163us) log.cc:844] Serialized 433 byte log entry
0927 13:50:06.633934 (+ 48382us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.634328 (+ 394us) write_op.cc:301] APPLY: starting
0927 13:50:06.634347 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.634390 (+ 43us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.634426 (+ 36us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.634564 (+ 138us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.634600 (+ 36us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 13:50:06.634607 (+ 7us) write_op.cc:312] APPLY: finished
0927 13:50:06.634692 (+ 85us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.634757 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.634774 (+ 17us) write_op.cc:454] Released schema lock
0927 13:50:06.634781 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:06.634851 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.634854 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":315,"apply.run_cpu_time_us":520,"apply.run_wall_time_us":520,"mutex_wait_us":23292,"num_ops":2,"prepare.queue_time_us":23365,"prepare.run_cpu_time_us":565,"prepare.run_wall_time_us":565,"raft.queue_time_us":1919,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":48509}]]}
I20260927 13:50:06.655455 7321 raft_consensus.cc:493] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.655619 7321 raft_consensus.cc:515] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.656450 7321 leader_election.cc:290] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.658165 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 6964f549d6214ad9a21cf213a9bfa3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.658913 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet d9198ace6a264737a990d6fb573faf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.659716 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet bb980bca9f16480ba050971b58aa46f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.659940 7321 raft_consensus.cc:493] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.660090 7321 raft_consensus.cc:515] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.653272 6447 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34390 (request call id 103) took 1209 ms. Trace:
I20260927 13:50:06.660495 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet fbde77915c7d4665965bef2298c3491f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.660723 7321 leader_election.cc:290] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.660523 6447 rpcz_store.cc:276] 0927 13:50:05.444078 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.550676 (+1106598us) service_pool.cc:224] Handling call
0927 13:50:06.551611 (+ 935us) catalog_manager.cc:2140] Acquired catalog manager lock
0927 13:50:06.552088 (+ 477us) catalog_manager.cc:2186] Created new table and tablet info
0927 13:50:06.653018 (+100930us) catalog_manager.cc:2246] Wrote table and tablets to system table
0927 13:50:06.653138 (+ 120us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0927 13:50:06.653229 (+ 91us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.583313 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.583422 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.583429 (+ 7us) write_op.cc:435] Acquired schema lock
0927 13:50:06.583432 (+ 3us) tablet.cc:662] Decoding operations
0927 13:50:06.583525 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.583539 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.583544 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.583622 (+ 78us) tablet.cc:701] Row locks acquired
0927 13:50:06.583625 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:06.583679 (+ 54us) write_op.cc:270] Start()
0927 13:50:06.583748 (+ 69us) write_op.cc:276] Timestamp: P: 1790517006583627 usec, L: 0
0927 13:50:06.583753 (+ 5us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.583947 (+ 194us) log.cc:844] Serialized 433 byte log entry
0927 13:50:06.619032 (+ 35085us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.619444 (+ 412us) write_op.cc:301] APPLY: starting
0927 13:50:06.619469 (+ 25us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.619516 (+ 47us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.619555 (+ 39us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.619699 (+ 144us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.619736 (+ 37us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 13:50:06.619743 (+ 7us) write_op.cc:312] APPLY: finished
0927 13:50:06.619837 (+ 94us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.619909 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.619932 (+ 23us) write_op.cc:454] Released schema lock
0927 13:50:06.619939 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:06.620019 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.620024 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":334,"apply.run_cpu_time_us":570,"apply.run_wall_time_us":571,"num_ops":2,"prepare.queue_time_us":30709,"prepare.run_cpu_time_us":750,"prepare.run_wall_time_us":750,"raft.queue_time_us":785,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":241,"replication_time_us":35241}]]}
I20260927 13:50:06.661091 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.661590 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992bf643dee64bccaa993a08027aa5fc" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.661789 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a98e712fb3492f9e4ebccfd489c16f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.650344 6453 rpcz_store.cc:276] 0927 13:50:05.500690 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.563599 (+1062909us) service_pool.cc:224] Handling call
0927 13:50:06.564432 (+ 833us) catalog_manager.cc:2140] Acquired catalog manager lock
0927 13:50:06.564838 (+ 406us) catalog_manager.cc:2186] Created new table and tablet info
0927 13:50:06.649721 (+ 84883us) catalog_manager.cc:2246] Wrote table and tablets to system table
0927 13:50:06.650012 (+ 291us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0927 13:50:06.650165 (+ 153us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.585661 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.585741 (+ 80us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.585745 (+ 4us) write_op.cc:435] Acquired schema lock
0927 13:50:06.585748 (+ 3us) tablet.cc:662] Decoding operations
0927 13:50:06.585810 (+ 62us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.585817 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.585821 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.585892 (+ 71us) tablet.cc:701] Row locks acquired
0927 13:50:06.585894 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:50:06.585918 (+ 24us) write_op.cc:270] Start()
0927 13:50:06.585939 (+ 21us) write_op.cc:276] Timestamp: P: 1790517006585868 usec, L: 0
0927 13:50:06.585943 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.586059 (+ 116us) log.cc:844] Serialized 433 byte log entry
0927 13:50:06.634014 (+ 47955us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.634920 (+ 906us) write_op.cc:301] APPLY: starting
0927 13:50:06.634931 (+ 11us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.634960 (+ 29us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.634982 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.635078 (+ 96us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.635105 (+ 27us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 13:50:06.635114 (+ 9us) write_op.cc:312] APPLY: finished
0927 13:50:06.635172 (+ 58us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.635209 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.635224 (+ 15us) write_op.cc:454] Released schema lock
0927 13:50:06.635229 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":875,"apply.run_cpu_time_us":361,"apply.run_wall_time_us":360,"mutex_wait_us":19609,"num_ops":2,"prepare.queue_time_us":20226,"prepare.run_cpu_time_us":517,"prepare.run_wall_time_us":1831,"raft.queue_time_us":1468,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":2,"replication_time_us":48053,"threads_started":1}]]}
W20260927 13:50:06.662663 5044 leader_election.cc:343] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:06.662930 5044 leader_election.cc:343] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.663168 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet a0575418f5ea4d82b34112e1bc9ab8b4 with delete_type TABLET_DATA_DELETED (replaced by tablet e3765fe06c664e60a11acf76c825bc42) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.663582 6453 master_service.cc:960] ReplaceTablet: received request to replace tablet 97b46497d8254a248df8d421d0b09d8d from {username='slave'} at 127.0.0.1:34390
I20260927 13:50:06.663887 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e7e50142e447158f90770322609a2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.664633 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a40f69bb7d842889be30c4629d6786f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.665304 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 08798185a7c641f98d7dc6a6b1b72e0a with delete_type TABLET_DATA_DELETED (replaced by tablet ecb5cdc007074e0c8f44d963e527a955) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.665971 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet f49384587bfa41d6aabfa8ee175d6abe with delete_type TABLET_DATA_DELETED (replaced by tablet dd0126a6df14457ca5c62c129f3275f8) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.666651 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.667707 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet da5d9bda857f467da6930a6c64266f3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:02 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.668385 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet bb7b3a35b2e94bbea6be4b4a8f158593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.668712 5074 tablet_service.cc:1558] Processing DeleteTablet for tablet 9855fd321e4b4d0aa37f7b31d7a5efca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.669041 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8bf79954c2429f886ac7afc9a8455f with delete_type TABLET_DATA_DELETED (replaced by tablet 502fe193f2034e37a53b245bbf049ae8) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.670727 5074 tablet_service.cc:1511] Processing CreateTablet for tablet b716b1ad8245487295c04a12b744f7b7 (DEFAULT_TABLE table=default.Table_3aa559bda6e74f04b2700167fb54731f [id=efc9d0e527454e4bad64ce39c8bf2bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.671198 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b716b1ad8245487295c04a12b744f7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.671408 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet d51c3fa3624340059f6508ced1a2220e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.674364 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 76a397300cdd44eb899f2ef5b9fe8c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 9858d2c788f54e30b67c1235af8f51af) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.675102 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ef5969312044a2bab451841ec65aa84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.676010 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ed33e78ee5448bcae633cc874c3e171 with delete_type TABLET_DATA_DELETED (replaced by tablet f4cfddedc5cc4ec4a40b071253254703) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.676651 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet e1e574bc8b544039b440a845966eb1d4 with delete_type TABLET_DATA_DELETED (replaced by tablet cc5cb26760e844aab324d5c4f4d2b488) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.680147 7190 ts_tablet_manager.cc:1929] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:06.680222 5157 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:06.680579 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f467925221b4cfdafeaa459b5c5adc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.680754 5074 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a3f40a2da8649e0898c0e09b6e14a61 with delete_type TABLET_DATA_DELETED (replaced by tablet ead437e93bb14a73a820631b0be041aa) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:06.682780 5362 tablet_service.cc:1511] Processing CreateTablet for tablet e6862bea5b6c40f48b5698bd06ae0e9d (DEFAULT_TABLE table=default.Table_0973bd1ed2dc4cb6b285aae2c97ad9af [id=8eae9c1d46ff425cae1ae9bac9b8f2a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.683149 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6862bea5b6c40f48b5698bd06ae0e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.690207 5349 tablet_service.cc:1511] Processing CreateTablet for tablet a0fb91bb86a545c2b0d4ec09e22295f2 (DEFAULT_TABLE table=default.Table_d7281f105585492eba77dc1d7ed95a94 [id=a2308e4d89294b968fdf857e8cf2dc99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.690568 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fb91bb86a545c2b0d4ec09e22295f2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:06.691706 6442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.65:57911 (request call id 136) took 2084 ms (client timeout 1000 ms). Trace:
W20260927 13:50:06.691810 6442 rpcz_store.cc:269] 0927 13:50:04.606949 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.608153 (+ 1204us) service_pool.cc:224] Handling call
0927 13:50:04.643465 (+ 35312us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00007fe748a7c65d 00007fe748a7c753 00007fe7455f9db1 00007fe74d3eda7d 00007fe74d5776e8 00007fe743f461f6 00007fe743f45f25 00007fe74064c63e 00007fe74064b51e 00007fe740651758 00007fe7406520bf
0927 13:50:06.691643 (+2048178us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:05.537023 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:05.537176 (+ 153us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:05.537184 (+ 8us) write_op.cc:435] Acquired schema lock
0927 13:50:05.537188 (+ 4us) tablet.cc:662] Decoding operations
0927 13:50:05.537318 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:05.537329 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:05.537334 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:50:05.537404 (+ 70us) tablet.cc:701] Row locks acquired
0927 13:50:05.537407 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:05.537445 (+ 38us) write_op.cc:270] Start()
0927 13:50:05.537480 (+ 35us) write_op.cc:276] Timestamp: P: 1790517005537397 usec, L: 0
0927 13:50:05.537483 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:05.537653 (+ 170us) log.cc:844] Serialized 356 byte log entry
0927 13:50:05.545487 (+ 7834us) op_driver.cc:464] REPLICATION: finished
0927 13:50:05.545872 (+ 385us) write_op.cc:301] APPLY: starting
0927 13:50:05.545888 (+ 16us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:05.545924 (+ 36us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:05.545959 (+ 35us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:05.546011 (+ 52us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:05.546040 (+ 29us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:05.546049 (+ 9us) write_op.cc:312] APPLY: finished
0927 13:50:05.546141 (+ 92us) log.cc:844] Serialized 23 byte log entry
0927 13:50:05.546196 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.546211 (+ 15us) write_op.cc:454] Released schema lock
0927 13:50:05.546229 (+ 18us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:05.546294 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.546298 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57353,"reported_tablets":258,"spinlock_wait_cycles":35031936,"child_traces":[["op",{"apply.queue_time_us":331,"apply.run_cpu_time_us":417,"apply.run_wall_time_us":416,"num_ops":1,"prepare.queue_time_us":35024,"prepare.run_cpu_time_us":738,"prepare.run_wall_time_us":1092,"raft.queue_time_us":39,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":7973}]]}
I20260927 13:50:06.697319 7098 ts_tablet_manager.cc:1929] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:06.697551 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 02af11cdfb4144d2b36b66b5f7f4347d (DEFAULT_TABLE table=default.Table_5cf641fb505b46939f594b89b22bb0e3 [id=7e26cea73c0d4237856b2850b417f735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.697801 7098 log.cc:1199] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/8aeb0c2c2be04a598e011a9d99c5492a
I20260927 13:50:06.697934 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02af11cdfb4144d2b36b66b5f7f4347d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.700433 5074 tablet_service.cc:1511] Processing CreateTablet for tablet 47a3a7e87720429b9cba3c42152b5d76 (DEFAULT_TABLE table=default.Table_cfbb8fd97928450cb39e38bce22effc1 [id=6ef477fbac224276bdd2c64ab7aea4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.700858 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a3a7e87720429b9cba3c42152b5d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.705849 7098 ts_tablet_manager.cc:1950] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:50:06.706969 6445 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.67:48295 (request call id 144) took 3080 ms (client timeout 1000 ms). Trace:
I20260927 13:50:06.707453 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 88) took 2332 ms. Trace:
I20260927 13:50:06.707594 7098 rpcz_store.cc:276] 0927 13:50:04.375450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.528830 (+153380us) service_pool.cc:224] Handling call
0927 13:50:06.532201 (+2003371us) ts_tablet_manager.cc:1151] Deleting tablet 8aeb0c2c2be04a598e011a9d99c5492a
0927 13:50:06.533348 (+ 1147us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.543672 (+ 10324us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.697260 (+153588us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.707433 (+ 10173us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2002870}
I20260927 13:50:06.708266 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 8aeb0c2c2be04a598e011a9d99c5492a (table default.Table_1331333f8b0a40f9961974e3407260ca [id=8597c2e7f8244b97bc7b72adca1158bf]) successfully deleted
I20260927 13:50:06.708659 7098 tablet_replica.cc:333] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:06.708918 7098 raft_consensus.cc:2243] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.711285 6447 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "default.Table_d9214a04e2e645468dc62f758c45a74f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 13:50:06.712037 6447 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9214a04e2e645468dc62f758c45a74f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 13:50:06.713753 7098 raft_consensus.cc:2272] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.709527 5087 tablet_service.cc:1511] Processing CreateTablet for tablet e337c23812c9469c987626e0e70589df (DEFAULT_TABLE table=default.Table_2340dd3345454c9cbdf067c0a3638a19 [id=22937a0cb089474ebe0988eccd6a3b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.714241 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e337c23812c9469c987626e0e70589df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.714483 7098 ts_tablet_manager.cc:1916] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.721119 5362 tablet_service.cc:1511] Processing CreateTablet for tablet 4f1016f8a49b4f97acc4d694e4b70d54 (DEFAULT_TABLE table=default.Table_936e6396f4194eea8ed1eff9e6b374bd [id=df1990df6eae40f393a7b982a35b03c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.721599 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1016f8a49b4f97acc4d694e4b70d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.727207 7098 ts_tablet_manager.cc:1929] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:06.728701 6447 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34390 (request call id 106) took 1223 ms. Trace:
I20260927 13:50:06.728888 6447 rpcz_store.cc:276] 0927 13:50:05.505016 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.661876 (+1156860us) service_pool.cc:224] Handling call
0927 13:50:06.711219 (+ 49343us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00007fe748a7c65d 00007fe748a7c753 00007fe7455f9db1 00007fe74d3eda7d 00007fe74d57cea3 00007fe743f48d16 00007fe743f48a45 00007fe74064c63e 00007fe74064b51e 00007fe740651758 00007fe7406520bf
0927 13:50:06.712215 (+ 996us) catalog_manager.cc:2140] Acquired catalog manager lock
0927 13:50:06.712670 (+ 455us) catalog_manager.cc:2186] Created new table and tablet info
0927 13:50:06.728459 (+ 15789us) catalog_manager.cc:2246] Wrote table and tablets to system table
0927 13:50:06.728571 (+ 112us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0927 13:50:06.728661 (+ 90us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.713270 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.713363 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.713369 (+ 6us) write_op.cc:435] Acquired schema lock
0927 13:50:06.713372 (+ 3us) tablet.cc:662] Decoding operations
0927 13:50:06.713454 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.713468 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.713473 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.713548 (+ 75us) tablet.cc:701] Row locks acquired
0927 13:50:06.713551 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:06.713581 (+ 30us) write_op.cc:270] Start()
0927 13:50:06.713614 (+ 33us) write_op.cc:276] Timestamp: P: 1790517006713517 usec, L: 0
0927 13:50:06.713617 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.713805 (+ 188us) log.cc:844] Serialized 433 byte log entry
0927 13:50:06.722068 (+ 8263us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.727586 (+ 5518us) write_op.cc:301] APPLY: starting
0927 13:50:06.727605 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.727650 (+ 45us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.727683 (+ 33us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.727831 (+ 148us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.727868 (+ 37us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 13:50:06.727875 (+ 7us) write_op.cc:312] APPLY: finished
0927 13:50:06.727984 (+ 109us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.728226 (+ 242us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.728275 (+ 49us) write_op.cc:454] Released schema lock
0927 13:50:06.728283 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:06.728359 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.728363 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":112911104,"child_traces":[["op",{"apply.queue_time_us":5443,"apply.run_cpu_time_us":604,"apply.run_wall_time_us":772,"num_ops":2,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":638,"prepare.run_wall_time_us":638,"raft.queue_time_us":9670,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":270,"replication_time_us":8421}]]}
I20260927 13:50:06.730306 6447 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_2aca6646f7534f72b84c2aba10508d48" } modify_external_catalogs: true
I20260927 13:50:06.730568 6447 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_2aca6646f7534f72b84c2aba10508d48" } modify_external_catalogs: true
I20260927 13:50:06.733690 7098 log.cc:1199] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/e26a3a50396940cf826442e4ba7356a8
I20260927 13:50:06.733958 7111 ts_tablet_manager.cc:1929] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:06.734063 7111 log.cc:1199] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/008516a474cc40f2b9de77b2f3e762cf
I20260927 13:50:06.734351 7098 ts_tablet_manager.cc:1950] T e26a3a50396940cf826442e4ba7356a8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:06.734691 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 8facc31d4ccf40d7af7b5f9fbb8e1375 (DEFAULT_TABLE table=default.Table_70b5cd5dfa384bbe96b6cbde391503c7 [id=1036f9d32f1c4c378344d96f41fd0e73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.735093 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8facc31d4ccf40d7af7b5f9fbb8e1375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.735225 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 89) took 2358 ms. Trace:
I20260927 13:50:06.735302 7098 rpcz_store.cc:276] 0927 13:50:04.377194 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.529404 (+152210us) service_pool.cc:224] Handling call
0927 13:50:06.708611 (+2179207us) ts_tablet_manager.cc:1151] Deleting tablet e26a3a50396940cf826442e4ba7356a8
0927 13:50:06.708622 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.724107 (+ 15485us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.727160 (+ 3053us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.735201 (+ 8041us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2178571}
I20260927 13:50:06.735802 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet e26a3a50396940cf826442e4ba7356a8 (table default.Table_3c83565e14ba4bdf96fcfceb17acdff3 [id=5f94649e22074c50b31b2156366e8993]) successfully deleted
I20260927 13:50:06.736131 7098 tablet_replica.cc:333] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:06.736299 7098 raft_consensus.cc:2243] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.736423 7098 raft_consensus.cc:2272] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.736907 7098 ts_tablet_manager.cc:1916] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.742290 5628 tablet_bootstrap.cc:492] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:06.742482 5628 ts_tablet_manager.cc:1403] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.183s user 0.004s sys 0.005s
I20260927 13:50:06.742718 7305 raft_consensus.cc:493] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.742903 7305 raft_consensus.cc:515] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.743214 5628 raft_consensus.cc:359] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:06.743374 5628 raft_consensus.cc:385] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.743428 5628 raft_consensus.cc:740] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.743630 5628 consensus_queue.cc:260] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:06.743763 7305 leader_election.cc:290] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.744279 6442 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_1b2791929bad4aaea7fcd8e2b206334d" } new_table_name: "default.Table_de28ad6c05ff40b99876d163d6273ffc" modify_external_catalogs: true
I20260927 13:50:06.747953 5356 tablet_service.cc:1511] Processing CreateTablet for tablet 04bf46b67c7e4bc69f4f148898843058 (DEFAULT_TABLE table=default.Table_c6e31b4579c5408d9c10f11b74af4a7b [id=f7d967bdc1d94a569f39f3830b0348d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.748471 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04bf46b67c7e4bc69f4f148898843058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.749065 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]). Expected version 2 got 0
I20260927 13:50:06.749464 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_cfdab7814ecc495089389612e0a7e4fe [id=ae170bbebc4e460fb58beb7f95f013a2]). Expected version 2 got 0
I20260927 13:50:06.749874 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:50:06.750258 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]). Expected version 1 got 0
I20260927 13:50:06.750530 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]). Expected version 1 got 0
I20260927 13:50:06.750765 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]). Expected version 1 got 0
I20260927 13:50:06.750975 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_954f47d3ef8846b8ade030d87002460e [id=750521adcb384c75841d7e1ff89af83d]). Expected version 2 got 0
I20260927 13:50:06.751183 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]). Expected version 2 got 0
I20260927 13:50:06.752534 5074 tablet_service.cc:1511] Processing CreateTablet for tablet eedf28ed8a61476c811d8352aafceb60 (DEFAULT_TABLE table=default.Table_f8e1d2c1de20415e9d275698c23e2bb2 [id=281bbb4f05cd469cbcc3d0d1be429d4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.752966 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eedf28ed8a61476c811d8352aafceb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.754611 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 20e10c11aec1425e80e05651580fdbc0 (DEFAULT_TABLE table=default.Table_af45c618a8364666918fb3ae10a1fccd [id=ee7873d8d27a46f9b196c9c43b55c7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.754977 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e10c11aec1425e80e05651580fdbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.756948 5354 tablet_service.cc:1511] Processing CreateTablet for tablet b716b1ad8245487295c04a12b744f7b7 (DEFAULT_TABLE table=default.Table_3aa559bda6e74f04b2700167fb54731f [id=efc9d0e527454e4bad64ce39c8bf2bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.757273 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b716b1ad8245487295c04a12b744f7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.757509 7098 ts_tablet_manager.cc:1929] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:06.757614 7098 log.cc:1199] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/992bf643dee64bccaa993a08027aa5fc
I20260927 13:50:06.757923 7098 ts_tablet_manager.cc:1950] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:06.758411 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 75) took 2458 ms. Trace:
I20260927 13:50:06.758592 7098 rpcz_store.cc:276] 0927 13:50:04.299582 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.456568 (+156986us) service_pool.cc:224] Handling call
0927 13:50:06.736088 (+2279520us) ts_tablet_manager.cc:1151] Deleting tablet 992bf643dee64bccaa993a08027aa5fc
0927 13:50:06.736097 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.740409 (+ 4312us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.757465 (+ 17056us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.758391 (+ 926us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2205592}
I20260927 13:50:06.759404 7098 tablet_replica.cc:333] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:06.759645 7098 raft_consensus.cc:2243] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.762629 7098 raft_consensus.cc:2272] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.763224 7098 ts_tablet_manager.cc:1916] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.764192 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aed7fe630f64213846ad37d904f6516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.764709 5628 ts_tablet_manager.cc:1434] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.022s user 0.001s sys 0.000s
I20260927 13:50:06.765071 5628 tablet_bootstrap.cc:492] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:06.768968 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet c57b60cbc1ca462789fd8e7a235f7119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.769402 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 3add644bb1f544e1b3c91fecfd6a541b with delete_type TABLET_DATA_DELETED (replaced by tablet c27872794fb24934b723c56935d94702) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.759163 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 992bf643dee64bccaa993a08027aa5fc (table default.Table_85388904282441d09642d64019688c97 [id=00fdc87b0cbf4bc091a92db3004b4397]) successfully deleted
I20260927 13:50:06.772369 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 715b9af057f6425eb664e2399677890f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.772698 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6073174dbb4ca1933685b7bd3a22e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 13ad5733322545f699d980df99ae0dff) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.773015 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.773319 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a50f61eec39438f9d2b652f0346a0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.773909 5080 tablet_service.cc:1511] Processing CreateTablet for tablet e6b1e7169cdd4f6b8dced0a807bc17e8 (DEFAULT_TABLE table=default.Table_c74dcd01d43b41babf48734ca8244f9f [id=d45c549bb1fe42f48f0aff415f91c29b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.774296 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b1e7169cdd4f6b8dced0a807bc17e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.774315 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet d3b38f40431f47a0acf1e11092d7717b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.774716 5354 tablet_service.cc:1558] Processing DeleteTablet for tablet 50fb1288684c45f6a778d809a5e2c160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.774904 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.775353 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 47a3a7e87720429b9cba3c42152b5d76 (DEFAULT_TABLE table=default.Table_cfbb8fd97928450cb39e38bce22effc1 [id=6ef477fbac224276bdd2c64ab7aea4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.775545 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]). Expected version 5 got 0
I20260927 13:50:06.775692 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a3a7e87720429b9cba3c42152b5d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.775840 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]). Expected version 3 got 0
I20260927 13:50:06.776172 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]). Expected version 1 got 0
I20260927 13:50:06.776365 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 90fb369fec2d43149080ab2ad94ecc57 (table default.Table_7b19583e86df4689a2e40ce5a9148e19 [id=23ffbb0d3240465cb12a09ffec1f8163]). Expected version 1 got 0
I20260927 13:50:06.776528 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_6ac0611179c743808ff8a129f463dd61 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 3 got 0
I20260927 13:50:06.776710 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:50:06.776719 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbdc347bc9845b2b577f551577d070b (DEFAULT_TABLE table=default.Table_544497088a2047e8a6b190c4e23e3e1c [id=d7b1a5499c5f4f9784a8952f1e66c3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.777045 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbdc347bc9845b2b577f551577d070b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.777159 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 564f5c92bf144fa1bfc2e1e07132dd69 (table default.Table_b927618f29db4aa49333c257a59c9aa3 [id=c81f7b3016144fd7a7329fbf31049d93]). Expected version 1 got 0
I20260927 13:50:06.781931 7321 raft_consensus.cc:493] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.782073 7321 raft_consensus.cc:515] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.782769 7321 leader_election.cc:290] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.783370 5087 tablet_service.cc:1511] Processing CreateTablet for tablet b851334fd8144ec3a38ed7e37ec53997 (DEFAULT_TABLE table=default.Table_56fd8ac906824c00b1a20aedef13e66b [id=350a692224414d44b7d57940b647bf6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.783560 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet db75594e5ee0427a80016bb8a19b6703 with delete_type TABLET_DATA_DELETED (replaced by tablet a4099c41981f46758a8f478d7fdb4182) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.783747 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b851334fd8144ec3a38ed7e37ec53997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.783967 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1b4494b7e895454f81fef308950729ef) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.688788 5211 tablet_service.cc:1511] Processing CreateTablet for tablet 47a3a7e87720429b9cba3c42152b5d76 (DEFAULT_TABLE table=default.Table_cfbb8fd97928450cb39e38bce22effc1 [id=6ef477fbac224276bdd2c64ab7aea4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.784391 5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a3a7e87720429b9cba3c42152b5d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.786137 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352e564866a747798ad44218133844ba" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:06.786669 5044 leader_election.cc:343] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.788094 5223 tablet_service.cc:1511] Processing CreateTablet for tablet abf4cdee82f442dfb2003d752d5fea3a (DEFAULT_TABLE table=default.Table_89f97a5bda26441d81fe82538717c17a [id=1b769747eb074d45b927aaa9cd6f0b3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.788421 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf4cdee82f442dfb2003d752d5fea3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:06.766929 6455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.67:48295 (request call id 145) took 1851 ms (client timeout 1000 ms). Trace:
W20260927 13:50:06.707114 6445 rpcz_store.cc:269] 0927 13:50:03.626340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:03.636605 (+ 10265us) service_pool.cc:224] Handling call
0927 13:50:03.644153 (+ 7548us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00007fe748a7c65d 00007fe748a7c753 00007fe7455f9db1 00007fe74d3eda7d 00007fe74d5776e8 00007fe743f461f6 00007fe743f45f25 00007fe74064c63e 00007fe74064b51e 00007fe740651758 00007fe7406520bf
0927 13:50:06.706923 (+3062770us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:04.211401 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:04.211497 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:04.211502 (+ 5us) write_op.cc:435] Acquired schema lock
0927 13:50:04.211504 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:04.211766 (+ 262us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:04.211777 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:04.211782 (+ 5us) tablet.cc:685] Acquiring locks for 11 operations
0927 13:50:04.212057 (+ 275us) tablet.cc:701] Row locks acquired
0927 13:50:04.212060 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:04.212094 (+ 34us) write_op.cc:270] Start()
0927 13:50:04.212125 (+ 31us) write_op.cc:276] Timestamp: P: 1790517004212077 usec, L: 0
0927 13:50:04.212129 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:04.212303 (+ 174us) log.cc:844] Serialized 4301 byte log entry
0927 13:50:04.217457 (+ 5154us) op_driver.cc:464] REPLICATION: finished
0927 13:50:04.217612 (+ 155us) write_op.cc:301] APPLY: starting
0927 13:50:04.217627 (+ 15us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:04.217737 (+ 110us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:04.217770 (+ 33us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:04.217937 (+ 167us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:04.217976 (+ 39us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0927 13:50:04.217984 (+ 8us) write_op.cc:312] APPLY: finished
0927 13:50:04.218093 (+ 109us) log.cc:844] Serialized 83 byte log entry
0927 13:50:04.218175 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:04.218202 (+ 27us) write_op.cc:454] Released schema lock
0927 13:50:04.218208 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:04.218279 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:04.218282 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":250,"spinlock_wait_cycles":6640512,"child_traces":[["op",{"apply.queue_time_us":81,"apply.run_cpu_time_us":659,"apply.run_wall_time_us":658,"num_ops":11,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":995,"prepare.run_wall_time_us":994,"raft.queue_time_us":300,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":5299}]]}
I20260927 13:50:06.790202 6445 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_8ccdfb70bd5f4ae9912dd1e5669a09e3" } modify_external_catalogs: true
I20260927 13:50:06.699453 5227 tablet_service.cc:1511] Processing CreateTablet for tablet e337c23812c9469c987626e0e70589df (DEFAULT_TABLE table=default.Table_2340dd3345454c9cbdf067c0a3638a19 [id=22937a0cb089474ebe0988eccd6a3b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.713572 5626 tablet_bootstrap.cc:492] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:06.791810 5626 ts_tablet_manager.cc:1403] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.264s user 0.016s sys 0.050s
I20260927 13:50:06.791884 7321 raft_consensus.cc:493] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.791922 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e337c23812c9469c987626e0e70589df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.791993 7321 raft_consensus.cc:515] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.792498 5626 raft_consensus.cc:359] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.792585 7321 leader_election.cc:290] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.792645 5626 raft_consensus.cc:385] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.792696 5626 raft_consensus.cc:740] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.792879 5626 consensus_queue.cc:260] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.793347 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880ce1300eac40b28aac8cba3e11077e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:06.742990 5217 tablet_service.cc:1511] Processing CreateTablet for tablet eedf28ed8a61476c811d8352aafceb60 (DEFAULT_TABLE table=default.Table_f8e1d2c1de20415e9d275698c23e2bb2 [id=281bbb4f05cd469cbcc3d0d1be429d4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.792840 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
I20260927 13:50:06.753160 5228 tablet_service.cc:1511] Processing CreateTablet for tablet 20e10c11aec1425e80e05651580fdbc0 (DEFAULT_TABLE table=default.Table_af45c618a8364666918fb3ae10a1fccd [id=ee7873d8d27a46f9b196c9c43b55c7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.793665 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eedf28ed8a61476c811d8352aafceb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.793970 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e10c11aec1425e80e05651580fdbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.770287 7203 raft_consensus.cc:493] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.794227 7203 raft_consensus.cc:515] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.794756 7203 leader_election.cc:290] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.778386 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbdc347bc9845b2b577f551577d070b (DEFAULT_TABLE table=default.Table_544497088a2047e8a6b190c4e23e3e1c [id=d7b1a5499c5f4f9784a8952f1e66c3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.795245 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbdc347bc9845b2b577f551577d070b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:06.790382 6455 rpcz_store.cc:269] 0927 13:50:04.915610 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.082075 (+166465us) service_pool.cc:224] Handling call
0927 13:50:06.766874 (+1684799us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:05.730797 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:05.730915 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:05.730921 (+ 6us) write_op.cc:435] Acquired schema lock
0927 13:50:05.730924 (+ 3us) tablet.cc:662] Decoding operations
0927 13:50:05.731033 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:05.731047 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:05.731052 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:05.731160 (+ 108us) tablet.cc:701] Row locks acquired
0927 13:50:05.731163 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:05.731199 (+ 36us) write_op.cc:270] Start()
0927 13:50:05.731233 (+ 34us) write_op.cc:276] Timestamp: P: 1790517005731194 usec, L: 0
0927 13:50:05.731236 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:05.731419 (+ 183us) log.cc:844] Serialized 907 byte log entry
0927 13:50:05.737928 (+ 6509us) op_driver.cc:464] REPLICATION: finished
0927 13:50:05.738047 (+ 119us) write_op.cc:301] APPLY: starting
0927 13:50:05.738066 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:05.738122 (+ 56us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:05.738150 (+ 28us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:05.738218 (+ 68us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:05.738252 (+ 34us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:50:05.738268 (+ 16us) write_op.cc:312] APPLY: finished
0927 13:50:05.738367 (+ 99us) log.cc:844] Serialized 29 byte log entry
0927 13:50:05.738428 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.738449 (+ 21us) write_op.cc:454] Released schema lock
0927 13:50:05.738456 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:05.738525 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:05.738529 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9533,"reported_tablets":261,"child_traces":[["op",{"apply.queue_time_us":34,"apply.run_cpu_time_us":477,"apply.run_wall_time_us":477,"num_ops":2,"prepare.queue_time_us":539,"prepare.run_cpu_time_us":743,"prepare.run_wall_time_us":744,"raft.queue_time_us":654,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":233,"replication_time_us":6661}]]}
I20260927 13:50:06.781553 5214 tablet_service.cc:1511] Processing CreateTablet for tablet b851334fd8144ec3a38ed7e37ec53997 (DEFAULT_TABLE table=default.Table_56fd8ac906824c00b1a20aedef13e66b [id=350a692224414d44b7d57940b647bf6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.798134 7190 log.cc:1199] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/50bc839e0fc54839a5d06c176760f618
I20260927 13:50:06.798365 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b851334fd8144ec3a38ed7e37ec53997. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:06.798316 5044 leader_election.cc:343] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.798475 7190 ts_tablet_manager.cc:1950] T 50bc839e0fc54839a5d06c176760f618 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:06.799233 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 89) took 1821 ms. Trace:
I20260927 13:50:06.799309 7190 rpcz_store.cc:276] 0927 13:50:04.977426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.979936 (+ 2510us) service_pool.cc:224] Handling call
0927 13:50:06.625918 (+1645982us) ts_tablet_manager.cc:1151] Deleting tablet 50bc839e0fc54839a5d06c176760f618
0927 13:50:06.625931 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.673854 (+ 47923us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.680082 (+ 6228us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.799193 (+119111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1645864}
I20260927 13:50:06.799376 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b044fbc166e848f39d17b63db69f63a4" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:06.799588 7190 tablet_replica.cc:333] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:06.799790 7190 raft_consensus.cc:2243] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:06.800109 7190 raft_consensus.cc:2272] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.800626 7190 ts_tablet_manager.cc:1916] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.802451 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet f75847513dcf4c84913a4073176f2507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.773495 5225 tablet_service.cc:1511] Processing CreateTablet for tablet e6b1e7169cdd4f6b8dced0a807bc17e8 (DEFAULT_TABLE table=default.Table_c74dcd01d43b41babf48734ca8244f9f [id=d45c549bb1fe42f48f0aff415f91c29b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.803164 5619 tablet_bootstrap.cc:492] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:06.803104 5228 tablet_service.cc:1511] Processing CreateTablet for tablet b594c65e18d94d1dba45b34dc520823c (DEFAULT_TABLE table=default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.803323 5619 ts_tablet_manager.cc:1403] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.182s user 0.003s sys 0.003s
I20260927 13:50:06.803275 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b044fbc166e848f39d17b63db69f63a4" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:06.803382 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b1e7169cdd4f6b8dced0a807bc17e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.803547 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b594c65e18d94d1dba45b34dc520823c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.804131 5619 raft_consensus.cc:359] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.804328 5619 raft_consensus.cc:385] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.804399 5619 raft_consensus.cc:740] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.804672 5619 consensus_queue.cc:260] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.802848 6455 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_74758221c71d4c799da6b76df7746ba3" } modify_external_catalogs: true
I20260927 13:50:06.808776 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]). Expected version 1 got 0
I20260927 13:50:06.810449 5184 leader_election.cc:304] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.810822 7268 raft_consensus.cc:493] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.810956 7268 raft_consensus.cc:515] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.811530 7268 leader_election.cc:290] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.811651 7268 raft_consensus.cc:2749] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.811913 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe8af2068948c78feac4641a7525be" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:06.811113 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 0d54e51b5c104c75b938aba55cecf890 (table default.Table_a02033f4b12c4cdd986cd855cb148309 [id=0c14f160c8ab4321b14a35fc5f8d3b56]). Expected version 1 got 0
I20260927 13:50:06.812888 5619 ts_tablet_manager.cc:1434] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260927 13:50:06.813400 5619 tablet_bootstrap.cc:492] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:06.814939 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe8af2068948c78feac4641a7525be" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:06.815555 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 50bc839e0fc54839a5d06c176760f618 (table default.Table_16dc00b04267495ea0bf7b352b433889 [id=02b943faad65425ba6058acef5bff0eb]) successfully deleted
I20260927 13:50:06.815841 5184 leader_election.cc:304] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.816339 7203 raft_consensus.cc:2749] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.793411 5626 ts_tablet_manager.cc:1434] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:06.819106 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 5d572343009042d294a9c98648a14127 (DEFAULT_TABLE table=default.Table_3fa264c067c94c4fb5a70ecffe083689 [id=331bc06ed33145f8955da8b8963b550c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.820086 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
I20260927 13:50:06.820444 5074 tablet_service.cc:1511] Processing CreateTablet for tablet b594c65e18d94d1dba45b34dc520823c (DEFAULT_TABLE table=default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.823799 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c7919f5076406186000cd4077aadaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.826061 5077 tablet_service.cc:1511] Processing CreateTablet for tablet 5d572343009042d294a9c98648a14127 (DEFAULT_TABLE table=default.Table_3fa264c067c94c4fb5a70ecffe083689 [id=331bc06ed33145f8955da8b8963b550c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.827440 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b594c65e18d94d1dba45b34dc520823c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.826843 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]). Expected version 1 got 0
I20260927 13:50:06.828610 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d572343009042d294a9c98648a14127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.831281 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff7d501f7704e69b696053cb1b1ffe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.831720 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 9855fd321e4b4d0aa37f7b31d7a5efca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.832067 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 992bf643dee64bccaa993a08027aa5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.832408 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 58d9274ad0934f19a7c36325eee3dd59 with delete_type TABLET_DATA_DELETED (replaced by tablet 0dbdc347bc9845b2b577f551577d070b) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.832758 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 95726f690a71433ca63f95da4ee750e5 with delete_type TABLET_DATA_DELETED (replaced by tablet cddf1b48a78e4ff789e0bb0bf75e307b) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.833103 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64750141d74d988612304ce050688d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.833493 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 3700a1f40c0644848da62392cb0c297f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.833860 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 081f18e00af74e5c811f774d29422351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.834192 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet d3149f6bbaf043f08970e19fd66c4e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.834625 5211 tablet_service.cc:1511] Processing CreateTablet for tablet 5623eafeb090484e9579fc979f0f52a5 (DEFAULT_TABLE table=default.Table_3ca628c79eab48babf7dad481da1cb2e [id=db575521245c4b5f8cb623fd5c778190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.833740 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
I20260927 13:50:06.835803 5619 tablet_bootstrap.cc:654] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.838097 5626 tablet_bootstrap.cc:492] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:06.838636 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 73546fba4ac846efbe9a9f4e346e4c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.839188 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a3f40a2da8649e0898c0e09b6e14a61 with delete_type TABLET_DATA_DELETED (replaced by tablet ead437e93bb14a73a820631b0be041aa) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.839484 5626 tablet_bootstrap.cc:654] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.839509 5352 tablet_service.cc:1558] Processing DeleteTablet for tablet bbb4f42522e84964aeb19358ee02dfc2 with delete_type TABLET_DATA_DELETED (replaced by tablet fcf4c143d5824458be4a42945c338dc9) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.840291 5352 tablet_service.cc:1511] Processing CreateTablet for tablet e337c23812c9469c987626e0e70589df (DEFAULT_TABLE table=default.Table_2340dd3345454c9cbdf067c0a3638a19 [id=22937a0cb089474ebe0988eccd6a3b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.840745 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e337c23812c9469c987626e0e70589df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.844661 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]). Expected version 1 got 0
I20260927 13:50:06.846302 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d572343009042d294a9c98648a14127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.846865 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 5623eafeb090484e9579fc979f0f52a5 (DEFAULT_TABLE table=default.Table_3ca628c79eab48babf7dad481da1cb2e [id=db575521245c4b5f8cb623fd5c778190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.847393 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5623eafeb090484e9579fc979f0f52a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.848285 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 8acd411b965c49919dc77c8c94853548 (DEFAULT_TABLE table=default.Table_65ed372bfab14cbd8ea34e25afdf59d7 [id=064c3328625f4e1faed6cd36616c9af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.848686 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acd411b965c49919dc77c8c94853548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.848632 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]). Expected version 1 got 0
I20260927 13:50:06.850198 5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5623eafeb090484e9579fc979f0f52a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.846432 5080 tablet_service.cc:1511] Processing CreateTablet for tablet abf4cdee82f442dfb2003d752d5fea3a (DEFAULT_TABLE table=default.Table_89f97a5bda26441d81fe82538717c17a [id=1b769747eb074d45b927aaa9cd6f0b3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.853080 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf4cdee82f442dfb2003d752d5fea3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.852883 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]). Expected version 1 got 0
I20260927 13:50:06.857038 5349 tablet_service.cc:1558] Processing DeleteTablet for tablet 0851e183315a45f4a85d68d698e74cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.857155 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]). Expected version 2 got 0
I20260927 13:50:06.859829 7203 raft_consensus.cc:493] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.859987 7203 raft_consensus.cc:515] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.859143 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]). Expected version 1 got 0
I20260927 13:50:06.860857 7203 leader_election.cc:290] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:06.861315 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet 8aeb0c2c2be04a598e011a9d99c5492a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.861442 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b04acc39f3436384fbb69cebdc35cd" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:06.861891 7111 ts_tablet_manager.cc:1950] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:06.861862 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b04acc39f3436384fbb69cebdc35cd" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:06.862552 7111 tablet_replica.cc:333] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:06.862804 7111 raft_consensus.cc:2243] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.862983 7111 raft_consensus.cc:2272] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.863390 5184 leader_election.cc:304] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:06.863554 7111 ts_tablet_manager.cc:1916] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.863850 7203 raft_consensus.cc:2749] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:06.864419 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 8acd411b965c49919dc77c8c94853548 (DEFAULT_TABLE table=default.Table_65ed372bfab14cbd8ea34e25afdf59d7 [id=064c3328625f4e1faed6cd36616c9af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.865650 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acd411b965c49919dc77c8c94853548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.866966 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 20e10c11aec1425e80e05651580fdbc0 (DEFAULT_TABLE table=default.Table_af45c618a8364666918fb3ae10a1fccd [id=ee7873d8d27a46f9b196c9c43b55c7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.867780 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e10c11aec1425e80e05651580fdbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.870217 5628 tablet_bootstrap.cc:654] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.870437 5361 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fdef4f56d9647118afe83ac3cd364fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.870519 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b4494b7e895454f81fef308950729ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.871323 7098 ts_tablet_manager.cc:1929] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:06.874289 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 269cda0876e346149512e0b4985c6890 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.874843 5353 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c14a6b95c1e460a8e7a299340f09498 with delete_type TABLET_DATA_DELETED (replaced by tablet 8acd411b965c49919dc77c8c94853548) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.875489 5353 tablet_service.cc:1511] Processing CreateTablet for tablet e6b1e7169cdd4f6b8dced0a807bc17e8 (DEFAULT_TABLE table=default.Table_c74dcd01d43b41babf48734ca8244f9f [id=d45c549bb1fe42f48f0aff415f91c29b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.875885 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b1e7169cdd4f6b8dced0a807bc17e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.875982 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]). Expected version 1 got 0
I20260927 13:50:06.880147 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]). Expected version 2 got 0
I20260927 13:50:06.884068 5349 tablet_service.cc:1511] Processing CreateTablet for tablet eedf28ed8a61476c811d8352aafceb60 (DEFAULT_TABLE table=default.Table_f8e1d2c1de20415e9d275698c23e2bb2 [id=281bbb4f05cd469cbcc3d0d1be429d4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.884534 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eedf28ed8a61476c811d8352aafceb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.885869 5211 tablet_service.cc:1511] Processing CreateTablet for tablet c06113a678914edabb239789c7262f51 (DEFAULT_TABLE table=default.Table_4d76dda091074c2a916d8a3993b45834 [id=e514a73bb9e04f7091974e424a6230a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.886327 5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06113a678914edabb239789c7262f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.886873 5626 tablet_bootstrap.cc:492] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:06.887092 5626 ts_tablet_manager.cc:1403] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.003s
I20260927 13:50:06.882647 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 9e808336f5b746d486d375695536c052 (table default.Table_36609f3408124349b504ae9eb3275d87 [id=d088563f44224b01a3eba63ce70e5681]). Expected version 1 got 0
I20260927 13:50:06.887347 7098 log.cc:1199] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/0191cfad4e7a4b088b2ecdc246bfa58a
I20260927 13:50:06.887790 7098 ts_tablet_manager.cc:1950] T 0191cfad4e7a4b088b2ecdc246bfa58a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:06.887923 5626 raft_consensus.cc:359] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.888109 5626 raft_consensus.cc:385] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.888170 5626 raft_consensus.cc:740] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.888413 5626 consensus_queue.cc:260] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.888829 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 91) took 2462 ms. Trace:
I20260927 13:50:06.889101 5626 ts_tablet_manager.cc:1434] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:06.889393 5626 tablet_bootstrap.cc:492] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:06.890229 5362 tablet_service.cc:1558] Processing DeleteTablet for tablet b0827a26334c42728545a9eaa006fae0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5978cb78bd974d669817def05007d0ea) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.890538 5356 tablet_service.cc:1558] Processing DeleteTablet for tablet f46f45a0a13b4e05802a08880d7f6a01 with delete_type TABLET_DATA_DELETED (replaced by tablet b594c65e18d94d1dba45b34dc520823c) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:06.889202 7098 rpcz_store.cc:276] 0927 13:50:04.426826 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.530540 (+103714us) service_pool.cc:224] Handling call
0927 13:50:06.759363 (+2228823us) ts_tablet_manager.cc:1151] Deleting tablet 0191cfad4e7a4b088b2ecdc246bfa58a
0927 13:50:06.759372 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.768056 (+ 8684us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.871277 (+103221us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.888811 (+ 17534us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2228666}
I20260927 13:50:06.892795 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 0191cfad4e7a4b088b2ecdc246bfa58a (table default.Table_2bf1c8729308443bba92997d06f84e9e [id=861ae0d96dd54f1dac15e3cce0ed657a]) successfully deleted
I20260927 13:50:06.893602 5626 tablet_bootstrap.cc:654] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:06.896548 7098 tablet_replica.cc:333] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:06.896778 7098 raft_consensus.cc:2243] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:06.896992 7098 raft_consensus.cc:2272] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:06.898033 7098 ts_tablet_manager.cc:1916] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:06.897267 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]). Expected version 2 got 0
I20260927 13:50:06.897344 5086 tablet_service.cc:1511] Processing CreateTablet for tablet c06113a678914edabb239789c7262f51 (DEFAULT_TABLE table=default.Table_4d76dda091074c2a916d8a3993b45834 [id=e514a73bb9e04f7091974e424a6230a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.898739 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06113a678914edabb239789c7262f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.899030 5361 tablet_service.cc:1511] Processing CreateTablet for tablet b594c65e18d94d1dba45b34dc520823c (DEFAULT_TABLE table=default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.899446 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b594c65e18d94d1dba45b34dc520823c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.899900 5362 tablet_service.cc:1511] Processing CreateTablet for tablet abf4cdee82f442dfb2003d752d5fea3a (DEFAULT_TABLE table=default.Table_89f97a5bda26441d81fe82538717c17a [id=1b769747eb074d45b927aaa9cd6f0b3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.900532 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf4cdee82f442dfb2003d752d5fea3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.900815 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5b20ac98f5429ab5e34632102d3ac3 (DEFAULT_TABLE table=default.Table_e5e1a64053e246afa93a7a04384b119f [id=906eb0f051e848b7ba7966195278927b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.901181 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5b20ac98f5429ab5e34632102d3ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.900892 5628 tablet_bootstrap.cc:492] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:06.904018 5628 ts_tablet_manager.cc:1403] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.139s user 0.001s sys 0.004s
I20260927 13:50:06.903883 5356 tablet_service.cc:1511] Processing CreateTablet for tablet b851334fd8144ec3a38ed7e37ec53997 (DEFAULT_TABLE table=default.Table_56fd8ac906824c00b1a20aedef13e66b [id=350a692224414d44b7d57940b647bf6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.905153 5628 raft_consensus.cc:359] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.905506 5628 raft_consensus.cc:385] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.905620 5628 raft_consensus.cc:740] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.905881 5628 consensus_queue.cc:260] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.906742 5628 ts_tablet_manager.cc:1434] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:06.907140 5223 tablet_service.cc:1511] Processing CreateTablet for tablet de625874fd934922b59ffc20f7951cf9 (DEFAULT_TABLE table=default.Table_8492d36517214d8185232485f0741f6e [id=a7754588b1e84d8e9bfa075c65f0f262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.907647 5628 tablet_bootstrap.cc:492] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:06.903908 6455 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_74758221c71d4c799da6b76df7746ba3" } modify_external_catalogs: true
I20260927 13:50:06.908056 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de625874fd934922b59ffc20f7951cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.903973 6445 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_8ccdfb70bd5f4ae9912dd1e5669a09e3" } modify_external_catalogs: true
I20260927 13:50:06.910955 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 5d572343009042d294a9c98648a14127 (DEFAULT_TABLE table=default.Table_3fa264c067c94c4fb5a70ecffe083689 [id=331bc06ed33145f8955da8b8963b550c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.911000 5353 tablet_service.cc:1511] Processing CreateTablet for tablet 5623eafeb090484e9579fc979f0f52a5 (DEFAULT_TABLE table=default.Table_3ca628c79eab48babf7dad481da1cb2e [id=db575521245c4b5f8cb623fd5c778190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.911839 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbdc347bc9845b2b577f551577d070b (DEFAULT_TABLE table=default.Table_544497088a2047e8a6b190c4e23e3e1c [id=d7b1a5499c5f4f9784a8952f1e66c3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.912652 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5b20ac98f5429ab5e34632102d3ac3 (DEFAULT_TABLE table=default.Table_e5e1a64053e246afa93a7a04384b119f [id=906eb0f051e848b7ba7966195278927b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.913733 7305 raft_consensus.cc:493] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.913859 5247 raft_consensus.cc:3060] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:06.913862 7305 raft_consensus.cc:515] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:06.914289 5365 tablet_service.cc:1511] Processing CreateTablet for tablet 8acd411b965c49919dc77c8c94853548 (DEFAULT_TABLE table=default.Table_65ed372bfab14cbd8ea34e25afdf59d7 [id=064c3328625f4e1faed6cd36616c9af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.914505 7305 leader_election.cc:290] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:06.915030 5359 tablet_service.cc:1511] Processing CreateTablet for tablet c06113a678914edabb239789c7262f51 (DEFAULT_TABLE table=default.Table_4d76dda091074c2a916d8a3993b45834 [id=e514a73bb9e04f7091974e424a6230a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.915783 5346 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5b20ac98f5429ab5e34632102d3ac3 (DEFAULT_TABLE table=default.Table_e5e1a64053e246afa93a7a04384b119f [id=906eb0f051e848b7ba7966195278927b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.916785 5363 tablet_service.cc:1511] Processing CreateTablet for tablet de625874fd934922b59ffc20f7951cf9 (DEFAULT_TABLE table=default.Table_8492d36517214d8185232485f0741f6e [id=a7754588b1e84d8e9bfa075c65f0f262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.926692 5626 tablet_bootstrap.cc:492] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:06.926837 5626 ts_tablet_manager.cc:1403] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.000s
I20260927 13:50:06.927480 5626 raft_consensus.cc:359] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.927644 5626 raft_consensus.cc:385] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.927691 5626 raft_consensus.cc:740] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.927935 5626 consensus_queue.cc:260] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.938827 7321 raft_consensus.cc:493] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:06.938970 7321 raft_consensus.cc:515] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.939570 7321 leader_election.cc:290] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:06.944154 5626 ts_tablet_manager.cc:1434] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.017s user 0.001s sys 0.000s
I20260927 13:50:06.903614 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_b68a6b76e8684ab9ab1e52fbfaad3740 [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 2 got 0
I20260927 13:50:06.945474 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]). Expected version 1 got 0
I20260927 13:50:06.940498 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a397300cdd44eb899f2ef5b9fe8c09" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:06.946846 5044 leader_election.cc:343] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:06.947057 5626 tablet_bootstrap.cc:492] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:06.949148 7098 ts_tablet_manager.cc:1929] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:06.949441 7098 log.cc:1199] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f49384587bfa41d6aabfa8ee175d6abe
I20260927 13:50:06.950966 7098 ts_tablet_manager.cc:1950] T f49384587bfa41d6aabfa8ee175d6abe P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:06.958666 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 97b46497d8254a248df8d421d0b09d8d (table default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815]). Expected version 1 got 0
I20260927 13:50:06.958943 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet c655651f9cb24310a5aa2e5b84c2a455 (table default.Table_5c96e3711de04429a590499eb47d5784 [id=db63359dda9d4b729446d6ddf78c30b8]). Expected version 1 got 0
I20260927 13:50:06.959314 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:06.961138 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 0fe47041b75d492bbce62c95d90de021 (table default.Table_eabbc608c09045b095cdfe05e9660ac7 [id=a6d3f0f894904a738cc54fe5d8631f06]). Expected version 1 got 0
I20260927 13:50:06.961258 5223 tablet_service.cc:1511] Processing CreateTablet for tablet cddf1b48a78e4ff789e0bb0bf75e307b (DEFAULT_TABLE table=default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.961383 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:06.961709 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_5bade20242f84b61b8c6a9639fe4d9a6 [id=a160103a454d421c8be6a88afa7c1419]). Expected version 2 got 0
I20260927 13:50:06.962224 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]). Expected version 1 got 0
I20260927 13:50:06.962548 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]). Expected version 1 got 0
I20260927 13:50:06.962755 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]). Expected version 1 got 0
I20260927 13:50:06.962929 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 2cc7301d09b245328a851a0734669965 (table default.Table_7a5a607e5463433eb93aedb9f76696db [id=1f268483d3c7447abfe7a024dd0aec58]). Expected version 1 got 0
I20260927 13:50:06.963125 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:06.963402 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a4099c41981f46758a8f478d7fdb4182 (table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]). Expected version 1 got 0
I20260927 13:50:06.963693 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 78719428d7b34f28a99722b093f6ab54 (table default.Table_6d795d7a66ee42f3a7fb0cef447cddba [id=ed8d36823c5c43eaa1e8b0447c7f32e9]). Expected version 1 got 0
I20260927 13:50:06.964169 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]). Expected version 1 got 0
I20260927 13:50:06.962579 5619 tablet_bootstrap.cc:492] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:06.968469 5080 tablet_service.cc:1511] Processing CreateTablet for tablet de625874fd934922b59ffc20f7951cf9 (DEFAULT_TABLE table=default.Table_8492d36517214d8185232485f0741f6e [id=a7754588b1e84d8e9bfa075c65f0f262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.969120 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de625874fd934922b59ffc20f7951cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.970525 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 10dc68c97a4244d29fede0a785c2e4b8 (DEFAULT_TABLE table=default.Table_0eb2310657374b4c9746296895007026 [id=17c17b7cb12c40ce81b7a015458f911b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.972406 5087 tablet_service.cc:1511] Processing CreateTablet for tablet 10dc68c97a4244d29fede0a785c2e4b8 (DEFAULT_TABLE table=default.Table_0eb2310657374b4c9746296895007026 [id=17c17b7cb12c40ce81b7a015458f911b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.972764 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10dc68c97a4244d29fede0a785c2e4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.979714 5619 ts_tablet_manager.cc:1403] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.166s user 0.001s sys 0.004s
I20260927 13:50:06.964730 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 187b3ceeccb142c4b798947e584d6044 (table default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82]). Expected version 1 got 0
I20260927 13:50:06.979456 5086 tablet_service.cc:1511] Processing CreateTablet for tablet cddf1b48a78e4ff789e0bb0bf75e307b (DEFAULT_TABLE table=default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:06.981331 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]). Expected version 1 got 0
I20260927 13:50:06.981645 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]). Expected version 2 got 0
I20260927 13:50:06.981827 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
I20260927 13:50:06.982152 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 5678703b72c8471583147786f49122a5 (table default.Table_f3c5680fa304438d9df88d573453cd6f [id=0d85f9f0d28e43debda43f83a3e59637]). Expected version 2 got 0
I20260927 13:50:06.982618 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:06.982824 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:06.983000 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:06.982602 5619 raft_consensus.cc:359] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.983326 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:06.983340 5619 raft_consensus.cc:385] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:06.983579 5619 raft_consensus.cc:740] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:06.983949 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:50:06.984143 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]). Expected version 1 got 0
I20260927 13:50:06.984963 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
I20260927 13:50:06.984632 5619 consensus_queue.cc:260] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:06.987044 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddf1b48a78e4ff789e0bb0bf75e307b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.913892 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5b20ac98f5429ab5e34632102d3ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.989395 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10dc68c97a4244d29fede0a785c2e4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:06.989568 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddf1b48a78e4ff789e0bb0bf75e307b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:06.995343 5319 leader_election.cc:343] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:06.996829 5319 leader_election.cc:343] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:06.998162 5319 leader_election.cc:343] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.001019 7190 ts_tablet_manager.cc:1929] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.001197 7190 log.cc:1199] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/bb25bb5ee153494d803130f1ad4f7c2e
I20260927 13:50:07.006870 5628 tablet_bootstrap.cc:654] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.020656 7190 ts_tablet_manager.cc:1950] T bb25bb5ee153494d803130f1ad4f7c2e P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.021696 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 90) took 2034 ms. Trace:
I20260927 13:50:07.021855 7190 rpcz_store.cc:276] 0927 13:50:04.987101 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.987262 (+ 161us) service_pool.cc:224] Handling call
0927 13:50:06.799550 (+1812288us) ts_tablet_manager.cc:1151] Deleting tablet bb25bb5ee153494d803130f1ad4f7c2e
0927 13:50:06.799558 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.930983 (+131425us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.000964 (+ 69981us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.021672 (+ 20708us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1808981}
I20260927 13:50:07.003818 5626 tablet_bootstrap.cc:654] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.027591 7305 raft_consensus.cc:493] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.027791 7305 raft_consensus.cc:515] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.028401 7305 leader_election.cc:290] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.030481 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 90) took 2604 ms. Trace:
I20260927 13:50:07.030645 7098 rpcz_store.cc:276] 0927 13:50:04.425980 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.530196 (+104216us) service_pool.cc:224] Handling call
0927 13:50:06.896500 (+2366304us) ts_tablet_manager.cc:1151] Deleting tablet f49384587bfa41d6aabfa8ee175d6abe
0927 13:50:06.896509 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:06.921086 (+ 24577us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:06.949090 (+ 28004us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.030453 (+ 81363us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2365486}
I20260927 13:50:07.031711 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f49384587bfa41d6aabfa8ee175d6abe (table default.Table_8a9f7c16b9ec4d10848c2bb0c661fe27 [id=0cf3d2b79225499f86d3d78ef105ab4b]) successfully deleted
I20260927 13:50:07.032135 7098 tablet_replica.cc:333] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.032449 7098 raft_consensus.cc:2243] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.032697 7098 raft_consensus.cc:2272] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.033317 7098 ts_tablet_manager.cc:1916] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.033823 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet bb25bb5ee153494d803130f1ad4f7c2e (table default.Table_cb8208423d374903b009adbf0c2cbe9d [id=7aabe4ef709d4722a07adc668a50b9de]) successfully deleted
I20260927 13:50:07.034575 7190 tablet_replica.cc:333] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.034855 7190 raft_consensus.cc:2243] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.035326 7190 raft_consensus.cc:2272] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.035984 7190 ts_tablet_manager.cc:1916] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.036885 6453 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 97b46497d8254a248df8d421d0b09d8d
I20260927 13:50:07.037439 6453 catalog_manager.cc:6934] ReplaceTablet: tablet 97b46497d8254a248df8d421d0b09d8d deleted and replaced by tablet 8693dee8fa3f42388b0a728c223854a9
I20260927 13:50:07.037575 6453 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:34390 (request call id 107) took 1412 ms. Trace:
I20260927 13:50:07.037658 6453 rpcz_store.cc:276] 0927 13:50:05.624775 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.663487 (+1038712us) service_pool.cc:224] Handling call
0927 13:50:06.711015 (+ 47528us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00007fe748a7c65d 00007fe748a7c753 00007fe7455f9db1 00007fe74d3eda7d 00007fe74d589d2b 00007fe743f55657 00007fe743f55385 00007fe74064c63e 00007fe74064b51e 00007fe740651758 00007fe7406520bf
0927 13:50:07.037521 (+326506us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:07.030727 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:07.030867 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:07.030877 (+ 10us) write_op.cc:435] Acquired schema lock
0927 13:50:07.030880 (+ 3us) tablet.cc:662] Decoding operations
0927 13:50:07.031007 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:07.031027 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:07.031031 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:07.031124 (+ 93us) tablet.cc:701] Row locks acquired
0927 13:50:07.031127 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:07.031168 (+ 41us) write_op.cc:270] Start()
0927 13:50:07.031204 (+ 36us) write_op.cc:276] Timestamp: P: 1790517007031123 usec, L: 0
0927 13:50:07.031208 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:07.031428 (+ 220us) log.cc:844] Serialized 625 byte log entry
0927 13:50:07.035160 (+ 3732us) op_driver.cc:464] REPLICATION: finished
0927 13:50:07.035323 (+ 163us) write_op.cc:301] APPLY: starting
0927 13:50:07.035343 (+ 20us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:07.035393 (+ 50us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:07.035420 (+ 27us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:07.035563 (+ 143us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:07.035647 (+ 84us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:07.035655 (+ 8us) write_op.cc:312] APPLY: finished
0927 13:50:07.035742 (+ 87us) log.cc:844] Serialized 29 byte log entry
0927 13:50:07.035809 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:07.035836 (+ 27us) write_op.cc:454] Released schema lock
0927 13:50:07.035843 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:07.035918 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:07.035922 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":108237568,"child_traces":[["op",{"apply.queue_time_us":108,"apply.run_cpu_time_us":583,"apply.run_wall_time_us":583,"num_ops":2,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":827,"prepare.run_wall_time_us":827,"raft.queue_time_us":963,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":266,"replication_time_us":3913}]]}
I20260927 13:50:07.042227 5626 tablet_bootstrap.cc:492] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:07.045846 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 97b46497d8254a248df8d421d0b09d8d with delete_type TABLET_DATA_DELETED (replaced by tablet 8693dee8fa3f42388b0a728c223854a9) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:07.046597 5626 ts_tablet_manager.cc:1403] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.100s user 0.004s sys 0.000s
I20260927 13:50:07.047775 5626 raft_consensus.cc:359] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.048144 5626 raft_consensus.cc:385] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.048286 5626 raft_consensus.cc:740] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.048686 5626 consensus_queue.cc:260] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.050689 5626 ts_tablet_manager.cc:1434] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:50:07.052096 5626 tablet_bootstrap.cc:492] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:07.052989 5619 ts_tablet_manager.cc:1434] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.073s user 0.003s sys 0.001s
I20260927 13:50:07.056872 5626 tablet_bootstrap.cc:654] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.058815 5074 tablet_service.cc:1558] Processing DeleteTablet for tablet 97b46497d8254a248df8d421d0b09d8d with delete_type TABLET_DATA_DELETED (replaced by tablet 8693dee8fa3f42388b0a728c223854a9) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:07.066921 7098 ts_tablet_manager.cc:1929] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:07.072433 7190 ts_tablet_manager.cc:1929] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.077114 7098 log.cc:1199] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a1e7e50142e447158f90770322609a2f
I20260927 13:50:07.000391 5319 leader_election.cc:304] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:07.077812 7190 log.cc:1199] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/081f18e00af74e5c811f774d29422351
I20260927 13:50:07.078132 7305 raft_consensus.cc:2804] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.078299 7190 ts_tablet_manager.cc:1950] T 081f18e00af74e5c811f774d29422351 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.078302 7305 raft_consensus.cc:697] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:07.078620 7305 consensus_queue.cc:237] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.079191 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 91) took 2088 ms. Trace:
I20260927 13:50:07.079308 7190 rpcz_store.cc:276] 0927 13:50:04.991767 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.991836 (+ 69us) service_pool.cc:224] Handling call
0927 13:50:07.034515 (+2042679us) ts_tablet_manager.cc:1151] Deleting tablet 081f18e00af74e5c811f774d29422351
0927 13:50:07.034530 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.061438 (+ 26908us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.072349 (+ 10911us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.079163 (+ 6814us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2042461}
I20260927 13:50:07.079931 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 081f18e00af74e5c811f774d29422351 (table default.Table_92bf3a9fa895485597b7f5cda3251baf [id=5900f338a23b46e8a487ec9cfa08b8a8]) successfully deleted
I20260927 13:50:07.077651 7098 ts_tablet_manager.cc:1950] T a1e7e50142e447158f90770322609a2f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.081317 7203 raft_consensus.cc:493] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.081466 7203 raft_consensus.cc:515] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.081918 5626 tablet_bootstrap.cc:492] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:07.082063 5626 ts_tablet_manager.cc:1403] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.003s
I20260927 13:50:07.082147 7203 leader_election.cc:290] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.082597 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbacda63c0d3427aabf3332b278576c5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.082798 5626 raft_consensus.cc:359] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.082935 5626 raft_consensus.cc:385] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.083019 5626 raft_consensus.cc:740] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.082921 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 92) took 2656 ms. Trace:
I20260927 13:50:07.082998 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbacda63c0d3427aabf3332b278576c5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.083282 5626 consensus_queue.cc:260] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.083757 5184 leader_election.cc:304] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.083897 5626 ts_tablet_manager.cc:1434] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:07.083248 7098 rpcz_store.cc:276] 0927 13:50:04.426912 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.530711 (+103799us) service_pool.cc:224] Handling call
0927 13:50:07.032075 (+2501364us) ts_tablet_manager.cc:1151] Deleting tablet a1e7e50142e447158f90770322609a2f
0927 13:50:07.032087 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.063556 (+ 31469us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.066861 (+ 3305us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.082901 (+ 16040us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36843,"tablet-delete.queue_time_us":2465690}
I20260927 13:50:07.084414 7203 raft_consensus.cc:2749] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.084493 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a1e7e50142e447158f90770322609a2f (table default.Table_bc37738823ef4e37a87cc856bf9bfbab [id=f5dc8e23cf63496f9b5920f02ce9cad5]) successfully deleted
I20260927 13:50:07.085078 7098 tablet_replica.cc:333] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.085417 7098 raft_consensus.cc:2243] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.085641 7098 raft_consensus.cc:2272] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.086287 7098 ts_tablet_manager.cc:1916] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.088544 5626 tablet_bootstrap.cc:492] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:07.090533 5626 tablet_bootstrap.cc:654] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.093327 5628 tablet_bootstrap.cc:492] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:07.094007 5628 ts_tablet_manager.cc:1403] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.186s user 0.003s sys 0.002s
W20260927 13:50:07.095703 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 95700.7us
I20260927 13:50:07.098001 5628 raft_consensus.cc:359] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.099064 5628 raft_consensus.cc:385] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.099397 5628 raft_consensus.cc:740] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.100577 5628 consensus_queue.cc:260] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.091495 7190 tablet_replica.cc:333] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.102854 7190 raft_consensus.cc:2243] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.103233 7190 raft_consensus.cc:2272] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.103857 7190 ts_tablet_manager.cc:1916] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.105343 5628 ts_tablet_manager.cc:1434] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260927 13:50:07.108755 5628 tablet_bootstrap.cc:492] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:07.117553 7190 ts_tablet_manager.cc:1929] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.117374 5628 tablet_bootstrap.cc:654] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.120640 7098 ts_tablet_manager.cc:1929] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:07.120854 7098 log.cc:1199] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/bb6073174dbb4ca1933685b7bd3a22e1
W20260927 13:50:07.119867 5319 leader_election.cc:343] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.121275 7098 ts_tablet_manager.cc:1950] T bb6073174dbb4ca1933685b7bd3a22e1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.121551 7190 log.cc:1199] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/3933c0a2fd6547f28528fae7d443a2c1
I20260927 13:50:07.124981 7190 ts_tablet_manager.cc:1950] T 3933c0a2fd6547f28528fae7d443a2c1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.125864 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 93) took 2696 ms. Trace:
I20260927 13:50:07.126865 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 92) took 2134 ms. Trace:
I20260927 13:50:07.127010 7098 rpcz_store.cc:276] 0927 13:50:04.428938 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.581888 (+152950us) service_pool.cc:224] Handling call
0927 13:50:07.085025 (+2503137us) ts_tablet_manager.cc:1151] Deleting tablet bb6073174dbb4ca1933685b7bd3a22e1
0927 13:50:07.085035 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.097226 (+ 12191us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.120570 (+ 23344us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.125839 (+ 5269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21105,"tablet-delete.queue_time_us":2502838}
I20260927 13:50:07.127684 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet bb6073174dbb4ca1933685b7bd3a22e1 (table default.Table_af1fdd99060c4fbcbd2e734ce850a4ad [id=671b833b30694e8ca3802d879a947f3b]) successfully deleted
I20260927 13:50:07.128098 7098 tablet_replica.cc:333] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.128351 7098 raft_consensus.cc:2243] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.128506 7190 rpcz_store.cc:276] 0927 13:50:04.992283 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.994874 (+ 2591us) service_pool.cc:224] Handling call
0927 13:50:07.085242 (+2090368us) ts_tablet_manager.cc:1151] Deleting tablet 3933c0a2fd6547f28528fae7d443a2c1
0927 13:50:07.091445 (+ 6203us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.114191 (+ 22746us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.117488 (+ 3297us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.126841 (+ 9353us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2090200}
I20260927 13:50:07.128898 7098 raft_consensus.cc:2272] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.129348 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 3933c0a2fd6547f28528fae7d443a2c1 (table default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]) successfully deleted
I20260927 13:50:07.129712 7190 tablet_replica.cc:333] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.129720 5619 tablet_bootstrap.cc:492] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:07.130429 7098 ts_tablet_manager.cc:1916] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.130719 7190 raft_consensus.cc:2243] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.131088 7190 pending_rounds.cc:70] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:50:07.131192 7190 pending_rounds.cc:77] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957646652137472 op_type: NO_OP noop_request { }
I20260927 13:50:07.134325 7190 raft_consensus.cc:2889] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:07.134553 7190 raft_consensus.cc:2272] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.135735 7190 ts_tablet_manager.cc:1916] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.139596 5628 tablet_bootstrap.cc:492] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:07.139900 5628 ts_tablet_manager.cc:1403] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.001s
I20260927 13:50:07.140417 6779 raft_consensus.cc:493] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.140544 6779 raft_consensus.cc:515] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.141186 6779 leader_election.cc:290] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:07.141664 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1a58c67bf54493a3c62fb175acabb8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:07.142273 5044 leader_election.cc:343] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.142863 5628 raft_consensus.cc:359] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.143168 5628 raft_consensus.cc:385] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.143304 5628 raft_consensus.cc:740] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.143760 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 5678703b72c8471583147786f49122a5 (table default.Table_f3c5680fa304438d9df88d573453cd6f [id=0d85f9f0d28e43debda43f83a3e59637]). Expected version 2 got 0
I20260927 13:50:07.143666 5628 consensus_queue.cc:260] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.144090 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
I20260927 13:50:07.144346 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:07.145439 5628 ts_tablet_manager.cc:1434] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:50:07.148725 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:07.150599 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_b68a6b76e8684ab9ab1e52fbfaad3740 [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 2 got 0
I20260927 13:50:07.150982 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:07.151249 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]). Expected version 1 got 0
I20260927 13:50:07.151422 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]). Expected version 2 got 0
I20260927 13:50:07.151831 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e3765fe06c664e60a11acf76c825bc42 (table default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee]). Expected version 1 got 0
I20260927 13:50:07.152081 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:50:07.152607 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]). Expected version 1 got 0
I20260927 13:50:07.152856 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_cfdab7814ecc495089389612e0a7e4fe [id=ae170bbebc4e460fb58beb7f95f013a2]). Expected version 2 got 0
I20260927 13:50:07.153044 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]). Expected version 5 got 0
I20260927 13:50:07.153239 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:50:07.153436 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:50:07.153666 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]). Expected version 2 got 0
I20260927 13:50:07.153950 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]). Expected version 1 got 0
I20260927 13:50:07.160013 7098 ts_tablet_manager.cc:1929] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.160146 7098 log.cc:1199] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/413d863d9a564e5d8325b4479346730d
I20260927 13:50:07.160531 7098 ts_tablet_manager.cc:1950] T 413d863d9a564e5d8325b4479346730d P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.161357 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_954f47d3ef8846b8ade030d87002460e [id=750521adcb384c75841d7e1ff89af83d]). Expected version 2 got 0
W20260927 13:50:07.160930 5319 leader_election.cc:343] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.161819 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]). Expected version 1 got 0
I20260927 13:50:07.162082 7190 ts_tablet_manager.cc:1929] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.162222 7190 log.cc:1199] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/da75a470ec0c4ec9afa7c18a51cd7276
I20260927 13:50:07.162619 7190 ts_tablet_manager.cc:1950] T da75a470ec0c4ec9afa7c18a51cd7276 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.163467 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 95) took 2170 ms. Trace:
I20260927 13:50:07.163556 7190 rpcz_store.cc:276] 0927 13:50:04.992750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.995058 (+ 2308us) service_pool.cc:224] Handling call
0927 13:50:07.129662 (+2134604us) ts_tablet_manager.cc:1151] Deleting tablet da75a470ec0c4ec9afa7c18a51cd7276
0927 13:50:07.129673 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.148576 (+ 18903us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.162022 (+ 13446us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.163445 (+ 1423us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2134482}
I20260927 13:50:07.164130 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet da75a470ec0c4ec9afa7c18a51cd7276 (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]) successfully deleted
I20260927 13:50:07.162098 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_6ac0611179c743808ff8a129f463dd61 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 3 got 0
I20260927 13:50:07.166872 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]). Expected version 3 got 0
I20260927 13:50:07.167109 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 90fb369fec2d43149080ab2ad94ecc57 (table default.Table_7b19583e86df4689a2e40ce5a9148e19 [id=23ffbb0d3240465cb12a09ffec1f8163]). Expected version 1 got 0
I20260927 13:50:07.167534 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]). Expected version 1 got 0
I20260927 13:50:07.167757 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 564f5c92bf144fa1bfc2e1e07132dd69 (table default.Table_b927618f29db4aa49333c257a59c9aa3 [id=c81f7b3016144fd7a7329fbf31049d93]). Expected version 1 got 0
I20260927 13:50:07.168401 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 0d54e51b5c104c75b938aba55cecf890 (table default.Table_a02033f4b12c4cdd986cd855cb148309 [id=0c14f160c8ab4321b14a35fc5f8d3b56]). Expected version 1 got 0
I20260927 13:50:07.170342 7190 tablet_replica.cc:333] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.170598 7190 raft_consensus.cc:2243] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.170951 7190 raft_consensus.cc:2272] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.171074 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
I20260927 13:50:07.171388 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
I20260927 13:50:07.171471 7231 raft_consensus.cc:493] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.171587 7190 ts_tablet_manager.cc:1916] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.171600 7231 raft_consensus.cc:515] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.172017 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:07.172190 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:07.172217 7231 leader_election.cc:290] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.172394 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:07.172629 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]). Expected version 2 got 0
I20260927 13:50:07.172834 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 0fe47041b75d492bbce62c95d90de021 (table default.Table_eabbc608c09045b095cdfe05e9660ac7 [id=a6d3f0f894904a738cc54fe5d8631f06]). Expected version 1 got 0
I20260927 13:50:07.173403 5432 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:07.173552 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]). Expected version 1 got 0
I20260927 13:50:07.173851 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 3b26289ed050454d817c13159295ec37 (table default.Table_5b64a307e44a471598ef010e33a82fe3 [id=9c86bcdd37654832b7a92763aa42e6c4]). Expected version 1 got 0
I20260927 13:50:07.174093 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]). Expected version 2 got 0
I20260927 13:50:07.181819 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_5bade20242f84b61b8c6a9639fe4d9a6 [id=a160103a454d421c8be6a88afa7c1419]). Expected version 2 got 0
I20260927 13:50:07.182166 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c655651f9cb24310a5aa2e5b84c2a455 (table default.Table_5c96e3711de04429a590499eb47d5784 [id=db63359dda9d4b729446d6ddf78c30b8]). Expected version 1 got 0
I20260927 13:50:07.182981 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet ead437e93bb14a73a820631b0be041aa (table default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]). Expected version 1 got 0
I20260927 13:50:07.183149 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 85debab98b0f42a5b50f1b0d132147d3 (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]). Expected version 1 got 0
I20260927 13:50:07.183161 7265 raft_consensus.cc:493] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.183318 7265 raft_consensus.cc:515] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.184140 7265 leader_election.cc:290] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.184973 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f702b0a6380543a8ac539125d4334cd5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.185189 5100 raft_consensus.cc:2468] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:07.185201 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
I20260927 13:50:07.185441 6779 raft_consensus.cc:493] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.185477 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6 (table default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]). Expected version 1 got 0
I20260927 13:50:07.185555 6779 raft_consensus.cc:515] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:07.185544 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f702b0a6380543a8ac539125d4334cd5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.185771 5381 raft_consensus.cc:2468] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:07.186144 6779 leader_election.cc:290] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:07.186502 5185 leader_election.cc:304] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:07.186528 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e3bb24afad4d789041b6a557512618" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:07.186959 7265 raft_consensus.cc:2804] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260927 13:50:07.186959 5044 leader_election.cc:343] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.187036 7265 raft_consensus.cc:493] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:07.187103 7265 raft_consensus.cc:3060] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.187450 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 07830b76d7e14ff0b6b1b1523dda21bc (table default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]). Expected version 2 got 0
I20260927 13:50:07.188477 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]). Expected version 1 got 0
I20260927 13:50:07.190573 7265 raft_consensus.cc:515] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.191761 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f702b0a6380543a8ac539125d4334cd5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:07.191926 5381 raft_consensus.cc:3060] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.194465 7265 leader_election.cc:290] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.194991 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f702b0a6380543a8ac539125d4334cd5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:07.195179 5100 raft_consensus.cc:3060] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.195524 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 78719428d7b34f28a99722b093f6ab54 (table default.Table_6d795d7a66ee42f3a7fb0cef447cddba [id=ed8d36823c5c43eaa1e8b0447c7f32e9]). Expected version 1 got 0
I20260927 13:50:07.195604 5381 raft_consensus.cc:2468] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:07.196193 5185 leader_election.cc:304] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:07.196390 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc (table default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]). Expected version 1 got 0
I20260927 13:50:07.196647 7265 raft_consensus.cc:2804] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.196844 7190 ts_tablet_manager.cc:1929] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.197218 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]). Expected version 1 got 0
I20260927 13:50:07.198046 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a4099c41981f46758a8f478d7fdb4182 (table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]). Expected version 1 got 0
I20260927 13:50:07.197257 7265 raft_consensus.cc:697] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:07.198885 7265 consensus_queue.cc:237] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.199026 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]). Expected version 1 got 0
I20260927 13:50:07.199880 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 2cc7301d09b245328a851a0734669965 (table default.Table_7a5a607e5463433eb93aedb9f76696db [id=1f268483d3c7447abfe7a024dd0aec58]). Expected version 1 got 0
I20260927 13:50:07.200098 5628 tablet_bootstrap.cc:492] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:07.200191 7190 log.cc:1199] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/a0e14fd01a9141cdb2df030ee0dd05db
I20260927 13:50:07.200745 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:07.200986 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]). Expected version 2 got 0
I20260927 13:50:07.201319 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]). Expected version 1 got 0
I20260927 13:50:07.201747 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]). Expected version 1 got 0
I20260927 13:50:07.201805 5628 tablet_bootstrap.cc:654] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.201941 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]). Expected version 1 got 0
I20260927 13:50:07.202394 7190 ts_tablet_manager.cc:1950] T a0e14fd01a9141cdb2df030ee0dd05db P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.202713 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 94) took 2717 ms. Trace:
I20260927 13:50:07.203117 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 96) took 2210 ms. Trace:
I20260927 13:50:07.204053 7190 rpcz_store.cc:276] 0927 13:50:04.992829 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.995188 (+ 2359us) service_pool.cc:224] Handling call
0927 13:50:07.170269 (+2175081us) ts_tablet_manager.cc:1151] Deleting tablet a0e14fd01a9141cdb2df030ee0dd05db
0927 13:50:07.170281 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.175113 (+ 4832us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.196780 (+ 21667us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.203099 (+ 6319us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2174964}
I20260927 13:50:07.202787 7098 rpcz_store.cc:276] 0927 13:50:04.485566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.582746 (+ 97180us) service_pool.cc:224] Handling call
0927 13:50:07.128043 (+2545297us) ts_tablet_manager.cc:1151] Deleting tablet 413d863d9a564e5d8325b4479346730d
0927 13:50:07.128055 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.145573 (+ 17518us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.159948 (+ 14375us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.202694 (+ 42746us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20275,"tablet-delete.queue_time_us":2544999}
I20260927 13:50:07.205595 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 95) took 2646 ms. Trace:
I20260927 13:50:07.205679 7098 rpcz_store.cc:276] 0927 13:50:04.559052 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.588675 (+ 29623us) service_pool.cc:224] Handling call
0927 13:50:07.204964 (+2616289us) ts_tablet_manager.cc:1151] Deleting tablet 8c14a6b95c1e460a8e7a299340f09498
0927 13:50:07.204973 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.205576 (+ 603us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12925,"tablet-delete.queue_time_us":2614531}
I20260927 13:50:07.205993 7098 tablet_replica.cc:333] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.206249 7098 raft_consensus.cc:2243] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.206403 7098 raft_consensus.cc:2272] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.206426 5626 tablet_bootstrap.cc:492] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:07.206552 5626 ts_tablet_manager.cc:1403] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.118s user 0.013s sys 0.015s
I20260927 13:50:07.206918 7098 ts_tablet_manager.cc:1916] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:07.206187 5319 leader_election.cc:343] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.207448 5626 raft_consensus.cc:359] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.207566 7190 tablet_replica.cc:333] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.207613 5626 raft_consensus.cc:385] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.207665 5626 raft_consensus.cc:740] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.207866 5626 consensus_queue.cc:260] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.207752 7190 raft_consensus.cc:2243] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.208441 7190 raft_consensus.cc:2272] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.198452 5100 raft_consensus.cc:2468] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:07.208549 5626 ts_tablet_manager.cc:1434] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:07.209487 7268 raft_consensus.cc:493] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.210570 7268 raft_consensus.cc:515] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.211162 7268 leader_election.cc:290] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.211943 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b0349bfaa4a9c8b7d280177f1ecae" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.211865 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b0349bfaa4a9c8b7d280177f1ecae" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.212175 5100 raft_consensus.cc:2468] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:07.212253 5626 tablet_bootstrap.cc:492] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:07.212435 5381 raft_consensus.cc:2468] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:07.212626 5184 leader_election.cc:304] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:07.212899 7268 raft_consensus.cc:2804] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:07.212975 7268 raft_consensus.cc:493] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:07.213053 7268 raft_consensus.cc:3060] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.210405 7190 ts_tablet_manager.cc:1916] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.202219 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]). Expected version 1 got 0
I20260927 13:50:07.216365 7268 raft_consensus.cc:515] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.205327 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 413d863d9a564e5d8325b4479346730d (table default.Table_fbec3d960eb2415280ee9b1e7171392a [id=f03beab934924c65bd71d31d91c0f5cd]) successfully deleted
I20260927 13:50:07.216856 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]). Expected version 1 got 0
I20260927 13:50:07.216936 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet a0e14fd01a9141cdb2df030ee0dd05db (table default.Table_8442b904c41d4d39a56497c27763e7f4 [id=6bf215680ef94518ae98737c9e63301d]) successfully deleted
I20260927 13:50:07.217012 7268 leader_election.cc:290] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.217060 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]). Expected version 1 got 0
W20260927 13:50:07.217237 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 8c14a6b95c1e460a8e7a299340f09498 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c14a6b95c1e460a8e7a299340f09498 already in progress: creating tablet
I20260927 13:50:07.217409 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 9e808336f5b746d486d375695536c052 (table default.Table_36609f3408124349b504ae9eb3275d87 [id=d088563f44224b01a3eba63ce70e5681]). Expected version 1 got 0
I20260927 13:50:07.217434 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b0349bfaa4a9c8b7d280177f1ecae" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:07.217638 5381 raft_consensus.cc:3060] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.217901 5626 tablet_bootstrap.cc:654] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.218050 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]). Expected version 2 got 0
I20260927 13:50:07.218055 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b0349bfaa4a9c8b7d280177f1ecae" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:07.218323 5100 raft_consensus.cc:3060] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.218375 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]). Expected version 1 got 0
I20260927 13:50:07.218626 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
I20260927 13:50:07.218848 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]). Expected version 1 got 0
I20260927 13:50:07.219233 6444 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]). Expected version 1 got 0
I20260927 13:50:07.220654 5381 raft_consensus.cc:2468] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:07.221056 5185 leader_election.cc:304] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:07.221383 7268 raft_consensus.cc:2804] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.221503 7268 raft_consensus.cc:697] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:07.221787 7268 consensus_queue.cc:237] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.229562 5100 raft_consensus.cc:2468] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:07.245651 7098 ts_tablet_manager.cc:1929] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.246487 7098 log.cc:1199] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f46f45a0a13b4e05802a08880d7f6a01
I20260927 13:50:07.250487 7098 ts_tablet_manager.cc:1950] T f46f45a0a13b4e05802a08880d7f6a01 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.251937 6779 raft_consensus.cc:493] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.252067 6779 raft_consensus.cc:515] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.252739 6779 leader_election.cc:290] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:07.272001 5628 tablet_bootstrap.cc:492] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:07.272313 5628 ts_tablet_manager.cc:1403] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.072s user 0.008s sys 0.011s
I20260927 13:50:07.281628 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]). Expected version 2 got 0
I20260927 13:50:07.293427 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_cfdab7814ecc495089389612e0a7e4fe [id=ae170bbebc4e460fb58beb7f95f013a2]). Expected version 2 got 0
I20260927 13:50:07.293947 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]). Expected version 2 got 0
I20260927 13:50:07.294392 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]). Expected version 1 got 0
I20260927 13:50:07.294625 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_954f47d3ef8846b8ade030d87002460e [id=750521adcb384c75841d7e1ff89af83d]). Expected version 2 got 0
I20260927 13:50:07.295148 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]). Expected version 1 got 0
I20260927 13:50:07.295429 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]). Expected version 1 got 0
I20260927 13:50:07.295979 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:50:07.296523 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_6ac0611179c743808ff8a129f463dd61 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 3 got 0
I20260927 13:50:07.296962 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:50:07.297271 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]). Expected version 3 got 0
I20260927 13:50:07.297745 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]). Expected version 1 got 0
I20260927 13:50:07.298374 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]). Expected version 5 got 0
I20260927 13:50:07.299278 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 90fb369fec2d43149080ab2ad94ecc57 (table default.Table_7b19583e86df4689a2e40ce5a9148e19 [id=23ffbb0d3240465cb12a09ffec1f8163]). Expected version 1 got 0
I20260927 13:50:07.300355 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
I20260927 13:50:07.302152 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]). Expected version 1 got 0
I20260927 13:50:07.302508 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]). Expected version 1 got 0
I20260927 13:50:07.303282 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
I20260927 13:50:07.304448 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]). Expected version 1 got 0
I20260927 13:50:07.304908 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet e3765fe06c664e60a11acf76c825bc42 (table default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee]). Expected version 1 got 0
I20260927 13:50:07.305294 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]). Expected version 1 got 0
I20260927 13:50:07.305581 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_5bade20242f84b61b8c6a9639fe4d9a6 [id=a160103a454d421c8be6a88afa7c1419]). Expected version 2 got 0
I20260927 13:50:07.306988 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
I20260927 13:50:07.307354 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:07.307969 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]). Expected version 2 got 0
I20260927 13:50:07.308454 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet ead437e93bb14a73a820631b0be041aa (table default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]). Expected version 1 got 0
I20260927 13:50:07.308751 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 85debab98b0f42a5b50f1b0d132147d3 (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]). Expected version 1 got 0
I20260927 13:50:07.309213 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 0fe47041b75d492bbce62c95d90de021 (table default.Table_eabbc608c09045b095cdfe05e9660ac7 [id=a6d3f0f894904a738cc54fe5d8631f06]). Expected version 1 got 0
I20260927 13:50:07.309552 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]). Expected version 1 got 0
I20260927 13:50:07.310285 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_b68a6b76e8684ab9ab1e52fbfaad3740 [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 2 got 0
I20260927 13:50:07.310532 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 3b26289ed050454d817c13159295ec37 (table default.Table_5b64a307e44a471598ef010e33a82fe3 [id=9c86bcdd37654832b7a92763aa42e6c4]). Expected version 1 got 0
I20260927 13:50:07.310915 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]). Expected version 1 got 0
I20260927 13:50:07.311177 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]). Expected version 2 got 0
I20260927 13:50:07.311825 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a4099c41981f46758a8f478d7fdb4182 (table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]). Expected version 1 got 0
I20260927 13:50:07.312348 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet c655651f9cb24310a5aa2e5b84c2a455 (table default.Table_5c96e3711de04429a590499eb47d5784 [id=db63359dda9d4b729446d6ddf78c30b8]). Expected version 1 got 0
I20260927 13:50:07.312988 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 78719428d7b34f28a99722b093f6ab54 (table default.Table_6d795d7a66ee42f3a7fb0cef447cddba [id=ed8d36823c5c43eaa1e8b0447c7f32e9]). Expected version 1 got 0
I20260927 13:50:07.313768 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6 (table default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]). Expected version 1 got 0
I20260927 13:50:07.314065 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 97) took 2232 ms. Trace:
I20260927 13:50:07.314184 7098 rpcz_store.cc:276] 0927 13:50:05.081893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.081961 (+ 68us) service_pool.cc:224] Handling call
0927 13:50:07.205951 (+2123990us) ts_tablet_manager.cc:1151] Deleting tablet f46f45a0a13b4e05802a08880d7f6a01
0927 13:50:07.205960 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.223133 (+ 17173us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.245257 (+ 22124us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.314036 (+ 68779us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2121682}
I20260927 13:50:07.314774 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]). Expected version 1 got 0
I20260927 13:50:07.314802 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f6a9c5e4be480796f433a68945dd72" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:07.315392 5044 leader_election.cc:343] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.315588 7203 raft_consensus.cc:493] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.315115 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 2cc7301d09b245328a851a0734669965 (table default.Table_7a5a607e5463433eb93aedb9f76696db [id=1f268483d3c7447abfe7a024dd0aec58]). Expected version 1 got 0
I20260927 13:50:07.315624 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f46f45a0a13b4e05802a08880d7f6a01 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]) successfully deleted
I20260927 13:50:07.315804 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:07.315753 7203 raft_consensus.cc:515] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.316066 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:07.316443 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:50:07.316673 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]). Expected version 1 got 0
I20260927 13:50:07.316900 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]). Expected version 1 got 0
I20260927 13:50:07.317271 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]). Expected version 2 got 0
I20260927 13:50:07.317745 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]). Expected version 1 got 0
I20260927 13:50:07.318092 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]). Expected version 1 got 0
I20260927 13:50:07.318142 6779 raft_consensus.cc:493] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.318267 6779 raft_consensus.cc:515] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.318382 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]). Expected version 1 got 0
I20260927 13:50:07.318584 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]). Expected version 1 got 0
I20260927 13:50:07.318835 6779 leader_election.cc:290] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:07.319125 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 9e808336f5b746d486d375695536c052 (table default.Table_36609f3408124349b504ae9eb3275d87 [id=d088563f44224b01a3eba63ce70e5681]). Expected version 1 got 0
I20260927 13:50:07.319192 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d29459405b4cdd921fb43bf5a2ae81" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:07.319638 5044 leader_election.cc:343] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.319983 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]). Expected version 1 got 0
I20260927 13:50:07.320215 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]). Expected version 2 got 0
I20260927 13:50:07.320637 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
I20260927 13:50:07.321025 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 5678703b72c8471583147786f49122a5 (table default.Table_f3c5680fa304438d9df88d573453cd6f [id=0d85f9f0d28e43debda43f83a3e59637]). Expected version 2 got 0
I20260927 13:50:07.321553 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:07.321825 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:07.322041 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:07.322335 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
I20260927 13:50:07.322805 6451 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:07.325089 7203 leader_election.cc:290] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:07.326354 5184 leader_election.cc:343] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 1087ad60dade46bb9d38f52a94dd536b
I20260927 13:50:07.330862 5626 tablet_bootstrap.cc:492] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:07.331053 5626 ts_tablet_manager.cc:1403] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.119s user 0.011s sys 0.006s
I20260927 13:50:07.331825 5626 raft_consensus.cc:359] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.331946 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 96) took 2251 ms. Trace:
I20260927 13:50:07.332039 7098 rpcz_store.cc:276] 0927 13:50:05.080705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.085849 (+ 5144us) service_pool.cc:224] Handling call
0927 13:50:07.314525 (+2228676us) ts_tablet_manager.cc:1151] Deleting tablet 1b4494b7e895454f81fef308950729ef
0927 13:50:07.331770 (+ 17245us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.331923 (+ 153us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2228458}
I20260927 13:50:07.332446 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 99) took 2244 ms. Trace:
I20260927 13:50:07.332512 7098 rpcz_store.cc:276] 0927 13:50:05.088132 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.088197 (+ 65us) service_pool.cc:224] Handling call
0927 13:50:07.332310 (+2244113us) ts_tablet_manager.cc:1151] Deleting tablet 58d9274ad0934f19a7c36325eee3dd59
0927 13:50:07.332321 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.332431 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2243941}
I20260927 13:50:07.332767 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 98) took 2245 ms. Trace:
I20260927 13:50:07.332823 7098 rpcz_store.cc:276] 0927 13:50:05.087645 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.091117 (+ 3472us) service_pool.cc:224] Handling call
0927 13:50:07.332695 (+2241578us) ts_tablet_manager.cc:1151] Deleting tablet a6596ed8c4d44ad58a7ec495a665d1e9
0927 13:50:07.332703 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.332755 (+ 52us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2241358}
I20260927 13:50:07.333096 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 118) took 1920 ms. Trace:
I20260927 13:50:07.333149 7098 rpcz_store.cc:276] 0927 13:50:05.412857 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.423039 (+ 10182us) service_pool.cc:224] Handling call
0927 13:50:07.333018 (+1909979us) ts_tablet_manager.cc:1151] Deleting tablet 362f660cac76436aba54bb707d8a991c
0927 13:50:07.333025 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.333084 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1909628}
I20260927 13:50:07.333400 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 129) took 1655 ms. Trace:
I20260927 13:50:07.333457 7098 rpcz_store.cc:276] 0927 13:50:05.677648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.677863 (+ 215us) service_pool.cc:224] Handling call
0927 13:50:07.333324 (+1655461us) ts_tablet_manager.cc:1151] Deleting tablet 269cda0876e346149512e0b4985c6890
0927 13:50:07.333331 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.333389 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1654950}
I20260927 13:50:07.333757 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 130) took 1641 ms. Trace:
I20260927 13:50:07.333817 7098 rpcz_store.cc:276] 0927 13:50:05.692629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.698446 (+ 5817us) service_pool.cc:224] Handling call
0927 13:50:07.333676 (+1635230us) ts_tablet_manager.cc:1151] Deleting tablet 9fdef4f56d9647118afe83ac3cd364fd
0927 13:50:07.333683 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.333746 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1620357}
I20260927 13:50:07.334041 7098 tablet_replica.cc:333] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.334236 7098 raft_consensus.cc:2243] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.334374 7098 raft_consensus.cc:2272] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.334735 5626 raft_consensus.cc:385] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.334801 5626 raft_consensus.cc:740] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.334947 7098 ts_tablet_manager.cc:1916] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.335041 5626 consensus_queue.cc:260] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.335656 5626 ts_tablet_manager.cc:1434] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260927 13:50:07.336280 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 1b4494b7e895454f81fef308950729ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b4494b7e895454f81fef308950729ef already in progress: creating tablet
I20260927 13:50:07.336553 5626 tablet_bootstrap.cc:492] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:07.336586 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 58d9274ad0934f19a7c36325eee3dd59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58d9274ad0934f19a7c36325eee3dd59 already in progress: creating tablet
W20260927 13:50:07.336790 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a6596ed8c4d44ad58a7ec495a665d1e9 because the tablet was not found. No further retry: Not found: Tablet not found: a6596ed8c4d44ad58a7ec495a665d1e9
W20260927 13:50:07.337004 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 362f660cac76436aba54bb707d8a991c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 362f660cac76436aba54bb707d8a991c already in progress: creating tablet
W20260927 13:50:07.337191 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 269cda0876e346149512e0b4985c6890 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 269cda0876e346149512e0b4985c6890 already in progress: creating tablet
W20260927 13:50:07.337440 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 9fdef4f56d9647118afe83ac3cd364fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fdef4f56d9647118afe83ac3cd364fd already in progress: creating tablet
I20260927 13:50:07.338346 5626 tablet_bootstrap.cc:654] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:07.342412 5319 leader_election.cc:343] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:07.342640 5319 leader_election.cc:343] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:07.342779 5319 leader_election.cc:343] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.344744 7361 raft_consensus.cc:493] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:50:07.350680 6991 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 13:50:07.353223 6991 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 13:50:07.354066 6991 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260927 13:50:07.357775 7098 ts_tablet_manager.cc:1929] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:07.358747 7098 log.cc:1199] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/467aa7fb4edf4b1b8dad6514d1d017b1
I20260927 13:50:07.360792 7098 ts_tablet_manager.cc:1950] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.361267 5628 raft_consensus.cc:359] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.362231 5628 raft_consensus.cc:385] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.362648 5628 raft_consensus.cc:740] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.363770 5628 consensus_queue.cc:260] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.365607 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 131) took 1208 ms. Trace:
I20260927 13:50:07.366814 7098 rpcz_store.cc:276] 0927 13:50:06.157239 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.157320 (+ 81us) service_pool.cc:224] Handling call
0927 13:50:07.334004 (+1176684us) ts_tablet_manager.cc:1151] Deleting tablet 467aa7fb4edf4b1b8dad6514d1d017b1
0927 13:50:07.334012 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.344464 (+ 10452us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.357557 (+ 13093us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.365408 (+ 7851us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1163682}
I20260927 13:50:07.369313 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 467aa7fb4edf4b1b8dad6514d1d017b1 (table default.Table_94ba7a27252044beb2d23563d4092a8f [id=4de8c6767c5640f2ab7b54f6e8884709]) successfully deleted
I20260927 13:50:07.369793 5628 ts_tablet_manager.cc:1434] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260927 13:50:07.370440 7098 tablet_replica.cc:333] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.371961 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]). Expected version 2 got 0
I20260927 13:50:07.345185 7361 raft_consensus.cc:515] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.372464 6779 raft_consensus.cc:493] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.372447 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_cfdab7814ecc495089389612e0a7e4fe [id=ae170bbebc4e460fb58beb7f95f013a2]). Expected version 2 got 0
I20260927 13:50:07.372577 6779 raft_consensus.cc:515] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.372711 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:50:07.373112 6779 leader_election.cc:290] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:07.373380 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]). Expected version 1 got 0
I20260927 13:50:07.373675 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]). Expected version 1 got 0
I20260927 13:50:07.373692 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860598d598dd4373b44075a932c7df52" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:07.372386 5626 tablet_bootstrap.cc:492] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:07.374168 5626 ts_tablet_manager.cc:1403] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.002s
W20260927 13:50:07.374223 5044 leader_election.cc:343] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.373971 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]). Expected version 1 got 0
W20260927 13:50:07.374380 5319 leader_election.cc:343] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:07.374584 5319 leader_election.cc:343] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.374607 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_954f47d3ef8846b8ade030d87002460e [id=750521adcb384c75841d7e1ff89af83d]). Expected version 2 got 0
W20260927 13:50:07.375016 5045 leader_election.cc:343] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.374987 6779 consensus_queue.cc:1048] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:07.375121 5045 leader_election.cc:304] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:07.375313 5045 raft_consensus.cc:2686] T 8aeb0c2c2be04a598e011a9d99c5492a P 34fc5fe0a32d42ab83f4aa6d07341409: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:50:07.376380 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]). Expected version 2 got 0
I20260927 13:50:07.376537 5626 raft_consensus.cc:359] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.376940 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]). Expected version 5 got 0
I20260927 13:50:07.376757 5626 raft_consensus.cc:385] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.377249 5626 raft_consensus.cc:740] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.377234 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]). Expected version 3 got 0
I20260927 13:50:07.377585 5626 consensus_queue.cc:260] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.378187 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]). Expected version 1 got 0
I20260927 13:50:07.378466 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 90fb369fec2d43149080ab2ad94ecc57 (table default.Table_7b19583e86df4689a2e40ce5a9148e19 [id=23ffbb0d3240465cb12a09ffec1f8163]). Expected version 1 got 0
I20260927 13:50:07.378687 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_6ac0611179c743808ff8a129f463dd61 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 3 got 0
I20260927 13:50:07.378788 5626 ts_tablet_manager.cc:1434] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:50:07.379091 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:50:07.379848 5626 tablet_bootstrap.cc:492] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:07.380143 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
I20260927 13:50:07.380270 5628 tablet_bootstrap.cc:492] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:07.380362 7098 raft_consensus.cc:2243] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.382002 7098 raft_consensus.cc:2272] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.381016 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]). Expected version 1 got 0
I20260927 13:50:07.383651 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b4f8a3b92e44cba7ea9e2b48aa70bb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.383854 5379 raft_consensus.cc:2468] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:07.384330 5185 leader_election.cc:304] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:07.384368 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
I20260927 13:50:07.384675 7265 raft_consensus.cc:2804] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:07.384677 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 66b0c74e3ff84cc2889de29106c43350 (table default.Table_204222be214241ed9c6f216ad0d30cc9 [id=e7b9e90f5d6b46af9c5334bcd7e5a5dc]). Expected version 1 got 0
I20260927 13:50:07.384761 7265 raft_consensus.cc:493] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:07.384833 7265 raft_consensus.cc:3060] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.385088 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
I20260927 13:50:07.384755 7361 leader_election.cc:290] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.385670 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]). Expected version 1 got 0
I20260927 13:50:07.386196 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]). Expected version 1 got 0
I20260927 13:50:07.386528 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet e3765fe06c664e60a11acf76c825bc42 (table default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee]). Expected version 1 got 0
I20260927 13:50:07.386173 7361 raft_consensus.cc:493] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.387032 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:50:07.387322 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
I20260927 13:50:07.387600 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:07.387502 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008516a474cc40f2b9de77b2f3e762cf" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:07.387676 7265 raft_consensus.cc:515] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.388098 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:07.388197 7265 leader_election.cc:290] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.388258 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 2cc7301d09b245328a851a0734669965 (table default.Table_7a5a607e5463433eb93aedb9f76696db [id=1f268483d3c7447abfe7a024dd0aec58]). Expected version 1 got 0
I20260927 13:50:07.388456 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]). Expected version 2 got 0
I20260927 13:50:07.388622 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b4f8a3b92e44cba7ea9e2b48aa70bb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:07.388789 5379 raft_consensus.cc:3060] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.388746 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 0fe47041b75d492bbce62c95d90de021 (table default.Table_eabbc608c09045b095cdfe05e9660ac7 [id=a6d3f0f894904a738cc54fe5d8631f06]). Expected version 1 got 0
I20260927 13:50:07.389037 5102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b4f8a3b92e44cba7ea9e2b48aa70bb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:07.389153 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b4f8a3b92e44cba7ea9e2b48aa70bb" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.389199 5102 raft_consensus.cc:3060] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.389194 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]). Expected version 1 got 0
I20260927 13:50:07.389776 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 85debab98b0f42a5b50f1b0d132147d3 (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]). Expected version 1 got 0
I20260927 13:50:07.390021 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet ead437e93bb14a73a820631b0be041aa (table default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]). Expected version 1 got 0
I20260927 13:50:07.391595 5379 raft_consensus.cc:2468] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:07.391884 5102 raft_consensus.cc:2468] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:07.392326 5184 leader_election.cc:304] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:07.392246 7098 ts_tablet_manager.cc:1916] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.387156 7361 raft_consensus.cc:515] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.392611 7203 raft_consensus.cc:2804] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.392876 7203 raft_consensus.cc:697] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:07.393136 7203 consensus_queue.cc:237] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.394487 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]). Expected version 2 got 0
I20260927 13:50:07.394779 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]). Expected version 1 got 0
I20260927 13:50:07.395061 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_b68a6b76e8684ab9ab1e52fbfaad3740 [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 2 got 0
I20260927 13:50:07.395295 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 3b26289ed050454d817c13159295ec37 (table default.Table_5b64a307e44a471598ef010e33a82fe3 [id=9c86bcdd37654832b7a92763aa42e6c4]). Expected version 1 got 0
I20260927 13:50:07.395918 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 78719428d7b34f28a99722b093f6ab54 (table default.Table_6d795d7a66ee42f3a7fb0cef447cddba [id=ed8d36823c5c43eaa1e8b0447c7f32e9]). Expected version 1 got 0
I20260927 13:50:07.396243 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet c655651f9cb24310a5aa2e5b84c2a455 (table default.Table_5c96e3711de04429a590499eb47d5784 [id=db63359dda9d4b729446d6ddf78c30b8]). Expected version 1 got 0
I20260927 13:50:07.397009 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e6bf85bf1434ab6ce42e751d31c6f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.397060 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6 (table default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]). Expected version 1 got 0
I20260927 13:50:07.397202 5379 raft_consensus.cc:2468] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:07.397632 5185 leader_election.cc:304] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:07.397971 7265 raft_consensus.cc:2804] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:07.398496 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc (table default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]). Expected version 1 got 0
I20260927 13:50:07.398607 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e6bf85bf1434ab6ce42e751d31c6f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.398504 7265 raft_consensus.cc:493] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:07.398799 7265 raft_consensus.cc:3060] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.398823 5107 raft_consensus.cc:2393] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:50:07.398228 7361 leader_election.cc:290] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.398914 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a4099c41981f46758a8f478d7fdb4182 (table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]). Expected version 1 got 0
I20260927 13:50:07.399354 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:07.399689 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 07830b76d7e14ff0b6b1b1523dda21bc (table default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]). Expected version 2 got 0
I20260927 13:50:07.399943 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]). Expected version 1 got 0
I20260927 13:50:07.400175 5628 tablet_bootstrap.cc:654] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.400279 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]). Expected version 1 got 0
I20260927 13:50:07.404142 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008516a474cc40f2b9de77b2f3e762cf" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:07.405136 5107 raft_consensus.cc:3060] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.406997 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]). Expected version 2 got 0
I20260927 13:50:07.400486 5626 tablet_bootstrap.cc:654] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.402318 7265 raft_consensus.cc:515] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.408142 7265 leader_election.cc:290] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.408202 5102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e6bf85bf1434ab6ce42e751d31c6f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:07.408414 5102 raft_consensus.cc:2393] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:50:07.408710 5107 raft_consensus.cc:2468] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:07.409474 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]). Expected version 1 got 0
I20260927 13:50:07.409569 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e6bf85bf1434ab6ce42e751d31c6f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:07.409799 5379 raft_consensus.cc:3060] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.413043 5379 raft_consensus.cc:2468] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:07.413497 5185 leader_election.cc:304] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:07.413763 7265 raft_consensus.cc:2804] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.413890 7265 raft_consensus.cc:697] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:07.414170 7265 consensus_queue.cc:237] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.415428 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]). Expected version 1 got 0
I20260927 13:50:07.415688 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]). Expected version 1 got 0
I20260927 13:50:07.415936 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]). Expected version 1 got 0
I20260927 13:50:07.416095 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]). Expected version 1 got 0
I20260927 13:50:07.416436 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 9e808336f5b746d486d375695536c052 (table default.Table_36609f3408124349b504ae9eb3275d87 [id=d088563f44224b01a3eba63ce70e5681]). Expected version 1 got 0
I20260927 13:50:07.417018 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]). Expected version 1 got 0
I20260927 13:50:07.417057 7361 raft_consensus.cc:493] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.417261 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]). Expected version 2 got 0
I20260927 13:50:07.417291 7361 raft_consensus.cc:515] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.417421 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
I20260927 13:50:07.417659 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 5678703b72c8471583147786f49122a5 (table default.Table_f3c5680fa304438d9df88d573453cd6f [id=0d85f9f0d28e43debda43f83a3e59637]). Expected version 2 got 0
I20260927 13:50:07.418104 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:07.418334 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:07.418493 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:07.418550 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.418730 6449 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:07.418797 5379 raft_consensus.cc:2393] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:07.419056 7361 leader_election.cc:290] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.419450 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.419692 5107 raft_consensus.cc:2393] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:50:07.420136 5184 leader_election.cc:304] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.420565 7361 raft_consensus.cc:3060] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.425267 7098 ts_tablet_manager.cc:1929] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.427400 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:07.429389 7098 log.cc:1199] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/50fb1288684c45f6a778d809a5e2c160
I20260927 13:50:07.430287 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f702b0a6380543a8ac539125d4334cd5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:07.430056 5102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:07.431308 5102 raft_consensus.cc:2393] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
W20260927 13:50:07.431272 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 0191cfad4e7a4b088b2ecdc246bfa58a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0191cfad4e7a4b088b2ecdc246bfa58a already in progress: creating tablet
W20260927 13:50:07.431609 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet bf557ac29964453583f224b46178c7dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf557ac29964453583f224b46178c7dd already in progress: creating tablet
I20260927 13:50:07.431645 5098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f702b0a6380543a8ac539125d4334cd5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.431824 5098 raft_consensus.cc:2393] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 79c1646c9659434b9a659382d2eb1d8a in this term.
I20260927 13:50:07.433058 7098 ts_tablet_manager.cc:1950] T 50fb1288684c45f6a778d809a5e2c160 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.437358 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 132) took 1279 ms. Trace:
I20260927 13:50:07.443310 7361 raft_consensus.cc:2749] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.444744 7098 rpcz_store.cc:276] 0927 13:50:06.157892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.157949 (+ 57us) service_pool.cc:224] Handling call
0927 13:50:07.370219 (+1212270us) ts_tablet_manager.cc:1151] Deleting tablet 50fb1288684c45f6a778d809a5e2c160
0927 13:50:07.370232 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.413031 (+ 42799us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.425196 (+ 12165us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.437333 (+ 12137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1199574}
I20260927 13:50:07.446521 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 50fb1288684c45f6a778d809a5e2c160 (table default.Table_d7e2b621de8d45e69f6e88b3e51354d5 [id=d472fc89c3d9450c85f175d6443a76f0]) successfully deleted
I20260927 13:50:07.447193 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 133) took 1288 ms. Trace:
W20260927 13:50:07.448407 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 334b0349bfaa4a9c8b7d280177f1ecae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 334b0349bfaa4a9c8b7d280177f1ecae already in progress: creating tablet
W20260927 13:50:07.448698 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 417b99e95ab4422d96b606fc76698324 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 417b99e95ab4422d96b606fc76698324 already in progress: creating tablet
W20260927 13:50:07.448931 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet e25f5898369f46fba32b7df27b334b28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e25f5898369f46fba32b7df27b334b28 already in progress: creating tablet
I20260927 13:50:07.448943 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9503dd46ccf472581d1a667eea300ed" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:07.449995 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 2b082227264e442a8b1db7a68fb0c3eb (table default.Table_967519598f9b4c999e93c6f358381116 [id=701057885bc4473193538947593d74e3]) successfully deleted
W20260927 13:50:07.450344 6427 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 27131f0e8c9e4f1ea290989155ddcd0b consensus state has no leader
I20260927 13:50:07.451598 5244 raft_consensus.cc:2468] T 0dc69551c99942b09862904266572471 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:07.458779 5247 raft_consensus.cc:3060] T e5b04acc39f3436384fbb69cebdc35cd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.459540 5244 raft_consensus.cc:3060] T b044fbc166e848f39d17b63db69f63a4 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.472211 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 5e3fa4870d5547a2bbffe1745b964504 (table default.Table_009df0f55a87479eab602a85d1503bf9 [id=1ea34fa23bae4ba88424a02d4e54a803]) successfully deleted
I20260927 13:50:07.473712 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b4f8a3b92e44cba7ea9e2b48aa70bb" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:07.475471 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 008516a474cc40f2b9de77b2f3e762cf (table default.Table_c700b32dc7b84e708c594f19077a40d1 [id=de5e7f4beb904151afa92b9e3f1151b2]) successfully deleted
I20260927 13:50:07.477352 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:07.478865 5249 raft_consensus.cc:3060] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.479696 5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b0349bfaa4a9c8b7d280177f1ecae" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:07.486562 7370 raft_consensus.cc:493] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.486784 7370 raft_consensus.cc:515] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.488271 7370 leader_election.cc:290] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.489135 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c69163fb77442be9215f8f285b904ef" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.489440 5379 raft_consensus.cc:2393] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:07.491000 7190 ts_tablet_manager.cc:1929] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.491164 7190 log.cc:1199] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f75847513dcf4c84913a4073176f2507
I20260927 13:50:07.491647 7190 ts_tablet_manager.cc:1950] T f75847513dcf4c84913a4073176f2507 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.493407 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 97) took 2500 ms. Trace:
I20260927 13:50:07.493638 7190 rpcz_store.cc:276] 0927 13:50:04.992896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.995310 (+ 2414us) service_pool.cc:224] Handling call
0927 13:50:07.207518 (+2212208us) ts_tablet_manager.cc:1151] Deleting tablet f75847513dcf4c84913a4073176f2507
0927 13:50:07.207528 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.393489 (+185961us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.462339 (+ 68850us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.493383 (+ 31044us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2211719}
I20260927 13:50:07.494467 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f75847513dcf4c84913a4073176f2507 (table default.Table_f0ac9487c6b5426eaebbdbb92e46c3ea [id=505fcecda93b407f9f10ee4dbc60a3f3]) successfully deleted
I20260927 13:50:07.450994 5098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9503dd46ccf472581d1a667eea300ed" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:07.478583 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.494858 5098 raft_consensus.cc:3060] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.494867 5108 raft_consensus.cc:2468] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:07.496914 7190 tablet_replica.cc:333] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.497098 7190 raft_consensus.cc:2243] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.497248 7190 raft_consensus.cc:2272] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.497682 5098 raft_consensus.cc:2468] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:07.497782 7190 ts_tablet_manager.cc:1916] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.479784 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b4f8a3b92e44cba7ea9e2b48aa70bb" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.498142 7098 rpcz_store.cc:276] 0927 13:50:06.158714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.159000 (+ 286us) service_pool.cc:224] Handling call
0927 13:50:07.447094 (+1288094us) ts_tablet_manager.cc:1151] Deleting tablet bb7b3a35b2e94bbea6be4b4a8f158593
0927 13:50:07.447105 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.447176 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1276638}
I20260927 13:50:07.498446 5107 raft_consensus.cc:2393] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 79c1646c9659434b9a659382d2eb1d8a in this term.
W20260927 13:50:07.498915 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet bb7b3a35b2e94bbea6be4b4a8f158593 because the tablet was not found. No further retry: Not found: Tablet not found: bb7b3a35b2e94bbea6be4b4a8f158593
I20260927 13:50:07.499295 7098 tablet_replica.cc:333] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.499527 7098 raft_consensus.cc:2243] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.488099 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c69163fb77442be9215f8f285b904ef" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.485936 5628 tablet_bootstrap.cc:492] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:07.500010 5100 raft_consensus.cc:2393] T 5c69163fb77442be9215f8f285b904ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:07.500032 5628 ts_tablet_manager.cc:1403] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.128s user 0.005s sys 0.004s
I20260927 13:50:07.500483 5184 leader_election.cc:304] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.501534 7361 raft_consensus.cc:3060] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.504905 7361 raft_consensus.cc:2749] T 5c69163fb77442be9215f8f285b904ef P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.509388 5628 raft_consensus.cc:359] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.510365 5628 raft_consensus.cc:385] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.510526 5628 raft_consensus.cc:740] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.513337 7190 ts_tablet_manager.cc:1929] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.510969 5628 consensus_queue.cc:260] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.517668 5628 ts_tablet_manager.cc:1434] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260927 13:50:07.520628 5628 tablet_bootstrap.cc:492] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:07.521636 7190 log.cc:1199] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/413d863d9a564e5d8325b4479346730d
I20260927 13:50:07.522559 7190 ts_tablet_manager.cc:1950] T 413d863d9a564e5d8325b4479346730d P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.524211 5628 tablet_bootstrap.cc:654] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.525640 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 98) took 2532 ms. Trace:
I20260927 13:50:07.527626 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbdc347bc9845b2b577f551577d070b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.528139 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1087ad60dade46bb9d38f52a94dd536b" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.530443 7190 rpcz_store.cc:276] 0927 13:50:04.992955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.995813 (+ 2858us) service_pool.cc:224] Handling call
0927 13:50:07.494532 (+2498719us) ts_tablet_manager.cc:1151] Deleting tablet 413d863d9a564e5d8325b4479346730d
0927 13:50:07.496869 (+ 2337us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.508292 (+ 11423us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.513276 (+ 4984us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.525620 (+ 12344us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2498556}
I20260927 13:50:07.531388 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 413d863d9a564e5d8325b4479346730d (table default.Table_fbec3d960eb2415280ee9b1e7171392a [id=f03beab934924c65bd71d31d91c0f5cd]) successfully deleted
I20260927 13:50:07.531421 7111 ts_tablet_manager.cc:1929] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:07.531502 7190 tablet_replica.cc:333] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.531520 7111 log.cc:1199] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/1087ad60dade46bb9d38f52a94dd536b
I20260927 13:50:07.531695 7190 raft_consensus.cc:2243] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.531810 7111 ts_tablet_manager.cc:1950] T 1087ad60dade46bb9d38f52a94dd536b P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:07.531976 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acd411b965c49919dc77c8c94853548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.532140 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 136) took 1063 ms. Trace:
I20260927 13:50:07.532203 7111 rpcz_store.cc:276] 0927 13:50:06.468358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.468405 (+ 47us) service_pool.cc:224] Handling call
0927 13:50:06.862442 (+394037us) ts_tablet_manager.cc:1151] Deleting tablet 1087ad60dade46bb9d38f52a94dd536b
0927 13:50:06.862449 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.030655 (+168206us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.531353 (+500698us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.532125 (+ 772us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":382540}
I20260927 13:50:07.532528 7111 tablet_replica.cc:333] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:07.532536 7190 raft_consensus.cc:2272] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.532701 7111 raft_consensus.cc:2243] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.532852 7111 pending_rounds.cc:70] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:50:07.532902 7111 pending_rounds.cc:77] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957657760657408 op_type: NO_OP noop_request { }
I20260927 13:50:07.532977 7111 raft_consensus.cc:2889] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:07.533046 7111 raft_consensus.cc:2272] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.533216 7190 ts_tablet_manager.cc:1916] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.533514 7111 ts_tablet_manager.cc:1916] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.535806 5619 tablet_bootstrap.cc:654] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:07.536610 5185 leader_election.cc:343] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: Tablet not RUNNING: STOPPED
I20260927 13:50:07.536787 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de625874fd934922b59ffc20f7951cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.536943 5185 leader_election.cc:304] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.537307 7203 raft_consensus.cc:2749] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.542248 5346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5b20ac98f5429ab5e34632102d3ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.542647 7305 raft_consensus.cc:493] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.542760 7305 raft_consensus.cc:515] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.543303 7305 leader_election.cc:290] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.544880 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d572343009042d294a9c98648a14127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.545679 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3f7ded9d644d749532e0700844bd62" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.546269 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25f5898369f46fba32b7df27b334b28" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.546408 5381 raft_consensus.cc:2468] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:07.546877 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82284e3fd1f4a2f95c7e47320abb30c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.547371 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d897f986d26a44f4894e147a74a90949" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.547910 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf557ac29964453583f224b46178c7dd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.548055 5381 raft_consensus.cc:2468] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:07.548566 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e6bf85bf1434ab6ce42e751d31c6f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:07.548723 5381 raft_consensus.cc:2393] T 449e6bf85bf1434ab6ce42e751d31c6f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34fc5fe0a32d42ab83f4aa6d07341409 in current term 1: Already voted for candidate 79c1646c9659434b9a659382d2eb1d8a in this term.
I20260927 13:50:07.549013 7305 raft_consensus.cc:493] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.549106 7305 raft_consensus.cc:515] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.549595 7305 leader_election.cc:290] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.550268 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5623eafeb090484e9579fc979f0f52a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.554625 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06113a678914edabb239789c7262f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.557262 7190 ts_tablet_manager.cc:1929] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.557392 7190 log.cc:1199] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f5b2b6f2ce1145a18c199bb37cc7e5b2
I20260927 13:50:07.557796 7190 ts_tablet_manager.cc:1950] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.558907 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b851334fd8144ec3a38ed7e37ec53997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.525530 6779 raft_consensus.cc:493] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.568634 6779 raft_consensus.cc:515] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:07.569294 6779 leader_election.cc:290] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:07.569424 6779 raft_consensus.cc:493] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.569515 6779 raft_consensus.cc:515] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.569774 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 99) took 2576 ms. Trace:
I20260927 13:50:07.569859 7190 rpcz_store.cc:276] 0927 13:50:04.993018 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.995951 (+ 2933us) service_pool.cc:224] Handling call
0927 13:50:07.531449 (+2535498us) ts_tablet_manager.cc:1151] Deleting tablet f5b2b6f2ce1145a18c199bb37cc7e5b2
0927 13:50:07.531460 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.544172 (+ 12712us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.557196 (+ 13024us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.569747 (+ 12551us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11043,"tablet-delete.queue_time_us":2535367}
I20260927 13:50:07.570037 6779 leader_election.cc:290] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:07.570447 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 (table default.Table_88984f1568c54b4398964528d6e45861 [id=661c2995cafa41669d92b0b4549f0cce]) successfully deleted
I20260927 13:50:07.570780 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdacca4b5bd4afb95c83f6c72091b2f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:07.571101 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f5479761f94ee0b339e125d06a808c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:07.571235 5044 leader_election.cc:343] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.534345 7098 raft_consensus.cc:2272] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.571305 7190 tablet_replica.cc:333] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
W20260927 13:50:07.571619 5044 leader_election.cc:343] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.571645 7190 raft_consensus.cc:2243] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.572029 7190 raft_consensus.cc:2272] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.572078 7098 ts_tablet_manager.cc:1916] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.572664 7190 ts_tablet_manager.cc:1916] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.534061 5102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b0349bfaa4a9c8b7d280177f1ecae" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.574272 5102 raft_consensus.cc:2393] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 79c1646c9659434b9a659382d2eb1d8a in this term.
I20260927 13:50:07.576745 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc69551c99942b09862904266572471" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:07.577055 5381 raft_consensus.cc:2393] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34fc5fe0a32d42ab83f4aa6d07341409 in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
W20260927 13:50:07.507263 6991 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 13:50:07.579329 6991 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260927 13:50:07.579485 6991 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 13:50:07.579604 6991 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260927 13:50:07.580783 7190 ts_tablet_manager.cc:1929] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.580936 7190 log.cc:1199] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/64c7919f5076406186000cd4077aadaf
I20260927 13:50:07.581446 7190 ts_tablet_manager.cc:1950] T 64c7919f5076406186000cd4077aadaf P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.581562 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bba86a18504fc1ae2a3aef7f7c5a39" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.582054 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.582228 5381 raft_consensus.cc:2468] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:07.582475 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 100) took 2589 ms. Trace:
I20260927 13:50:07.582589 7190 rpcz_store.cc:276] 0927 13:50:04.993073 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.996089 (+ 3016us) service_pool.cc:224] Handling call
0927 13:50:07.571256 (+2575167us) ts_tablet_manager.cc:1151] Deleting tablet 64c7919f5076406186000cd4077aadaf
0927 13:50:07.571266 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.577140 (+ 5874us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.580734 (+ 3594us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.582453 (+ 1719us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2574980}
I20260927 13:50:07.582782 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a98e712fb3492f9e4ebccfd489c16f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.583141 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 64c7919f5076406186000cd4077aadaf (table default.Table_a84034c9d8ab4ec5ada3c6fbb73934e1 [id=5dfc4daab06e4be5846fc9be88d222f4]) successfully deleted
I20260927 13:50:07.583573 7190 tablet_replica.cc:333] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.583607 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352e564866a747798ad44218133844ba" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.583884 7190 raft_consensus.cc:2243] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.584048 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880ce1300eac40b28aac8cba3e11077e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.584318 7190 raft_consensus.cc:2272] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.584882 7190 ts_tablet_manager.cc:1916] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.585065 5619 tablet_bootstrap.cc:492] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:07.585192 5619 ts_tablet_manager.cc:1403] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.479s user 0.008s sys 0.011s
I20260927 13:50:07.585879 5619 raft_consensus.cc:359] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.586025 5619 raft_consensus.cc:385] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.587982 7098 ts_tablet_manager.cc:1929] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:07.588094 7098 log.cc:1199] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/008516a474cc40f2b9de77b2f3e762cf
I20260927 13:50:07.588387 7098 ts_tablet_manager.cc:1950] T 008516a474cc40f2b9de77b2f3e762cf P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.589155 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 134) took 1429 ms. Trace:
I20260927 13:50:07.589244 7098 rpcz_store.cc:276] 0927 13:50:06.159247 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.159299 (+ 52us) service_pool.cc:224] Handling call
0927 13:50:07.499247 (+1339948us) ts_tablet_manager.cc:1151] Deleting tablet 008516a474cc40f2b9de77b2f3e762cf
0927 13:50:07.499259 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.583765 (+ 84506us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.587931 (+ 4166us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.589134 (+ 1203us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1328743}
I20260927 13:50:07.589761 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 008516a474cc40f2b9de77b2f3e762cf (table default.Table_c700b32dc7b84e708c594f19077a40d1 [id=de5e7f4beb904151afa92b9e3f1151b2]) successfully deleted
I20260927 13:50:07.592108 7190 ts_tablet_manager.cc:1929] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.592298 7190 log.cc:1199] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/5e3fa4870d5547a2bbffe1745b964504
I20260927 13:50:07.592729 7190 ts_tablet_manager.cc:1950] T 5e3fa4870d5547a2bbffe1745b964504 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.593232 5628 tablet_bootstrap.cc:492] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:07.593375 5628 ts_tablet_manager.cc:1403] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.073s user 0.001s sys 0.003s
I20260927 13:50:07.593633 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 94) took 2600 ms. Trace:
I20260927 13:50:07.593695 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a397300cdd44eb899f2ef5b9fe8c09" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.593755 7190 rpcz_store.cc:276] 0927 13:50:04.992654 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.996389 (+ 3735us) service_pool.cc:224] Handling call
0927 13:50:07.583519 (+2587130us) ts_tablet_manager.cc:1151] Deleting tablet 5e3fa4870d5547a2bbffe1745b964504
0927 13:50:07.583531 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.588610 (+ 5079us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.592050 (+ 3440us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.593615 (+ 1565us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2586932}
I20260927 13:50:07.594434 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 5e3fa4870d5547a2bbffe1745b964504 (table default.Table_009df0f55a87479eab602a85d1503bf9 [id=1ea34fa23bae4ba88424a02d4e54a803]) successfully deleted
I20260927 13:50:07.594890 7190 tablet_replica.cc:333] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.595136 7190 raft_consensus.cc:2243] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.595335 7190 raft_consensus.cc:2272] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.595932 7190 ts_tablet_manager.cc:1916] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.595708 5626 tablet_bootstrap.cc:492] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:07.595988 5628 raft_consensus.cc:359] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.596191 5628 raft_consensus.cc:385] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.596283 5628 raft_consensus.cc:740] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.596534 5628 consensus_queue.cc:260] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.597142 5626 ts_tablet_manager.cc:1403] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.217s user 0.005s sys 0.005s
I20260927 13:50:07.594643 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1a58c67bf54493a3c62fb175acabb8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.598491 5628 ts_tablet_manager.cc:1434] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:50:07.599179 5628 tablet_bootstrap.cc:492] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:07.599185 5296 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:07.602327 7190 ts_tablet_manager.cc:1929] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:07.602530 7190 log.cc:1199] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/51e1acd618fc44be9169fa1d56fa510a
I20260927 13:50:07.602744 5628 tablet_bootstrap.cc:654] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.602957 7190 ts_tablet_manager.cc:1950] T 51e1acd618fc44be9169fa1d56fa510a P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.603310 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 102) took 2610 ms. Trace:
I20260927 13:50:07.603315 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e3bb24afad4d789041b6a557512618" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.603446 7190 rpcz_store.cc:276] 0927 13:50:04.993184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.996688 (+ 3504us) service_pool.cc:224] Handling call
0927 13:50:07.594842 (+2598154us) ts_tablet_manager.cc:1151] Deleting tablet 51e1acd618fc44be9169fa1d56fa510a
0927 13:50:07.594851 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.599444 (+ 4593us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.602282 (+ 2838us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.603293 (+ 1011us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2597982}
I20260927 13:50:07.604102 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 51e1acd618fc44be9169fa1d56fa510a (table default.Table_73693476f4564e2e8e0f60b0f7e3d474 [id=90f057f5064842a19916355825eb7129]) successfully deleted
I20260927 13:50:07.586072 5619 raft_consensus.cc:740] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.604614 5619 consensus_queue.cc:260] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.605137 7190 tablet_replica.cc:333] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.605468 7190 raft_consensus.cc:2243] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.605857 7190 raft_consensus.cc:2272] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.607040 7190 ts_tablet_manager.cc:1916] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.611837 5628 tablet_bootstrap.cc:492] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:07.612449 5628 ts_tablet_manager.cc:1403] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260927 13:50:07.613245 5628 raft_consensus.cc:359] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.613910 7190 ts_tablet_manager.cc:1929] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.614096 7190 log.cc:1199] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/0880140d99004eb1803d6b5dcf41af13
I20260927 13:50:07.614171 5628 raft_consensus.cc:385] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.614244 5628 raft_consensus.cc:740] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.614260 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f6a9c5e4be480796f433a68945dd72" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.614504 5381 raft_consensus.cc:2468] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:07.614456 5628 consensus_queue.cc:260] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.614627 7190 ts_tablet_manager.cc:1950] T 0880140d99004eb1803d6b5dcf41af13 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.614974 5628 ts_tablet_manager.cc:1434] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:07.614969 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 93) took 2622 ms. Trace:
I20260927 13:50:07.615110 7098 tablet_replica.cc:333] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.615273 7098 raft_consensus.cc:2243] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.615135 7190 rpcz_store.cc:276] 0927 13:50:04.992536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.994738 (+ 2202us) service_pool.cc:224] Handling call
0927 13:50:07.605088 (+2610350us) ts_tablet_manager.cc:1151] Deleting tablet 0880140d99004eb1803d6b5dcf41af13
0927 13:50:07.605099 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.610612 (+ 5513us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.613855 (+ 3243us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.614953 (+ 1098us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2584304}
I20260927 13:50:07.615404 7098 raft_consensus.cc:2272] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.615765 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d29459405b4cdd921fb43bf5a2ae81" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.615916 7098 ts_tablet_manager.cc:1916] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.615957 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 0880140d99004eb1803d6b5dcf41af13 (table default.Table_8c3b2a8ae18e4aa0a1e71601ac62ea43 [id=4a7f10ca480d42bca8cd7d0e7fe8bd00]) successfully deleted
I20260927 13:50:07.616199 5619 ts_tablet_manager.cc:1434] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.031s user 0.000s sys 0.002s
I20260927 13:50:07.615240 5626 raft_consensus.cc:359] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.616444 7190 tablet_replica.cc:333] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.616542 5626 raft_consensus.cc:385] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.618479 5626 raft_consensus.cc:740] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.618528 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860598d598dd4373b44075a932c7df52" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.616642 7190 raft_consensus.cc:2243] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.619005 7190 raft_consensus.cc:2272] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.619688 7190 ts_tablet_manager.cc:1916] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.620311 5626 consensus_queue.cc:260] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.620898 5628 tablet_bootstrap.cc:492] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:07.620891 5626 ts_tablet_manager.cc:1434] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260927 13:50:07.621135 5626 tablet_bootstrap.cc:492] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:07.622738 5626 tablet_bootstrap.cc:654] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.623906 5628 tablet_bootstrap.cc:654] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.624099 7385 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e421351a34d1463e9773dcebdeebae3c)
I20260927 13:50:07.624325 7385 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:50:07.628603 7098 ts_tablet_manager.cc:1929] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:07.628773 7098 log.cc:1199] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/8ca5b5f9ca1e44eb8cc8bb9e1ff11102
I20260927 13:50:07.629136 7098 ts_tablet_manager.cc:1950] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.629920 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 135) took 1469 ms. Trace:
I20260927 13:50:07.630298 7098 rpcz_store.cc:276] 0927 13:50:06.160562 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.160606 (+ 44us) service_pool.cc:224] Handling call
0927 13:50:07.610402 (+1449796us) ts_tablet_manager.cc:1151] Deleting tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102
0927 13:50:07.615059 (+ 4657us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.619282 (+ 4223us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.628550 (+ 9268us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.629900 (+ 1350us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1439457}
I20260927 13:50:07.631369 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 (table default.Table_7675c4eea2d04c06b01cf0466c4ed466 [id=c58f2a8e5acf483d89fb782663512587]) successfully deleted
I20260927 13:50:07.631870 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 136) took 1470 ms. Trace:
I20260927 13:50:07.632283 7098 rpcz_store.cc:276] 0927 13:50:06.161197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.161328 (+ 131us) service_pool.cc:224] Handling call
0927 13:50:07.631742 (+1470414us) ts_tablet_manager.cc:1151] Deleting tablet 5978cb78bd974d669817def05007d0ea
0927 13:50:07.631752 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.631853 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1460745}
W20260927 13:50:07.632995 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 5978cb78bd974d669817def05007d0ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5978cb78bd974d669817def05007d0ea already in progress: creating tablet
I20260927 13:50:07.633374 7098 tablet_replica.cc:333] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.633806 7098 raft_consensus.cc:2243] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.634266 7098 raft_consensus.cc:2272] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.634666 7387 raft_consensus.cc:493] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.634800 7387 raft_consensus.cc:515] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.635627 7098 ts_tablet_manager.cc:1916] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.635870 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee18063dc634385b9e61fae3b3ece99" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:07.636412 5044 leader_election.cc:343] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.638142 7387 leader_election.cc:290] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:07.639051 7385 leader_election.cc:290] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:50:07.639520 6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13a42ae8b95b495c9bcea85d6732cd77" candidate_term: 5 candidate_status { last_received { term: 4 index: 1085 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c" is_pre_election: true
I20260927 13:50:07.642155 5628 tablet_bootstrap.cc:492] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:07.642330 5628 ts_tablet_manager.cc:1403] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.000s
I20260927 13:50:07.642995 5628 raft_consensus.cc:359] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.643210 5628 raft_consensus.cc:385] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.643304 5628 raft_consensus.cc:740] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.643599 5628 consensus_queue.cc:260] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.644145 5628 ts_tablet_manager.cc:1434] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:07.644462 5628 tablet_bootstrap.cc:492] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:07.646337 5628 tablet_bootstrap.cc:654] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.649876 5319 leader_election.cc:304] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:07.650946 7305 raft_consensus.cc:2804] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.651072 7305 raft_consensus.cc:697] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:07.651340 7305 consensus_queue.cc:237] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.652981 7098 ts_tablet_manager.cc:1929] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:07.652590 6991 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.163.84:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.4.163.126:42985,127.4.163.125:42239,127.4.163.124:37095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.163.124:37095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.163.124
--webserver_port=36383
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 27 Sep 2026 13:43:25 UTC on bdcb31816ec0
build id 14025
ASAN enabled
I20260927 13:50:07.653666 7098 log.cc:1199] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/e25f5898369f46fba32b7df27b334b28
I20260927 13:50:07.654186 7098 ts_tablet_manager.cc:1950] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.655022 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 137) took 1493 ms. Trace:
I20260927 13:50:07.655633 7098 rpcz_store.cc:276] 0927 13:50:06.161606 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.161659 (+ 53us) service_pool.cc:224] Handling call
0927 13:50:07.633329 (+1471670us) ts_tablet_manager.cc:1151] Deleting tablet e25f5898369f46fba32b7df27b334b28
0927 13:50:07.633340 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.647978 (+ 14638us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.652928 (+ 4950us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.655001 (+ 2073us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1462030}
I20260927 13:50:07.656544 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet e25f5898369f46fba32b7df27b334b28 (table default.Table_13777f8bd8dc43b6b1da8868bbdc5e40 [id=248111d3c564489c80ec8b9d1629f49a]) successfully deleted
I20260927 13:50:07.657117 7098 tablet_replica.cc:333] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.657476 6991 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 13:50:07.657550 7098 raft_consensus.cc:2243] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.657987 7098 raft_consensus.cc:2272] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.658764 5619 tablet_bootstrap.cc:492] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:07.658766 7098 ts_tablet_manager.cc:1916] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.660200 5619 tablet_bootstrap.cc:654] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.661399 5628 tablet_bootstrap.cc:492] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:07.661576 5628 ts_tablet_manager.cc:1403] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260927 13:50:07.662211 6991 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260927 13:50:07.662309 5628 raft_consensus.cc:359] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.662578 5628 raft_consensus.cc:385] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.662640 5628 raft_consensus.cc:740] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.662858 5628 consensus_queue.cc:260] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.663353 5628 ts_tablet_manager.cc:1434] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:07.663636 5628 tablet_bootstrap.cc:492] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:07.664537 5319 leader_election.cc:304] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:07.664804 7231 raft_consensus.cc:2804] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.664939 7231 raft_consensus.cc:697] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:07.665208 7231 consensus_queue.cc:237] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.665802 5628 tablet_bootstrap.cc:654] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.671736 7098 ts_tablet_manager.cc:1929] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:07.673518 7098 log.cc:1199] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f3f6a9c5e4be480796f433a68945dd72
I20260927 13:50:07.674027 7098 ts_tablet_manager.cc:1950] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.674890 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 139) took 1487 ms. Trace:
I20260927 13:50:07.675549 7098 rpcz_store.cc:276] 0927 13:50:06.187880 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.187938 (+ 58us) service_pool.cc:224] Handling call
0927 13:50:07.657069 (+1469131us) ts_tablet_manager.cc:1151] Deleting tablet f3f6a9c5e4be480796f433a68945dd72
0927 13:50:07.657079 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.668632 (+ 11553us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.671683 (+ 3051us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.674857 (+ 3174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1468910}
I20260927 13:50:07.676555 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f3f6a9c5e4be480796f433a68945dd72 (table default.Table_3e73c785e0d244c3ae23fc951d45174c [id=4538e58c268d44b59999b80f295c321d]) successfully deleted
I20260927 13:50:07.677343 7098 tablet_replica.cc:333] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.677699 7098 raft_consensus.cc:2243] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.678207 7098 raft_consensus.cc:2272] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.679093 7098 ts_tablet_manager.cc:1916] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.680205 7111 ts_tablet_manager.cc:1929] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.680308 7111 log.cc:1199] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/8ca5b5f9ca1e44eb8cc8bb9e1ff11102
I20260927 13:50:07.680629 7111 ts_tablet_manager.cc:1950] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:07.680522 5628 tablet_bootstrap.cc:492] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:07.680861 5628 ts_tablet_manager.cc:1403] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260927 13:50:07.681799 5628 raft_consensus.cc:359] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:07.682090 5628 raft_consensus.cc:385] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.682271 5628 raft_consensus.cc:740] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.682567 5628 consensus_queue.cc:260] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:07.683180 5628 ts_tablet_manager.cc:1434] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:07.683769 5628 tablet_bootstrap.cc:492] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:07.692978 7098 ts_tablet_manager.cc:1929] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:07.693490 5628 tablet_bootstrap.cc:654] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:07.694234 5711 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
I20260927 13:50:07.695137 7190 ts_tablet_manager.cc:1929] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.695336 7190 log.cc:1199] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/3afb800e7ff44aadaed8f8d85aa9efe2
I20260927 13:50:07.695966 7190 ts_tablet_manager.cc:1950] T 3afb800e7ff44aadaed8f8d85aa9efe2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.696347 7098 log.cc:1199] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/bf557ac29964453583f224b46178c7dd
I20260927 13:50:07.696331 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 101) took 2703 ms. Trace:
I20260927 13:50:07.696419 7190 rpcz_store.cc:276] 0927 13:50:04.993129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:04.996235 (+ 3106us) service_pool.cc:224] Handling call
0927 13:50:07.616322 (+2620087us) ts_tablet_manager.cc:1151] Deleting tablet 3afb800e7ff44aadaed8f8d85aa9efe2
0927 13:50:07.616332 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.626574 (+ 10242us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.643845 (+ 17271us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.696314 (+ 52469us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2593508}
I20260927 13:50:07.696620 7098 ts_tablet_manager.cc:1950] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.696866 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 103) took 2224 ms. Trace:
I20260927 13:50:07.697032 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 138) took 1509 ms. Trace:
I20260927 13:50:07.696964 7190 rpcz_store.cc:276] 0927 13:50:05.472534 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.472584 (+ 50us) service_pool.cc:224] Handling call
0927 13:50:07.696731 (+2224147us) ts_tablet_manager.cc:1151] Deleting tablet 1b4494b7e895454f81fef308950729ef
0927 13:50:07.696741 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.696850 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2223943}
I20260927 13:50:07.697094 7098 rpcz_store.cc:276] 0927 13:50:06.187771 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.188133 (+ 362us) service_pool.cc:224] Handling call
0927 13:50:07.677013 (+1488880us) ts_tablet_manager.cc:1151] Deleting tablet bf557ac29964453583f224b46178c7dd
0927 13:50:07.677028 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.689768 (+ 12740us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.692924 (+ 3156us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.697014 (+ 4090us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1488696}
I20260927 13:50:07.697350 7190 tablet_replica.cc:333] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:07.697597 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet bf557ac29964453583f224b46178c7dd (table default.Table_2f83c545334d4bc995f6afb456fb190b [id=00aa74ea071b484daf2c9854a1e87728]) successfully deleted
I20260927 13:50:07.697661 7190 raft_consensus.cc:2243] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.697808 7190 pending_rounds.cc:70] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:50:07.697846 7190 pending_rounds.cc:77] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7333957652378472448 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "f46f45a0a13b4e05802a08880d7f6a01" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_e969ed1c04384e2cbafb90d72cbdef52" dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" new_extra_config { } }
I20260927 13:50:07.699008 7098 tablet_replica.cc:333] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.699158 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 3afb800e7ff44aadaed8f8d85aa9efe2 (table default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]) successfully deleted
W20260927 13:50:07.699523 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 1b4494b7e895454f81fef308950729ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b4494b7e895454f81fef308950729ef already in progress: creating tablet
I20260927 13:50:07.699759 7098 raft_consensus.cc:2243] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.699946 7190 raft_consensus.cc:2272] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.700053 7098 pending_rounds.cc:70] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Trying to abort 1 pending ops.
I20260927 13:50:07.701025 7190 ts_tablet_manager.cc:1916] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.700982 7387 raft_consensus.cc:493] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.704391 7098 pending_rounds.cc:77] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957648355221504 op_type: NO_OP noop_request { }
I20260927 13:50:07.704514 7098 raft_consensus.cc:2889] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:07.704568 7387 raft_consensus.cc:515] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.705471 7387 leader_election.cc:290] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:07.705868 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4ddd064e2c415fb47b694732514582" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:07.706434 5044 leader_election.cc:343] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.710458 7387 raft_consensus.cc:493] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.710634 7387 raft_consensus.cc:515] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:07.711453 7387 leader_election.cc:290] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:07.711647 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "187b3ceeccb142c4b798947e584d6044" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:07.704607 7098 raft_consensus.cc:2272] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:07.712082 5044 leader_election.cc:343] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.713011 7098 ts_tablet_manager.cc:1916] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.684155 5319 leader_election.cc:304] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:07.720747 7359 raft_consensus.cc:2804] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.722307 5227 tablet_service.cc:1511] Processing CreateTablet for tablet 4fda77f121a44c5c9329c7eab3651da2 (DEFAULT_TABLE table=default.Table_d9214a04e2e645468dc62f758c45a74f [id=bf39fb04f204483e8d1ed106d76c3e9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.721387 7190 ts_tablet_manager.cc:1929] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 13:50:07.723155 5215 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7f3c79d6b04902958813816682893d (DEFAULT_TABLE table=default.Table_6ae053d0df4249988247ca5438c2b0e7 [id=807b149c939a4ed2a09505cfb07e555f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.723938 5223 tablet_service.cc:1511] Processing CreateTablet for tablet b3d03be746f240698009e9ea7dc092ac (DEFAULT_TABLE table=default.Table_c37d485f00e04ab79a168180c2e1ae88 [id=5ac08d70b8af464bb0e2bd1124f73ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.724972 5086 tablet_service.cc:1511] Processing CreateTablet for tablet 4fda77f121a44c5c9329c7eab3651da2 (DEFAULT_TABLE table=default.Table_d9214a04e2e645468dc62f758c45a74f [id=bf39fb04f204483e8d1ed106d76c3e9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.725152 5074 tablet_service.cc:1511] Processing CreateTablet for tablet b3d03be746f240698009e9ea7dc092ac (DEFAULT_TABLE table=default.Table_c37d485f00e04ab79a168180c2e1ae88 [id=5ac08d70b8af464bb0e2bd1124f73ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.725404 5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fda77f121a44c5c9329c7eab3651da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.725615 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d03be746f240698009e9ea7dc092ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.725910 5080 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7f3c79d6b04902958813816682893d (DEFAULT_TABLE table=default.Table_6ae053d0df4249988247ca5438c2b0e7 [id=807b149c939a4ed2a09505cfb07e555f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.691751 7394 tablet.cc:1751] T 03917a40b5884401a6bc09c7925fd1ae P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 13:50:07.726245 5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7f3c79d6b04902958813816682893d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.705044 5619 tablet_bootstrap.cc:492] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:07.728826 5619 ts_tablet_manager.cc:1403] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.070s user 0.002s sys 0.001s
I20260927 13:50:07.731133 5619 raft_consensus.cc:359] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.731289 5619 raft_consensus.cc:385] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.731333 5619 raft_consensus.cc:740] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.732725 5619 consensus_queue.cc:260] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.733207 5619 ts_tablet_manager.cc:1434] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:50:07.733340 5628 tablet_bootstrap.cc:492] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:07.733453 5628 ts_tablet_manager.cc:1403] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.050s user 0.011s sys 0.000s
I20260927 13:50:07.734164 5628 raft_consensus.cc:359] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.734334 5628 raft_consensus.cc:385] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.734450 5628 raft_consensus.cc:740] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.734665 5628 consensus_queue.cc:260] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.735340 5628 ts_tablet_manager.cc:1434] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:07.736340 5628 tablet_bootstrap.cc:492] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:07.738679 5628 tablet_bootstrap.cc:654] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.738844 5087 tablet_service.cc:1511] Processing CreateTablet for tablet e3ff7cb97a274c7ab316b0c4baf1f595 (DEFAULT_TABLE table=default.Table_b551e47328c044599ac2b4be3901aa7b [id=cb650a75aae14103bd8d9158f18cf9f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.739229 5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ff7cb97a274c7ab316b0c4baf1f595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.741715 5619 tablet_bootstrap.cc:492] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:07.741875 5074 tablet_service.cc:1511] Processing CreateTablet for tablet 1ddb5770a42449319eede54b476e4a70 (DEFAULT_TABLE table=default.Table_5df4d50c0d744dafa316d51755abfcb1 [id=ba5d6bc4106d4a26b27b1bff0362c667]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.742200 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddb5770a42449319eede54b476e4a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.742333 5077 tablet_service.cc:1511] Processing CreateTablet for tablet f0e4e716d3e74e0eacded4bf76ac57fb (DEFAULT_TABLE table=default.Table_32256dc4657d4f4fafd87e3ce74dbea3 [id=03ba9c14260e491280aca2bd45b13b0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.742631 5077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e4e716d3e74e0eacded4bf76ac57fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.743274 7098 ts_tablet_manager.cc:1929] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.743352 7098 log.cc:1199] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/84d9c94ee0af46e8aea12adac57829f7
I20260927 13:50:07.743655 7098 ts_tablet_manager.cc:1950] T 84d9c94ee0af46e8aea12adac57829f7 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.744659 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 137) took 1276 ms. Trace:
I20260927 13:50:07.744743 7111 rpcz_store.cc:276] 0927 13:50:06.468616 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.468663 (+ 47us) service_pool.cc:224] Handling call
0927 13:50:07.532484 (+1063821us) ts_tablet_manager.cc:1151] Deleting tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102
0927 13:50:07.532494 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.588738 (+ 56244us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.680150 (+ 91412us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.744638 (+ 64488us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1052538}
I20260927 13:50:07.744915 5072 tablet_service.cc:1511] Processing CreateTablet for tablet 7710c6561bd84945a9ff017daf74a085 (DEFAULT_TABLE table=default.Table_bf1d966c56b941bab74f8fe4cef3bbb6 [id=f07c60c3feb741e4b9dda75a2ab5660e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.745043 7111 tablet_replica.cc:333] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:07.745203 7111 raft_consensus.cc:2243] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.745342 5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7710c6561bd84945a9ff017daf74a085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.745440 7111 raft_consensus.cc:2272] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.745675 5079 tablet_service.cc:1511] Processing CreateTablet for tablet 2a37b1abb77e41909922b33c6c0531c0 (DEFAULT_TABLE table=default.Table_3920ec6b5dbd4624a1ceeee9d17a8f4e [id=db345da382f7442dab9f561e9350e7af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.746119 7111 ts_tablet_manager.cc:1916] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:07.748832 5711 leader_election.cc:336] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095): Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
I20260927 13:50:07.749004 5711 leader_election.cc:304] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13a42ae8b95b495c9bcea85d6732cd77; no voters: 802b83f09d3445359cfac825cd87c9de, e421351a34d1463e9773dcebdeebae3c
I20260927 13:50:07.749255 7385 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260927 13:50:07.749270 5070 tablet_service.cc:1511] Processing CreateTablet for tablet f4cfddedc5cc4ec4a40b071253254703 (DEFAULT_TABLE table=default.Table_f8cf2e1f9d84401897db63d0a884c6b1 [id=1828e2f519ae4cbc810509b126d740e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.749684 5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cfddedc5cc4ec4a40b071253254703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.751824 5085 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4b38e92f5f4963ae65bf40cecbc3a4 (DEFAULT_TABLE table=default.Table_3895042624e24a5bb7f7a7b8d19b2808 [id=22591106ebc0497db2a4d78b59fc89a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.752146 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4b38e92f5f4963ae65bf40cecbc3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.752821 5073 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4d7ef2ab5442f09092980747070008 (DEFAULT_TABLE table=default.Table_2b497c46186046989a9abb789a03949b [id=585e575f6df640ef808fb5a21a209d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.753093 5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4d7ef2ab5442f09092980747070008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.753505 5619 tablet_bootstrap.cc:654] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.754510 5088 tablet_service.cc:1511] Processing CreateTablet for tablet 5120bd92e689493ca6c5a92ed427b49e (DEFAULT_TABLE table=default.Table_01f1e5668a7c4e5da56f8e70a23a7026 [id=25ab7e226a6548f7a72964a34429fe8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.754779 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5120bd92e689493ca6c5a92ed427b49e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.755770 5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a37b1abb77e41909922b33c6c0531c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.761314 7359 raft_consensus.cc:697] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:07.761670 7359 consensus_queue.cc:237] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.764144 5319 leader_election.cc:304] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:07.765038 7305 raft_consensus.cc:2804] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.765219 7305 raft_consensus.cc:697] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:07.765534 7305 consensus_queue.cc:237] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.780361 5619 tablet_bootstrap.cc:492] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:07.780583 5619 ts_tablet_manager.cc:1403] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.002s
I20260927 13:50:07.781330 5619 raft_consensus.cc:359] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.781577 5619 raft_consensus.cc:385] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.781678 5619 raft_consensus.cc:740] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.781966 5619 consensus_queue.cc:260] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.782595 5088 tablet_service.cc:1511] Processing CreateTablet for tablet cc5cb26760e844aab324d5c4f4d2b488 (DEFAULT_TABLE table=default.Table_2159a2c74b9c4769be385712b34f41c3 [id=c386219cd45c4447b229c721951babeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.783654 5628 tablet_bootstrap.cc:492] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:07.783790 5628 ts_tablet_manager.cc:1403] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.048s user 0.006s sys 0.003s
I20260927 13:50:07.791814 5628 raft_consensus.cc:359] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.792026 5628 raft_consensus.cc:385] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.792081 5628 raft_consensus.cc:740] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.792328 5628 consensus_queue.cc:260] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.792812 5628 ts_tablet_manager.cc:1434] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260927 13:50:07.793114 5628 tablet_bootstrap.cc:492] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:07.798761 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 140) took 1610 ms. Trace:
I20260927 13:50:07.798949 7098 rpcz_store.cc:276] 0927 13:50:06.187972 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.188338 (+ 366us) service_pool.cc:224] Handling call
0927 13:50:07.698964 (+1510626us) ts_tablet_manager.cc:1151] Deleting tablet 84d9c94ee0af46e8aea12adac57829f7
0927 13:50:07.698974 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.740274 (+ 41300us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.743233 (+ 2959us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.798744 (+ 55511us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1510492}
I20260927 13:50:07.799412 7098 tablet_replica.cc:333] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.799641 7098 raft_consensus.cc:2243] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.799830 7098 raft_consensus.cc:2272] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.800469 7098 ts_tablet_manager.cc:1916] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:07.724371 7405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:50:07.724638 7190 log.cc:1199] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f46f45a0a13b4e05802a08880d7f6a01
I20260927 13:50:07.736732 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 1ddb5770a42449319eede54b476e4a70 (DEFAULT_TABLE table=default.Table_5df4d50c0d744dafa316d51755abfcb1 [id=ba5d6bc4106d4a26b27b1bff0362c667]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.802651 7190 ts_tablet_manager.cc:1950] T f46f45a0a13b4e05802a08880d7f6a01 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:07.736765 5221 tablet_service.cc:1511] Processing CreateTablet for tablet f4cfddedc5cc4ec4a40b071253254703 (DEFAULT_TABLE table=default.Table_f8cf2e1f9d84401897db63d0a884c6b1 [id=1828e2f519ae4cbc810509b126d740e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.736912 5214 tablet_service.cc:1511] Processing CreateTablet for tablet e3ff7cb97a274c7ab316b0c4baf1f595 (DEFAULT_TABLE table=default.Table_b551e47328c044599ac2b4be3901aa7b [id=cb650a75aae14103bd8d9158f18cf9f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.737102 5228 tablet_service.cc:1511] Processing CreateTablet for tablet f0e4e716d3e74e0eacded4bf76ac57fb (DEFAULT_TABLE table=default.Table_32256dc4657d4f4fafd87e3ce74dbea3 [id=03ba9c14260e491280aca2bd45b13b0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.803440 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 104) took 2330 ms. Trace:
I20260927 13:50:07.737275 5217 tablet_service.cc:1511] Processing CreateTablet for tablet 7710c6561bd84945a9ff017daf74a085 (DEFAULT_TABLE table=default.Table_bf1d966c56b941bab74f8fe4cef3bbb6 [id=f07c60c3feb741e4b9dda75a2ab5660e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.803503 7190 rpcz_store.cc:276] 0927 13:50:05.472632 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.472676 (+ 44us) service_pool.cc:224] Handling call
0927 13:50:07.697277 (+2224601us) ts_tablet_manager.cc:1151] Deleting tablet f46f45a0a13b4e05802a08880d7f6a01
0927 13:50:07.697291 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.709270 (+ 11979us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.720992 (+ 11722us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.803420 (+ 82428us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2224439}
I20260927 13:50:07.737453 5212 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4b38e92f5f4963ae65bf40cecbc3a4 (DEFAULT_TABLE table=default.Table_3895042624e24a5bb7f7a7b8d19b2808 [id=22591106ebc0497db2a4d78b59fc89a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.803889 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 105) took 2330 ms. Trace:
I20260927 13:50:07.803967 7190 rpcz_store.cc:276] 0927 13:50:05.472978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.473029 (+ 51us) service_pool.cc:224] Handling call
0927 13:50:07.803775 (+2330746us) ts_tablet_manager.cc:1151] Deleting tablet a6596ed8c4d44ad58a7ec495a665d1e9
0927 13:50:07.803783 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.803856 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2330575}
I20260927 13:50:07.804288 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 106) took 2330 ms. Trace:
I20260927 13:50:07.751307 5222 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4d7ef2ab5442f09092980747070008 (DEFAULT_TABLE table=default.Table_2b497c46186046989a9abb789a03949b [id=585e575f6df640ef808fb5a21a209d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.804342 7190 rpcz_store.cc:276] 0927 13:50:05.473414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.473455 (+ 41us) service_pool.cc:224] Handling call
0927 13:50:07.804186 (+2330731us) ts_tablet_manager.cc:1151] Deleting tablet 58d9274ad0934f19a7c36325eee3dd59
0927 13:50:07.804193 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.804274 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2330584}
I20260927 13:50:07.751564 5219 tablet_service.cc:1511] Processing CreateTablet for tablet cc5cb26760e844aab324d5c4f4d2b488 (DEFAULT_TABLE table=default.Table_2159a2c74b9c4769be385712b34f41c3 [id=c386219cd45c4447b229c721951babeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.804621 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 126) took 2178 ms. Trace:
I20260927 13:50:07.804675 7190 rpcz_store.cc:276] 0927 13:50:05.626527 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.626573 (+ 46us) service_pool.cc:224] Handling call
0927 13:50:07.804536 (+2177963us) ts_tablet_manager.cc:1151] Deleting tablet 362f660cac76436aba54bb707d8a991c
0927 13:50:07.804542 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.804607 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2148598}
I20260927 13:50:07.804971 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 136) took 1857 ms. Trace:
I20260927 13:50:07.805030 7190 rpcz_store.cc:276] 0927 13:50:05.947245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.950179 (+ 2934us) service_pool.cc:224] Handling call
0927 13:50:07.804871 (+1854692us) ts_tablet_manager.cc:1151] Deleting tablet 9fdef4f56d9647118afe83ac3cd364fd
0927 13:50:07.804889 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.804957 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1854524}
I20260927 13:50:07.805327 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 135) took 1858 ms. Trace:
I20260927 13:50:07.805399 7190 rpcz_store.cc:276] 0927 13:50:05.947144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.951134 (+ 3990us) service_pool.cc:224] Handling call
0927 13:50:07.805237 (+1854103us) ts_tablet_manager.cc:1151] Deleting tablet 269cda0876e346149512e0b4985c6890
0927 13:50:07.805244 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.805310 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1853895}
I20260927 13:50:07.805689 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 137) took 1505 ms. Trace:
I20260927 13:50:07.805760 7190 rpcz_store.cc:276] 0927 13:50:06.300034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.300153 (+ 119us) service_pool.cc:224] Handling call
0927 13:50:07.805604 (+1505451us) ts_tablet_manager.cc:1151] Deleting tablet 0076228c3f224d1f9d76ccf2dd7064ae
0927 13:50:07.805612 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.805675 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1505271}
I20260927 13:50:07.814335 5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5cb26760e844aab324d5c4f4d2b488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.817644 7394 tablet.cc:1751] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:50:07.819234 7111 ts_tablet_manager.cc:1929] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.819351 7111 log.cc:1199] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/413d863d9a564e5d8325b4479346730d
I20260927 13:50:07.819692 7111 ts_tablet_manager.cc:1950] T 413d863d9a564e5d8325b4479346730d P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:07.822703 5157 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:07.825147 7394 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35946 (request call id 126) took 1824 ms. Trace:
W20260927 13:50:07.826064 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 53019.4us
I20260927 13:50:07.826423 5319 leader_election.cc:304] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:07.827443 7231 raft_consensus.cc:2804] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.827657 7231 raft_consensus.cc:697] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:07.828115 7231 consensus_queue.cc:237] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.829802 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 139) took 1360 ms. Trace:
I20260927 13:50:07.829909 7111 rpcz_store.cc:276] 0927 13:50:06.469081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.469127 (+ 46us) service_pool.cc:224] Handling call
0927 13:50:07.745002 (+1275875us) ts_tablet_manager.cc:1151] Deleting tablet 413d863d9a564e5d8325b4479346730d
0927 13:50:07.745012 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.803173 (+ 58161us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.819155 (+ 15982us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.829774 (+ 10619us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1265001}
I20260927 13:50:07.831380 5319 leader_election.cc:304] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:50:07.832017 5319 raft_consensus.cc:2686] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:50:07.834976 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 138) took 1366 ms. Trace:
I20260927 13:50:07.835065 7111 rpcz_store.cc:276] 0927 13:50:06.468975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.469298 (+ 323us) service_pool.cc:224] Handling call
0927 13:50:07.830253 (+1360955us) ts_tablet_manager.cc:1151] Deleting tablet 5978cb78bd974d669817def05007d0ea
0927 13:50:07.830267 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.834960 (+ 4693us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1350227}
I20260927 13:50:07.835664 7111 tablet_replica.cc:333] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:07.835858 7111 raft_consensus.cc:2243] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:07.825312 7394 rpcz_store.cc:276] 0927 13:50:06.000870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.000924 (+ 54us) service_pool.cc:224] Handling call
0927 13:50:06.058221 (+ 57297us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x61800000d518. stack: 00007f280367b5c6 00007f280367b380 00007f280268334d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f280367105d 00007f2803670c7e 00007f28175b698d 00007f28175b692c 00007f28136ca974 00007f28136cabda 00007f281364ba1c 00007f28135ff33f 00007f28135fd59c 00007f280d447306
0927 13:50:07.825125 (+1766904us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.134588 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0927 13:50:06.134776 (+ 188us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 13:50:06.134784 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0927 13:50:06.134792 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0927 13:50:06.134830 (+ 38us) alter_schema_op.cc:128] START. Timestamp: 1790517006134782
0927 13:50:06.134833 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.135002 (+ 169us) log.cc:844] Serialized 173 byte log entry
0927 13:50:07.817444 (+1682442us) op_driver.cc:464] REPLICATION: finished
0927 13:50:07.817607 (+ 163us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0927 13:50:07.818347 (+ 740us) log.cc:844] Serialized 5 byte log entry
0927 13:50:07.824144 (+ 5797us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.824854 (+ 710us) log.cc:844] Serialized 14 byte log entry
0927 13:50:07.824908 (+ 54us) alter_schema_op.cc:73] Released schema lock
0927 13:50:07.824913 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"spinlock_wait_cycles":121820544,"child_traces":[["op",{"apply.queue_time_us":97,"prepare.queue_time_us":76070,"prepare.run_cpu_time_us":1909,"prepare.run_wall_time_us":46001,"replication_time_us":1682570,"thread_start_us":128078,"threads_started":2,"wal-append.queue_time_us":28505,"wal-append.run_cpu_time_us":434,"wal-append.run_wall_time_us":1000475}]]}
I20260927 13:50:07.836022 7111 pending_rounds.cc:70] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:50:07.836700 7111 pending_rounds.cc:77] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957655795773440 op_type: NO_OP noop_request { }
I20260927 13:50:07.836805 7111 raft_consensus.cc:2889] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:07.836896 7111 raft_consensus.cc:2272] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:07.837126 5319 leader_election.cc:343] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 4211f338c6a648c5b3e36c6df0b3c510
I20260927 13:50:07.837644 5319 leader_election.cc:304] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:07.838101 7359 consensus_queue.cc:1048] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:07.838743 5619 ts_tablet_manager.cc:1434] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.058s user 0.003s sys 0.003s
I20260927 13:50:07.839031 5619 tablet_bootstrap.cc:492] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:07.842586 5319 leader_election.cc:304] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:07.843164 7423 raft_consensus.cc:2804] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.843295 7423 raft_consensus.cc:697] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:07.843580 7423 consensus_queue.cc:237] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.844098 7394 tablet.cc:1751] T a81b44fb2f644dff899d6d4aa435ccee P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:07.842803 7412 raft_consensus.cc:2804] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:07.845110 7412 raft_consensus.cc:493] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:07.845453 7412 raft_consensus.cc:3060] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.848882 7412 raft_consensus.cc:515] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.859190 7098 ts_tablet_manager.cc:1929] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:07.859654 7098 log.cc:1199] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/1ae6b1e46bdc4c28a2d0a2633d40f92a
I20260927 13:50:07.860149 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 1087ad60dade46bb9d38f52a94dd536b (table default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]) successfully deleted
I20260927 13:50:07.850867 5362 tablet_service.cc:1511] Processing CreateTablet for tablet cddf1b48a78e4ff789e0bb0bf75e307b (DEFAULT_TABLE table=default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.851390 5354 tablet_service.cc:1511] Processing CreateTablet for tablet 10dc68c97a4244d29fede0a785c2e4b8 (DEFAULT_TABLE table=default.Table_0eb2310657374b4c9746296895007026 [id=17c17b7cb12c40ce81b7a015458f911b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.864027 5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddf1b48a78e4ff789e0bb0bf75e307b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.851575 5346 tablet_service.cc:1558] Processing DeleteTablet for tablet 97b46497d8254a248df8d421d0b09d8d with delete_type TABLET_DATA_DELETED (replaced by tablet 8693dee8fa3f42388b0a728c223854a9) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:07.851897 5361 tablet_service.cc:1511] Processing CreateTablet for tablet 4fda77f121a44c5c9329c7eab3651da2 (DEFAULT_TABLE table=default.Table_d9214a04e2e645468dc62f758c45a74f [id=bf39fb04f204483e8d1ed106d76c3e9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.864491 5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fda77f121a44c5c9329c7eab3651da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.861558 5102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:07.867822 5102 raft_consensus.cc:2468] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:07.862939 5628 tablet_bootstrap.cc:654] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:07.863335 5045 leader_election.cc:343] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.868079 5045 leader_election.cc:304] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.868520 5045 leader_election.cc:304] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:50:07.868695 5045 raft_consensus.cc:2686] T e25f5898369f46fba32b7df27b334b28 P 34fc5fe0a32d42ab83f4aa6d07341409: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:50:07.852244 5359 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7f3c79d6b04902958813816682893d (DEFAULT_TABLE table=default.Table_6ae053d0df4249988247ca5438c2b0e7 [id=807b149c939a4ed2a09505cfb07e555f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 13:50:07.869338 5045 leader_election.cc:343] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.869416 5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7f3c79d6b04902958813816682893d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.869445 5045 leader_election.cc:304] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:07.869778 5045 leader_election.cc:343] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.869871 5045 leader_election.cc:304] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.870235 5045 leader_election.cc:304] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:50:07.870404 5045 raft_consensus.cc:2686] T bf557ac29964453583f224b46178c7dd P 34fc5fe0a32d42ab83f4aa6d07341409: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:50:07.870520 7412 leader_election.cc:290] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.870962 5045 leader_election.cc:304] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.871317 7387 raft_consensus.cc:2749] T 7e3f7ded9d644d749532e0700844bd62 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.871477 7387 raft_consensus.cc:2749] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.871600 7387 raft_consensus.cc:2749] T d897f986d26a44f4894e147a74a90949 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.871701 7387 raft_consensus.cc:2749] T 449e6bf85bf1434ab6ce42e751d31c6f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.872189 5102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ca4b429294782a9e6ed496c6dfb72" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
W20260927 13:50:07.874979 5319 leader_election.cc:343] T 008516a474cc40f2b9de77b2f3e762cf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.852591 5356 tablet_service.cc:1511] Processing CreateTablet for tablet b3d03be746f240698009e9ea7dc092ac (DEFAULT_TABLE table=default.Table_c37d485f00e04ab79a168180c2e1ae88 [id=5ac08d70b8af464bb0e2bd1124f73ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.875805 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d03be746f240698009e9ea7dc092ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.876669 5319 leader_election.cc:304] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:07.876864 7231 raft_consensus.cc:2749] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:07.877547 5319 leader_election.cc:343] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.852962 5363 tablet_service.cc:1511] Processing CreateTablet for tablet 1ddb5770a42449319eede54b476e4a70 (DEFAULT_TABLE table=default.Table_5df4d50c0d744dafa316d51755abfcb1 [id=ba5d6bc4106d4a26b27b1bff0362c667]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.878096 5319 leader_election.cc:304] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:07.878415 5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddb5770a42449319eede54b476e4a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.878394 7231 raft_consensus.cc:2804] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:07.853490 5349 tablet_service.cc:1511] Processing CreateTablet for tablet 7710c6561bd84945a9ff017daf74a085 (DEFAULT_TABLE table=default.Table_bf1d966c56b941bab74f8fe4cef3bbb6 [id=f07c60c3feb741e4b9dda75a2ab5660e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.878652 5349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7710c6561bd84945a9ff017daf74a085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.853266 5353 tablet_service.cc:1511] Processing CreateTablet for tablet e3ff7cb97a274c7ab316b0c4baf1f595 (DEFAULT_TABLE table=default.Table_b551e47328c044599ac2b4be3901aa7b [id=cb650a75aae14103bd8d9158f18cf9f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.854864 5352 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4b38e92f5f4963ae65bf40cecbc3a4 (DEFAULT_TABLE table=default.Table_3895042624e24a5bb7f7a7b8d19b2808 [id=22591106ebc0497db2a4d78b59fc89a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.878921 5353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ff7cb97a274c7ab316b0c4baf1f595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.879101 5352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4b38e92f5f4963ae65bf40cecbc3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.879580 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10dc68c97a4244d29fede0a785c2e4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.855494 5355 tablet_service.cc:1511] Processing CreateTablet for tablet 2a37b1abb77e41909922b33c6c0531c0 (DEFAULT_TABLE table=default.Table_3920ec6b5dbd4624a1ceeee9d17a8f4e [id=db345da382f7442dab9f561e9350e7af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.882478 5355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a37b1abb77e41909922b33c6c0531c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.856191 5364 tablet_service.cc:1511] Processing CreateTablet for tablet 5120bd92e689493ca6c5a92ed427b49e (DEFAULT_TABLE table=default.Table_01f1e5668a7c4e5da56f8e70a23a7026 [id=25ab7e226a6548f7a72964a34429fe8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.886396 5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5120bd92e689493ca6c5a92ed427b49e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.856318 5350 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4d7ef2ab5442f09092980747070008 (DEFAULT_TABLE table=default.Table_2b497c46186046989a9abb789a03949b [id=585e575f6df640ef808fb5a21a209d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.857157 5360 tablet_service.cc:1511] Processing CreateTablet for tablet cc5cb26760e844aab324d5c4f4d2b488 (DEFAULT_TABLE table=default.Table_2159a2c74b9c4769be385712b34f41c3 [id=c386219cd45c4447b229c721951babeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.889484 5350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4d7ef2ab5442f09092980747070008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.889942 5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5cb26760e844aab324d5c4f4d2b488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.853494 5365 tablet_service.cc:1511] Processing CreateTablet for tablet f0e4e716d3e74e0eacded4bf76ac57fb (DEFAULT_TABLE table=default.Table_32256dc4657d4f4fafd87e3ce74dbea3 [id=03ba9c14260e491280aca2bd45b13b0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.896838 5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e4e716d3e74e0eacded4bf76ac57fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.901685 5619 tablet_bootstrap.cc:654] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.855964 5348 tablet_service.cc:1511] Processing CreateTablet for tablet f4cfddedc5cc4ec4a40b071253254703 (DEFAULT_TABLE table=default.Table_f8cf2e1f9d84401897db63d0a884c6b1 [id=1828e2f519ae4cbc810509b126d740e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:07.902433 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cfddedc5cc4ec4a40b071253254703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:07.920866 7435 tablet.cc:1751] T a81b44fb2f644dff899d6d4aa435ccee P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:07.860339 7111 ts_tablet_manager.cc:1916] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.923642 7394 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35946 (request call id 135) took 1455 ms. Trace:
I20260927 13:50:07.923740 7394 rpcz_store.cc:276] 0927 13:50:06.468243 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.468340 (+ 97us) service_pool.cc:224] Handling call
0927 13:50:07.923624 (+1455284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.468700 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0927 13:50:06.468815 (+ 115us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 13:50:06.468824 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0927 13:50:06.468830 (+ 6us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0927 13:50:06.468870 (+ 40us) alter_schema_op.cc:128] START. Timestamp: 1790517006468789
0927 13:50:06.468873 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.469106 (+ 233us) log.cc:844] Serialized 173 byte log entry
0927 13:50:07.843625 (+1374519us) op_driver.cc:464] REPLICATION: finished
0927 13:50:07.844076 (+ 451us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0927 13:50:07.844651 (+ 575us) log.cc:844] Serialized 5 byte log entry
0927 13:50:07.923049 (+ 78398us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.923538 (+ 489us) log.cc:844] Serialized 14 byte log entry
0927 13:50:07.923580 (+ 42us) alter_schema_op.cc:73] Released schema lock
0927 13:50:07.923586 (+ 6us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":389,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":12079,"prepare.run_wall_time_us":40339,"raft.queue_time_us":9141,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":428,"replication_time_us":1374718,"thread_start_us":55537,"threads_started":2,"wal-append.queue_time_us":56779,"wal-append.run_cpu_time_us":469,"wal-append.run_wall_time_us":1000568}]]}
W20260927 13:50:07.924428 5045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 53479.8us
I20260927 13:50:07.924687 5045 leader_election.cc:304] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:07.925122 5045 leader_election.cc:343] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.925226 5045 leader_election.cc:304] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.925436 6779 raft_consensus.cc:2749] T 0dc69551c99942b09862904266572471 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.925551 5045 leader_election.cc:304] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:07.925587 6779 raft_consensus.cc:2749] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.925782 6779 raft_consensus.cc:2804] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:07.925839 6779 raft_consensus.cc:493] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:07.925896 6779 raft_consensus.cc:3060] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:07.925984 5045 leader_election.cc:343] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 992bf643dee64bccaa993a08027aa5fc
I20260927 13:50:07.926102 5045 leader_election.cc:304] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:07.926282 5045 raft_consensus.cc:2686] T 992bf643dee64bccaa993a08027aa5fc P 34fc5fe0a32d42ab83f4aa6d07341409: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260927 13:50:07.926836 5045 leader_election.cc:343] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.926962 5045 leader_election.cc:304] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.927188 7388 raft_consensus.cc:2749] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:07.927933 5045 leader_election.cc:343] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.928188 5045 leader_election.cc:304] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.928406 5619 tablet_bootstrap.cc:492] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:07.928537 5619 ts_tablet_manager.cc:1403] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.090s user 0.004s sys 0.004s
I20260927 13:50:07.929241 5619 raft_consensus.cc:359] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.929399 5619 raft_consensus.cc:385] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.929461 5619 raft_consensus.cc:740] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:07.929699 5619 consensus_queue.cc:260] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.930080 5619 ts_tablet_manager.cc:1434] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260927 13:50:07.930683 5619 tablet_bootstrap.cc:492] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:07.935130 7231 raft_consensus.cc:697] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:07.935454 7231 consensus_queue.cc:237] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.936033 5619 tablet_bootstrap.cc:654] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.940577 7111 ts_tablet_manager.cc:1929] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:07.948917 7111 log.cc:1199] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/51e1acd618fc44be9169fa1d56fa510a
I20260927 13:50:07.928603 6779 raft_consensus.cc:515] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.949290 7428 raft_consensus.cc:2749] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.930857 7098 ts_tablet_manager.cc:1950] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:07.949517 7111 ts_tablet_manager.cc:1950] T 51e1acd618fc44be9169fa1d56fa510a P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:07.949826 6779 leader_election.cc:290] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:07.947466 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 69378.4us
I20260927 13:50:07.950749 7423 consensus_queue.cc:1048] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:07.950928 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 141) took 1762 ms. Trace:
I20260927 13:50:07.951062 7098 rpcz_store.cc:276] 0927 13:50:06.188084 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.188498 (+ 414us) service_pool.cc:224] Handling call
0927 13:50:07.799360 (+1610862us) ts_tablet_manager.cc:1151] Deleting tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a
0927 13:50:07.799370 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.837578 (+ 38208us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.859116 (+ 21538us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.950907 (+ 91791us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1610736}
I20260927 13:50:07.951175 5319 leader_election.cc:304] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:07.951412 7423 raft_consensus.cc:2749] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.951870 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 145) took 1757 ms. Trace:
I20260927 13:50:07.951999 7098 rpcz_store.cc:276] 0927 13:50:06.194404 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.194457 (+ 53us) service_pool.cc:224] Handling call
0927 13:50:07.951718 (+1757261us) ts_tablet_manager.cc:1151] Deleting tablet 417b99e95ab4422d96b606fc76698324
0927 13:50:07.951730 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.951850 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1757039}
I20260927 13:50:07.952514 7098 tablet_replica.cc:333] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:07.952792 7098 raft_consensus.cc:2243] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.953045 7098 pending_rounds.cc:70] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: Trying to abort 1 pending ops.
I20260927 13:50:07.953143 7098 pending_rounds.cc:77] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957656097742848 op_type: NO_OP noop_request { }
I20260927 13:50:07.953306 7098 raft_consensus.cc:2889] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260927 13:50:07.953392 5319 leader_election.cc:343] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 4211f338c6a648c5b3e36c6df0b3c510
I20260927 13:50:07.953450 7098 raft_consensus.cc:2272] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.953523 5319 leader_election.cc:304] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:07.953841 7423 raft_consensus.cc:2749] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260927 13:50:07.954206 5319 leader_election.cc:343] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.954487 5319 leader_election.cc:304] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:50:07.954741 5045 leader_election.cc:343] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.954980 5045 leader_election.cc:304] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.955334 6779 raft_consensus.cc:2749] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.955404 7423 raft_consensus.cc:2749] T 334b0349bfaa4a9c8b7d280177f1ecae P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.955881 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 140) took 1486 ms. Trace:
I20260927 13:50:07.955962 7111 rpcz_store.cc:276] 0927 13:50:06.469360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.469411 (+ 51us) service_pool.cc:224] Handling call
0927 13:50:07.835615 (+1366204us) ts_tablet_manager.cc:1151] Deleting tablet 51e1acd618fc44be9169fa1d56fa510a
0927 13:50:07.835625 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.925500 (+ 89875us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.940522 (+ 15022us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.955865 (+ 15343us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21190,"tablet-delete.queue_time_us":1353104}
I20260927 13:50:07.956244 7111 tablet_replica.cc:333] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:07.956844 7423 consensus_queue.cc:1048] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:07.957670 7098 ts_tablet_manager.cc:1916] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:07.960264 7394 tablet.cc:1751] T 20766b5a757e4a7e954c198f8c9ca41f P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260927 13:50:07.970489 5045 leader_election.cc:343] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.970827 5045 leader_election.cc:304] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.971166 7428 raft_consensus.cc:2749] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:07.973026 5319 consensus_peers.cc:597] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e26a3a50396940cf826442e4ba7356a8. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:07.974457 7394 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35946 (request call id 209) took 1323 ms. Trace:
I20260927 13:50:07.867034 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f46f45a0a13b4e05802a08880d7f6a01 (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]) successfully deleted
W20260927 13:50:07.977033 6428 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 125859us
W20260927 13:50:07.977289 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a6596ed8c4d44ad58a7ec495a665d1e9 because the tablet was not found. No further retry: Not found: Tablet not found: a6596ed8c4d44ad58a7ec495a665d1e9
W20260927 13:50:07.977511 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 58d9274ad0934f19a7c36325eee3dd59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58d9274ad0934f19a7c36325eee3dd59 already in progress: creating tablet
W20260927 13:50:07.977689 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 362f660cac76436aba54bb707d8a991c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 362f660cac76436aba54bb707d8a991c already in progress: creating tablet
W20260927 13:50:07.977918 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 9fdef4f56d9647118afe83ac3cd364fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fdef4f56d9647118afe83ac3cd364fd already in progress: creating tablet
I20260927 13:50:07.981105 5102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:07.981355 5102 raft_consensus.cc:3060] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.875501 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 (table default.Table_7675c4eea2d04c06b01cf0466c4ed466 [id=c58f2a8e5acf483d89fb782663512587]) successfully deleted
I20260927 13:50:07.913038 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 5678703b72c8471583147786f49122a5 (table default.Table_f3c5680fa304438d9df88d573453cd6f [id=0d85f9f0d28e43debda43f83a3e59637]). Expected version 2 got 0
I20260927 13:50:07.975693 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f5479761f94ee0b339e125d06a808c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.977314 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdacca4b5bd4afb95c83f6c72091b2f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.977736 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee18063dc634385b9e61fae3b3ece99" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.982431 5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4ddd064e2c415fb47b694732514582" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.982695 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "187b3ceeccb142c4b798947e584d6044" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:07.985988 7111 raft_consensus.cc:2243] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:07.987766 5383 raft_consensus.cc:2468] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
I20260927 13:50:07.988310 7394 rpcz_store.cc:276] 0927 13:50:06.650557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.650863 (+ 306us) service_pool.cc:224] Handling call
0927 13:50:07.974437 (+1323574us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.651376 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0927 13:50:06.651495 (+ 119us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 13:50:06.651504 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0927 13:50:06.651511 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0927 13:50:06.651615 (+ 104us) alter_schema_op.cc:128] START. Timestamp: 1790517006651524
0927 13:50:06.651619 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.651811 (+ 192us) log.cc:844] Serialized 173 byte log entry
0927 13:50:07.960155 (+1308344us) op_driver.cc:464] REPLICATION: finished
0927 13:50:07.960244 (+ 89us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0927 13:50:07.960720 (+ 476us) log.cc:844] Serialized 5 byte log entry
0927 13:50:07.973547 (+ 12827us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:07.974348 (+ 801us) log.cc:844] Serialized 14 byte log entry
0927 13:50:07.974391 (+ 43us) alter_schema_op.cc:73] Released schema lock
0927 13:50:07.974398 (+ 7us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":29,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":2919,"prepare.run_wall_time_us":5559,"replication_time_us":1308504,"thread_start_us":10806,"threads_started":2,"wal-append.queue_time_us":10919,"wal-append.run_cpu_time_us":512,"wal-append.run_wall_time_us":1000683}]]}
I20260927 13:50:07.988878 7111 raft_consensus.cc:2272] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:07.989262 7394 tablet.cc:1751] T 78c4bbb0512c4411916eb4c48731f32f P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:50:07.989579 5102 raft_consensus.cc:2468] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:07.991997 6779 raft_consensus.cc:493] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.992197 5619 tablet_bootstrap.cc:492] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:07.992352 5619 ts_tablet_manager.cc:1403] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.003s
I20260927 13:50:07.992233 6779 raft_consensus.cc:515] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.993136 6779 leader_election.cc:290] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:07.993180 5619 raft_consensus.cc:359] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.993377 5619 raft_consensus.cc:385] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:07.993444 5619 raft_consensus.cc:740] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:50:07.992456 5045 leader_election.cc:343] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.993744 5045 leader_election.cc:304] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.993672 5619 consensus_queue.cc:260] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.994164 6779 raft_consensus.cc:2749] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:07.994338 5045 leader_election.cc:343] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:07.994395 5619 ts_tablet_manager.cc:1434] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:07.994483 5045 leader_election.cc:304] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:07.994730 6779 raft_consensus.cc:2749] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:07.995055 5619 tablet_bootstrap.cc:492] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:07.997717 5619 tablet_bootstrap.cc:654] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.992197 7111 ts_tablet_manager.cc:1916] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.006498 5045 leader_election.cc:304] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:50:08.006928 5045 raft_consensus.cc:2686] T f3f6a9c5e4be480796f433a68945dd72 P 34fc5fe0a32d42ab83f4aa6d07341409: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260927 13:50:08.007983 5045 leader_election.cc:343] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.008239 5045 leader_election.cc:304] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.008939 6779 raft_consensus.cc:2749] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:08.009078 5045 leader_election.cc:343] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.013926 7111 ts_tablet_manager.cc:1929] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:08.014048 7111 log.cc:1199] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/c48ca4b429294782a9e6ed496c6dfb72
I20260927 13:50:08.016157 5045 leader_election.cc:304] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.020226 6779 raft_consensus.cc:2749] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.023646 7394 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35946 (request call id 146) took 1552 ms. Trace:
I20260927 13:50:08.024111 7394 rpcz_store.cc:276] 0927 13:50:06.470841 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.470889 (+ 48us) service_pool.cc:224] Handling call
0927 13:50:08.023623 (+1552734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.507402 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0927 13:50:06.507527 (+ 125us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 13:50:06.507535 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0927 13:50:06.507544 (+ 9us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0927 13:50:06.507588 (+ 44us) alter_schema_op.cc:128] START. Timestamp: 1790517006507499
0927 13:50:06.507591 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.507771 (+ 180us) log.cc:844] Serialized 173 byte log entry
0927 13:50:07.962035 (+1454264us) op_driver.cc:464] REPLICATION: finished
0927 13:50:07.989240 (+ 27205us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0927 13:50:07.991264 (+ 2024us) log.cc:844] Serialized 5 byte log entry
0927 13:50:08.017508 (+ 26244us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.023515 (+ 6007us) log.cc:844] Serialized 14 byte log entry
0927 13:50:08.023567 (+ 52us) alter_schema_op.cc:73] Released schema lock
0927 13:50:08.023575 (+ 8us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":27151,"prepare.queue_time_us":36182,"prepare.run_cpu_time_us":443,"prepare.run_wall_time_us":442,"replication_time_us":1454407,"thread_start_us":98485,"threads_started":3,"wal-append.queue_time_us":17258}]]}
I20260927 13:50:08.028368 6779 raft_consensus.cc:493] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.028513 7388 raft_consensus.cc:493] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.028656 6779 raft_consensus.cc:515] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.028702 7359 consensus_queue.cc:1048] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.028663 7388 raft_consensus.cc:515] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.029434 7388 leader_election.cc:290] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.029479 6779 leader_election.cc:290] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.028733 5319 leader_election.cc:304] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:08.038712 7359 raft_consensus.cc:2804] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:08.038810 7359 raft_consensus.cc:493] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:08.038879 7359 raft_consensus.cc:3060] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:08.038921 5319 consensus_peers.cc:597] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84d9c94ee0af46e8aea12adac57829f7. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:08.042972 7359 raft_consensus.cc:515] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.043783 7359 leader_election.cc:290] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.044739 5619 tablet_bootstrap.cc:492] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:08.044950 5619 ts_tablet_manager.cc:1403] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.005s
I20260927 13:50:08.045980 7388 raft_consensus.cc:493] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.046042 7111 ts_tablet_manager.cc:1950] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:08.046162 7388 raft_consensus.cc:515] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.046836 7388 leader_election.cc:290] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.046555 5619 raft_consensus.cc:359] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.048242 5619 raft_consensus.cc:385] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.048310 5619 raft_consensus.cc:740] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.048560 5619 consensus_queue.cc:260] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.049501 5619 ts_tablet_manager.cc:1434] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260927 13:50:08.049985 5619 tablet_bootstrap.cc:492] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:08.050510 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 141) took 1580 ms. Trace:
I20260927 13:50:08.050590 7111 rpcz_store.cc:276] 0927 13:50:06.469635 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.469680 (+ 45us) service_pool.cc:224] Handling call
0927 13:50:07.956204 (+1486524us) ts_tablet_manager.cc:1151] Deleting tablet c48ca4b429294782a9e6ed496c6dfb72
0927 13:50:07.956214 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.006023 (+ 49809us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.013862 (+ 7839us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.050483 (+ 36621us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29525,"tablet-delete.queue_time_us":1473626}
I20260927 13:50:08.050913 7111 tablet_replica.cc:333] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:08.051136 7111 raft_consensus.cc:2243] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.051311 7111 raft_consensus.cc:2272] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.052261 7111 ts_tablet_manager.cc:1916] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.052368 7388 raft_consensus.cc:493] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.052546 7388 raft_consensus.cc:515] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.053205 7388 leader_election.cc:290] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:08.055258 5619 tablet_bootstrap.cc:654] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.059095 5319 leader_election.cc:304] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:08.059535 7098 ts_tablet_manager.cc:1929] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:08.059711 7098 log.cc:1199] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b5a9f864e4274666a86baed43e1623cd
I20260927 13:50:08.060058 7423 raft_consensus.cc:2804] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:08.060194 7423 raft_consensus.cc:697] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:08.060253 7098 ts_tablet_manager.cc:1950] T b5a9f864e4274666a86baed43e1623cd P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:08.060456 7423 consensus_queue.cc:237] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.061293 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 143) took 1867 ms. Trace:
I20260927 13:50:08.061471 7098 rpcz_store.cc:276] 0927 13:50:06.194096 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.194575 (+ 479us) service_pool.cc:224] Handling call
0927 13:50:07.952462 (+1757887us) ts_tablet_manager.cc:1151] Deleting tablet b5a9f864e4274666a86baed43e1623cd
0927 13:50:07.952474 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.976593 (+ 24119us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.059414 (+ 82821us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.061244 (+ 1830us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1757742}
W20260927 13:50:08.062755 7406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:50:08.067022 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
W20260927 13:50:08.067492 6429 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 106808us
W20260927 13:50:08.067741 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 269cda0876e346149512e0b4985c6890 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 269cda0876e346149512e0b4985c6890 already in progress: creating tablet
I20260927 13:50:08.067785 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 413d863d9a564e5d8325b4479346730d (table default.Table_fbec3d960eb2415280ee9b1e7171392a [id=f03beab934924c65bd71d31d91c0f5cd]) successfully deleted
W20260927 13:50:08.068424 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 5978cb78bd974d669817def05007d0ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5978cb78bd974d669817def05007d0ea already in progress: creating tablet
I20260927 13:50:08.070658 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 51e1acd618fc44be9169fa1d56fa510a (table default.Table_73693476f4564e2e8e0f60b0f7e3d474 [id=90f057f5064842a19916355825eb7129]) successfully deleted
I20260927 13:50:08.071770 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:08.072043 5383 raft_consensus.cc:2393] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34fc5fe0a32d42ab83f4aa6d07341409 in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:08.072463 7435 tablet.cc:1751] T 78c4bbb0512c4411916eb4c48731f32f P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:50:08.073289 5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0076228c3f224d1f9d76ccf2dd7064ae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.073688 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef853d6e6ce4848927c9de884d39ac2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.074229 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e808336f5b746d486d375695536c052" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.074720 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69606adaa96d431791ed5c8455a7c548" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.076244 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5978cb78bd974d669817def05007d0ea" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.076900 5102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:08.077128 5102 raft_consensus.cc:2393] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb28c54312c94d7dafb1c2abf7870735 in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:50:08.078773 7388 raft_consensus.cc:493] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.078909 7388 raft_consensus.cc:515] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.079520 7388 leader_election.cc:290] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:08.085958 5628 tablet_bootstrap.cc:492] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.089073 5628 ts_tablet_manager.cc:1403] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.296s user 0.008s sys 0.008s
I20260927 13:50:08.091063 5628 raft_consensus.cc:359] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:08.095058 5319 consensus_peers.cc:597] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5a9f864e4274666a86baed43e1623cd. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:08.095709 5628 raft_consensus.cc:385] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.098187 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet c48ca4b429294782a9e6ed496c6dfb72 (table default.Table_7a48c16d7a32465cbc86892633257ea3 [id=49b35f9188a141e4af0afc5b3d2fd897]) successfully deleted
I20260927 13:50:08.098412 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
W20260927 13:50:08.088155 5045 leader_election.cc:343] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:08.098755 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 0076228c3f224d1f9d76ccf2dd7064ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0076228c3f224d1f9d76ccf2dd7064ae already in progress: creating tablet
I20260927 13:50:08.098778 5045 leader_election.cc:304] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.098930 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:08.099023 7388 raft_consensus.cc:2749] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.099171 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_b68a6b76e8684ab9ab1e52fbfaad3740 [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 2 got 0
I20260927 13:50:08.099221 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 84d9c94ee0af46e8aea12adac57829f7 (table default.Table_7ac056af78a84ab9b807aaed0fcf7c6a [id=4d64253f01f048778ee2ff75d95535ef]) successfully deleted
W20260927 13:50:08.099479 5045 leader_election.cc:343] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.099542 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:08.099577 5045 leader_election.cc:304] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.099754 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a (table default.Table_42fee70b5ead49929314182670a6aa7e [id=bfd622f425d94088a9bb3afb7475021e]) successfully deleted
I20260927 13:50:08.099785 7388 raft_consensus.cc:2749] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.099828 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]). Expected version 1 got 0
W20260927 13:50:08.100021 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 417b99e95ab4422d96b606fc76698324 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 417b99e95ab4422d96b606fc76698324 already in progress: creating tablet
I20260927 13:50:08.100236 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b5a9f864e4274666a86baed43e1623cd (table default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]) successfully deleted
W20260927 13:50:08.100580 5045 leader_election.cc:343] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.100667 5045 leader_election.cc:304] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.100869 5628 raft_consensus.cc:740] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.101095 5628 consensus_queue.cc:260] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.101428 7388 raft_consensus.cc:2749] T dd4ddd064e2c415fb47b694732514582 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.101634 7435 tablet.cc:1751] T 730cd78c7b1a49d892a5ecb46fae0812 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:08.102548 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0d3e3f86440448a88404f0ac06e0c0c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.103314 7394 tablet.cc:1751] T 730cd78c7b1a49d892a5ecb46fae0812 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:08.100028 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]). Expected version 2 got 0
I20260927 13:50:08.104652 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e3765fe06c664e60a11acf76c825bc42 (table default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee]). Expected version 1 got 0
I20260927 13:50:08.104912 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:50:08.105487 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]). Expected version 1 got 0
W20260927 13:50:08.104887 7460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 13:50:08.105778 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_cfdab7814ecc495089389612e0a7e4fe [id=ae170bbebc4e460fb58beb7f95f013a2]). Expected version 2 got 0
I20260927 13:50:08.105970 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]). Expected version 5 got 0
I20260927 13:50:07.785025 5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fda77f121a44c5c9329c7eab3651da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.110123 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:50:08.111047 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:50:08.111846 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]). Expected version 2 got 0
I20260927 13:50:08.112982 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]). Expected version 1 got 0
W20260927 13:50:07.794984 5211 consensus_meta.cc:287] T c06113a678914edabb239789c7262f51 P 79c1646c9659434b9a659382d2eb1d8a: Time spent flushing consensus metadata: real 0.905s user 0.029s sys 0.009s
I20260927 13:50:08.114439 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_954f47d3ef8846b8ade030d87002460e [id=750521adcb384c75841d7e1ff89af83d]). Expected version 2 got 0
I20260927 13:50:08.114539 5211 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44390 (request call id 163) took 1254 ms. Trace:
I20260927 13:50:08.114634 5211 rpcz_store.cc:276] 0927 13:50:06.859613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.885610 (+ 25997us) service_pool.cc:224] Handling call
0927 13:50:06.886157 (+ 547us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0927 13:50:06.886183 (+ 26us) ts_tablet_manager.cc:682] Creating new metadata...
0927 13:50:06.889982 (+ 3799us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.114355 (+1224373us) tablet_replica.cc:206] Creating consensus instance
0927 13:50:08.114524 (+ 169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260927 13:50:07.737617 5216 tablet_service.cc:1511] Processing CreateTablet for tablet 2a37b1abb77e41909922b33c6c0531c0 (DEFAULT_TABLE table=default.Table_3920ec6b5dbd4624a1ceeee9d17a8f4e [id=db345da382f7442dab9f561e9350e7af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:08.115417 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a37b1abb77e41909922b33c6c0531c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:08.115507 5045 leader_election.cc:343] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.115700 5045 leader_election.cc:304] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.115993 7388 raft_consensus.cc:2749] T 187b3ceeccb142c4b798947e584d6044 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.116529 5045 leader_election.cc:304] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:08.116631 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]). Expected version 1 got 0
I20260927 13:50:08.116798 7388 raft_consensus.cc:2804] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:08.116878 7388 raft_consensus.cc:493] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:08.116931 7388 raft_consensus.cc:3060] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.117667 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_6ac0611179c743808ff8a129f463dd61 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 3 got 0
I20260927 13:50:08.118026 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]). Expected version 3 got 0
I20260927 13:50:08.118324 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 90fb369fec2d43149080ab2ad94ecc57 (table default.Table_7b19583e86df4689a2e40ce5a9148e19 [id=23ffbb0d3240465cb12a09ffec1f8163]). Expected version 1 got 0
I20260927 13:50:08.120005 7388 raft_consensus.cc:515] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.121269 5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee18063dc634385b9e61fae3b3ece99" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:08.121692 7388 leader_election.cc:290] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:07.751168 5218 tablet_service.cc:1511] Processing CreateTablet for tablet 5120bd92e689493ca6c5a92ed427b49e (DEFAULT_TABLE table=default.Table_01f1e5668a7c4e5da56f8e70a23a7026 [id=25ab7e226a6548f7a72964a34429fe8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:08.122491 7435 tablet.cc:1751] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:50:08.122576 5218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5120bd92e689493ca6c5a92ed427b49e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:08.122879 5044 leader_election.cc:343] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.123483 7098 tablet_replica.cc:333] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:08.123710 7098 raft_consensus.cc:2243] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.123901 7098 raft_consensus.cc:2272] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.124440 7098 ts_tablet_manager.cc:1916] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.125569 5628 ts_tablet_manager.cc:1434] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260927 13:50:08.125905 5628 tablet_bootstrap.cc:492] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.127621 5628 tablet_bootstrap.cc:654] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:07.763082 5626 tablet_bootstrap.cc:492] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.128821 5626 ts_tablet_manager.cc:1403] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.508s user 0.003s sys 0.007s
I20260927 13:50:08.129485 5626 raft_consensus.cc:359] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.129643 5626 raft_consensus.cc:385] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.129693 5626 raft_consensus.cc:740] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.129891 5626 consensus_queue.cc:260] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.130581 7388 raft_consensus.cc:493] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.130746 7388 raft_consensus.cc:515] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:07.861250 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:07.863694 5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ca4b429294782a9e6ed496c6dfb72" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.131711 7388 leader_election.cc:290] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:07.872679 5247 raft_consensus.cc:3060] T 80fe8af2068948c78feac4641a7525be P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:07.910936 7370 raft_consensus.cc:493] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:07.979516 5249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:08.132097 7370 raft_consensus.cc:515] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.132611 7370 leader_election.cc:290] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:07.993561 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e808336f5b746d486d375695536c052" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.030457 5237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0076228c3f224d1f9d76ccf2dd7064ae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.002095 7445 tablet.cc:1751] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:50:08.040869 7447 tablet.cc:1751] T 20766b5a757e4a7e954c198f8c9ca41f P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:50:08.049401 5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69606adaa96d431791ed5c8455a7c548" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.135804 5099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54cf8c485324f798d59edf65d52d7b5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:08.135025 5626 ts_tablet_manager.cc:1434] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 13:50:08.053985 5236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5978cb78bd974d669817def05007d0ea" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.138556 5626 tablet_bootstrap.cc:492] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:08.138986 5044 leader_election.cc:343] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.139186 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54cf8c485324f798d59edf65d52d7b5" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:08.139269 5044 leader_election.cc:343] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:08.139451 5044 leader_election.cc:343] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.139488 5236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d48db9b20a41419d5be703190fadd8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:08.139587 5044 leader_election.cc:343] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.140277 5626 tablet_bootstrap.cc:654] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:08.142544 5044 leader_election.cc:343] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:08.143139 5045 leader_election.cc:343] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.143146 5185 leader_election.cc:304] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.143591 5045 leader_election.cc:304] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.145388 7445 tablet.cc:1751] T 730cd78c7b1a49d892a5ecb46fae0812 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:08.145933 7388 raft_consensus.cc:2749] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.128643 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]). Expected version 1 got 0
W20260927 13:50:08.146687 5045 leader_election.cc:343] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.147714 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
W20260927 13:50:08.148279 5045 leader_election.cc:343] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.152465 7447 tablet.cc:1746] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 79c1646c9659434b9a659382d2eb1d8a: Skipping requested alter to schema version 3, tablet already version 3
I20260927 13:50:08.153071 5045 leader_election.cc:304] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.155668 7388 raft_consensus.cc:2749] T 9e808336f5b746d486d375695536c052 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:08.156163 5045 leader_election.cc:343] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.156673 5045 leader_election.cc:304] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.157083 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
I20260927 13:50:08.157546 7388 raft_consensus.cc:2749] T 69606adaa96d431791ed5c8455a7c548 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:08.158092 5045 leader_election.cc:343] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.158773 5619 tablet_bootstrap.cc:492] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:08.158942 5619 ts_tablet_manager.cc:1403] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.109s user 0.001s sys 0.001s
I20260927 13:50:08.159668 5045 leader_election.cc:304] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.160094 7441 tablet.cc:1746] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P bb28c54312c94d7dafb1c2abf7870735: Skipping requested alter to schema version 3, tablet already version 3
I20260927 13:50:08.161643 7370 raft_consensus.cc:2749] T b54cf8c485324f798d59edf65d52d7b5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:50:08.162180 7388 raft_consensus.cc:2749] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.163089 5628 tablet_bootstrap.cc:492] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.163131 5219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5cb26760e844aab324d5c4f4d2b488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.163691 5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cfddedc5cc4ec4a40b071253254703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.164125 5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4b38e92f5f4963ae65bf40cecbc3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.164304 5628 ts_tablet_manager.cc:1403] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.000s
I20260927 13:50:08.164570 5222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4d7ef2ab5442f09092980747070008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.164963 5217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7710c6561bd84945a9ff017daf74a085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.165053 5628 raft_consensus.cc:359] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.066627 5235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:08.102587 7265 raft_consensus.cc:493] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.166388 7265 raft_consensus.cc:515] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:07.950333 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:08.166574 7441 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35946 (request call id 280) took 1268 ms. Trace:
I20260927 13:50:08.166744 5243 raft_consensus.cc:2468] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:08.030272 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef853d6e6ce4848927c9de884d39ac2" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.167068 7265 leader_election.cc:290] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.167127 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ff7cb97a274c7ab316b0c4baf1f595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.080005 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0d3e3f86440448a88404f0ac06e0c0c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.167662 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:08.169041 5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e4e716d3e74e0eacded4bf76ac57fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.160018 5619 raft_consensus.cc:359] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.169584 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.169766 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddb5770a42449319eede54b476e4a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.169864 5381 raft_consensus.cc:2393] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:08.166685 7441 rpcz_store.cc:276] 0927 13:50:06.898545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.898858 (+ 313us) service_pool.cc:224] Handling call
0927 13:50:08.166556 (+1267698us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.899315 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0927 13:50:06.899404 (+ 89us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 13:50:07.828041 (+928637us) alter_schema_op.cc:66] Acquired schema lock
0927 13:50:07.833798 (+ 5757us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0927 13:50:07.860422 (+ 26624us) alter_schema_op.cc:128] START. Timestamp: 1790517007841575
0927 13:50:07.864292 (+ 3870us) op_driver.cc:348] REPLICATION: starting
0927 13:50:07.975395 (+111103us) log.cc:844] Serialized 173 byte log entry
0927 13:50:08.103136 (+127741us) op_driver.cc:464] REPLICATION: finished
0927 13:50:08.160053 (+ 56917us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0927 13:50:08.166451 (+ 6398us) log.cc:844] Serialized 94 byte log entry
0927 13:50:08.166507 (+ 56us) alter_schema_op.cc:73] Released schema lock
0927 13:50:08.166513 (+ 6us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":56841,"prepare.queue_time_us":94,"prepare.run_cpu_time_us":61674,"prepare.run_wall_time_us":1076445,"replication_time_us":238466}]]}
I20260927 13:50:08.171281 5628 raft_consensus.cc:385] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.168730 5099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:08.171561 5099 raft_consensus.cc:2393] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in this term.
I20260927 13:50:08.169214 5044 leader_election.cc:304] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:08.172204 5044 leader_election.cc:343] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.172327 5044 leader_election.cc:304] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.173224 7388 raft_consensus.cc:2749] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.173398 7388 raft_consensus.cc:2749] T eef853d6e6ce4848927c9de884d39ac2 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:08.164136 5045 leader_election.cc:343] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:08.173880 5044 leader_election.cc:343] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.174221 5044 leader_election.cc:304] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.174556 6779 raft_consensus.cc:2749] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.173028 5184 leader_election.cc:304] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.175530 7265 raft_consensus.cc:3060] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.173100 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d03be746f240698009e9ea7dc092ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.176877 5215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7f3c79d6b04902958813816682893d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.177016 5628 raft_consensus.cc:740] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.177455 5628 consensus_queue.cc:260] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:07.806089 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 140) took 1256 ms. Trace:
I20260927 13:50:08.177819 7190 rpcz_store.cc:276] 0927 13:50:06.549671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.549943 (+ 272us) service_pool.cc:224] Handling call
0927 13:50:07.805990 (+1256047us) ts_tablet_manager.cc:1151] Deleting tablet 8ed33e78ee5448bcae633cc874c3e171
0927 13:50:07.806000 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:07.806074 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1255828}
I20260927 13:50:08.179523 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 141) took 1621 ms. Trace:
I20260927 13:50:08.179586 5628 ts_tablet_manager.cc:1434] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260927 13:50:08.181600 5628 tablet_bootstrap.cc:492] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.181658 6991 server_base.cc:1061] running on GCE node
I20260927 13:50:08.182806 6991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 13:50:08.183140 7190 rpcz_store.cc:276] 0927 13:50:06.558096 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.558191 (+ 95us) service_pool.cc:224] Handling call
0927 13:50:08.179396 (+1621205us) ts_tablet_manager.cc:1151] Deleting tablet e1e574bc8b544039b440a845966eb1d4
0927 13:50:08.179407 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.179505 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1620971}
I20260927 13:50:08.183514 5628 tablet_bootstrap.cc:654] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.183874 7394 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35946 (request call id 145) took 1713 ms. Trace:
I20260927 13:50:08.183970 7394 rpcz_store.cc:276] 0927 13:50:06.470702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.470746 (+ 44us) service_pool.cc:224] Handling call
0927 13:50:08.183854 (+1713108us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.471074 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0927 13:50:06.471156 (+ 82us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 13:50:06.471163 (+ 7us) alter_schema_op.cc:66] Acquired schema lock
0927 13:50:06.471169 (+ 6us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0927 13:50:06.471196 (+ 27us) alter_schema_op.cc:128] START. Timestamp: 1790517006471118
0927 13:50:06.471199 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.471336 (+ 137us) log.cc:844] Serialized 173 byte log entry
0927 13:50:08.083418 (+1612082us) op_driver.cc:464] REPLICATION: finished
0927 13:50:08.103292 (+ 19874us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0927 13:50:08.103714 (+ 422us) log.cc:844] Serialized 5 byte log entry
0927 13:50:08.183499 (+ 79785us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.183773 (+ 274us) log.cc:844] Serialized 14 byte log entry
0927 13:50:08.183813 (+ 40us) alter_schema_op.cc:73] Released schema lock
0927 13:50:08.183817 (+ 4us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":19804,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":11624,"prepare.run_wall_time_us":36281,"replication_time_us":1612177,"thread_start_us":112258,"threads_started":2,"wal-append.queue_time_us":111580,"wal-append.run_cpu_time_us":584,"wal-append.run_wall_time_us":1000633}]]}
W20260927 13:50:08.189069 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 77884.5us
I20260927 13:50:08.185832 7098 ts_tablet_manager.cc:1929] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:08.190452 7098 log.cc:1199] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/334b0349bfaa4a9c8b7d280177f1ecae
I20260927 13:50:08.190876 7098 ts_tablet_manager.cc:1950] T 334b0349bfaa4a9c8b7d280177f1ecae P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:08.173947 7111 ts_tablet_manager.cc:1929] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:08.191605 7111 log.cc:1199] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/f3f6a9c5e4be480796f433a68945dd72
I20260927 13:50:08.191962 7111 ts_tablet_manager.cc:1950] T f3f6a9c5e4be480796f433a68945dd72 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:08.192239 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 144) took 1998 ms. Trace:
I20260927 13:50:08.192368 7098 rpcz_store.cc:276] 0927 13:50:06.194254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.194753 (+ 499us) service_pool.cc:224] Handling call
0927 13:50:08.123420 (+1928667us) ts_tablet_manager.cc:1151] Deleting tablet 334b0349bfaa4a9c8b7d280177f1ecae
0927 13:50:08.123431 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.165859 (+ 42428us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.185775 (+ 19916us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.192222 (+ 6447us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1928523}
I20260927 13:50:08.192747 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 142) took 1722 ms. Trace:
I20260927 13:50:08.192840 7111 rpcz_store.cc:276] 0927 13:50:06.469881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.469928 (+ 47us) service_pool.cc:224] Handling call
0927 13:50:08.050862 (+1580934us) ts_tablet_manager.cc:1151] Deleting tablet f3f6a9c5e4be480796f433a68945dd72
0927 13:50:08.050874 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.063150 (+ 12276us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.173888 (+110738us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.192715 (+ 18827us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1568236}
I20260927 13:50:08.192982 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 142) took 1999 ms. Trace:
I20260927 13:50:08.193202 7111 tablet_replica.cc:333] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:08.193169 7098 rpcz_store.cc:276] 0927 13:50:06.193975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.194464 (+ 489us) service_pool.cc:224] Handling call
0927 13:50:08.192901 (+1998437us) ts_tablet_manager.cc:1151] Deleting tablet 95726f690a71433ca63f95da4ee750e5
0927 13:50:08.192910 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.192967 (+ 57us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1997802}
I20260927 13:50:08.193427 7111 raft_consensus.cc:2243] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:08.193715 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 154) took 1996 ms. Trace:
I20260927 13:50:08.193753 7111 raft_consensus.cc:2272] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.194065 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee18063dc634385b9e61fae3b3ece99" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:08.194147 7098 rpcz_store.cc:276] 0927 13:50:06.197270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.197318 (+ 48us) service_pool.cc:224] Handling call
0927 13:50:08.193647 (+1996329us) ts_tablet_manager.cc:1151] Deleting tablet 5aed7fe630f64213846ad37d904f6516
0927 13:50:08.193655 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.193701 (+ 46us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1996169}
I20260927 13:50:08.194309 5381 raft_consensus.cc:3060] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.195395 7435 tablet.cc:1751] T 20766b5a757e4a7e954c198f8c9ca41f P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:50:08.197381 5381 raft_consensus.cc:2468] T 3ee18063dc634385b9e61fae3b3ece99 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:50:08.197988 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d48db9b20a41419d5be703190fadd8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.198904 5319 leader_election.cc:304] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:08.200896 7098 tablet_replica.cc:333] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:08.201124 7098 raft_consensus.cc:2243] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.201315 7098 raft_consensus.cc:2272] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.201908 7098 ts_tablet_manager.cc:1916] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.070228 7449 tablet.cc:1751] T 78c4bbb0512c4411916eb4c48731f32f P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 13:50:08.064803 7446 tablet.cc:1751] T a81b44fb2f644dff899d6d4aa435ccee P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:08.188337 7265 raft_consensus.cc:2749] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.196393 5238 raft_consensus.cc:3060] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.203106 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 142) took 1640 ms. Trace:
I20260927 13:50:08.203783 7190 rpcz_store.cc:276] 0927 13:50:06.562452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.562511 (+ 59us) service_pool.cc:224] Handling call
0927 13:50:08.202726 (+1640215us) ts_tablet_manager.cc:1151] Deleting tablet 9f467925221b4cfdafeaa459b5c5adc0
0927 13:50:08.202736 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.203090 (+ 354us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1640036}
I20260927 13:50:08.205063 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 168) took 1164 ms. Trace:
I20260927 13:50:08.205502 7190 rpcz_store.cc:276] 0927 13:50:07.040507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:07.045794 (+ 5287us) service_pool.cc:224] Handling call
0927 13:50:08.204961 (+1159167us) ts_tablet_manager.cc:1151] Deleting tablet 97b46497d8254a248df8d421d0b09d8d
0927 13:50:08.204970 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.205048 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1158305}
W20260927 13:50:08.206254 5319 raft_consensus.cc:2686] T c48ca4b429294782a9e6ed496c6dfb72 P bb28c54312c94d7dafb1c2abf7870735: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:50:08.206714 5628 tablet_bootstrap.cc:492] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.206895 5628 ts_tablet_manager.cc:1403] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
W20260927 13:50:08.206930 5319 leader_election.cc:343] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.207855 6991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 13:50:08.207897 5628 raft_consensus.cc:359] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.208133 5628 raft_consensus.cc:385] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.208247 5628 raft_consensus.cc:740] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.208527 5628 consensus_queue.cc:260] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.209671 6991 hybrid_clock.cc:648] HybridClock initialized: now 1790517008209601 us; error 77 us; skew 500 ppm
I20260927 13:50:08.210016 5628 ts_tablet_manager.cc:1434] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 13:50:08.210197 6991 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 13:50:08.211263 5628 tablet_bootstrap.cc:492] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.213944 5628 tablet_bootstrap.cc:654] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.214375 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:08.214839 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:08.215359 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
I20260927 13:50:08.215793 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 0fe47041b75d492bbce62c95d90de021 (table default.Table_eabbc608c09045b095cdfe05e9660ac7 [id=a6d3f0f894904a738cc54fe5d8631f06]). Expected version 1 got 0
I20260927 13:50:08.216859 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]). Expected version 2 got 0
I20260927 13:50:08.217540 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet ead437e93bb14a73a820631b0be041aa (table default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]). Expected version 1 got 0
I20260927 13:50:08.218022 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 85debab98b0f42a5b50f1b0d132147d3 (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]). Expected version 1 got 0
I20260927 13:50:08.218456 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c655651f9cb24310a5aa2e5b84c2a455 (table default.Table_5c96e3711de04429a590499eb47d5784 [id=db63359dda9d4b729446d6ddf78c30b8]). Expected version 1 got 0
W20260927 13:50:08.214875 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 8ed33e78ee5448bcae633cc874c3e171 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ed33e78ee5448bcae633cc874c3e171 already in progress: creating tablet
I20260927 13:50:08.222741 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a4099c41981f46758a8f478d7fdb4182 (table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]). Expected version 1 got 0
I20260927 13:50:08.223352 7098 ts_tablet_manager.cc:1929] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:08.223495 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 3b26289ed050454d817c13159295ec37 (table default.Table_5b64a307e44a471598ef010e33a82fe3 [id=9c86bcdd37654832b7a92763aa42e6c4]). Expected version 1 got 0
I20260927 13:50:08.227728 7098 log.cc:1199] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/71268fb7aa9646639ea41dc8ccebfc5c
I20260927 13:50:08.227608 5628 tablet_bootstrap.cc:492] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.227982 5628 ts_tablet_manager.cc:1403] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260927 13:50:08.228956 5628 raft_consensus.cc:359] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.229178 5628 raft_consensus.cc:385] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.229271 5628 raft_consensus.cc:740] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:50:08.224404 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet e1e574bc8b544039b440a845966eb1d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1e574bc8b544039b440a845966eb1d4 already in progress: creating tablet
I20260927 13:50:08.229611 5628 consensus_queue.cc:260] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:08.229720 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 9f467925221b4cfdafeaa459b5c5adc0 because the tablet was not found. No further retry: Not found: Tablet not found: 9f467925221b4cfdafeaa459b5c5adc0
I20260927 13:50:08.230093 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 334b0349bfaa4a9c8b7d280177f1ecae (table default.Table_add07d0ee556457283038281d97f840b [id=28c3b0590cd643b988ee77d18c7afaec]) successfully deleted
W20260927 13:50:08.230342 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 95726f690a71433ca63f95da4ee750e5 because the tablet was not found. No further retry: Not found: Tablet not found: 95726f690a71433ca63f95da4ee750e5
W20260927 13:50:08.230575 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 5aed7fe630f64213846ad37d904f6516 because the tablet was not found. No further retry: Not found: Tablet not found: 5aed7fe630f64213846ad37d904f6516
I20260927 13:50:08.231462 5628 ts_tablet_manager.cc:1434] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 13:50:08.232571 5628 tablet_bootstrap.cc:492] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.232931 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6 (table default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]). Expected version 1 got 0
I20260927 13:50:08.233559 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 07830b76d7e14ff0b6b1b1523dda21bc (table default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]). Expected version 2 got 0
I20260927 13:50:08.233974 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]). Expected version 1 got 0
I20260927 13:50:08.234225 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]). Expected version 1 got 0
I20260927 13:50:08.234751 7098 ts_tablet_manager.cc:1950] T 71268fb7aa9646639ea41dc8ccebfc5c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:08.235426 5628 tablet_bootstrap.cc:654] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.236917 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 149) took 2040 ms. Trace:
I20260927 13:50:08.237872 7098 rpcz_store.cc:276] 0927 13:50:06.196825 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.197439 (+ 614us) service_pool.cc:224] Handling call
0927 13:50:08.200844 (+2003405us) ts_tablet_manager.cc:1151] Deleting tablet 71268fb7aa9646639ea41dc8ccebfc5c
0927 13:50:08.200856 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.216650 (+ 15794us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.223292 (+ 6642us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.236898 (+ 13606us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2003287}
I20260927 13:50:08.238365 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 150) took 2041 ms. Trace:
I20260927 13:50:08.238976 7098 rpcz_store.cc:276] 0927 13:50:06.196909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.197577 (+ 668us) service_pool.cc:224] Handling call
0927 13:50:08.238243 (+2040666us) ts_tablet_manager.cc:1151] Deleting tablet 24bd9a95e2d24242aba890ee9d01c023
0927 13:50:08.238252 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.238350 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2040560}
I20260927 13:50:08.241943 6779 raft_consensus.cc:493] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.242080 6779 raft_consensus.cc:515] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.242702 6779 leader_election.cc:290] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:08.243575 7098 tablet_replica.cc:333] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:08.243805 7098 raft_consensus.cc:2243] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.243992 7098 raft_consensus.cc:2272] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.244511 7098 ts_tablet_manager.cc:1916] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.248052 6991 webserver.cc:533] Webserver started at http://127.4.163.124:36383/ using document root <none> and password file <none>
I20260927 13:50:08.248749 5319 leader_election.cc:304] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:08.249382 5626 tablet_bootstrap.cc:492] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.243268 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4c143d5824458be4a42945c338dc9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.249897 7111 ts_tablet_manager.cc:1916] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.249539 5626 ts_tablet_manager.cc:1403] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.111s user 0.001s sys 0.006s
I20260927 13:50:08.251124 7265 consensus_queue.cc:1048] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.251368 6991 fs_manager.cc:362] Metadata directory not provided
I20260927 13:50:08.252565 5628 tablet_bootstrap.cc:492] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.252758 5628 ts_tablet_manager.cc:1403] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260927 13:50:08.253512 5628 raft_consensus.cc:359] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.253717 5628 raft_consensus.cc:385] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.253805 5628 raft_consensus.cc:740] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.254098 5628 consensus_queue.cc:260] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.255602 5628 ts_tablet_manager.cc:1434] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260927 13:50:08.256664 5628 tablet_bootstrap.cc:492] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.258376 5628 tablet_bootstrap.cc:654] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.258699 6991 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260927 13:50:08.263986 5044 leader_election.cc:343] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.265938 7098 ts_tablet_manager.cc:1929] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:08.266093 7098 log.cc:1199] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/e730a00ad2e646a4ba594ba9434c3b50
I20260927 13:50:08.266466 7098 ts_tablet_manager.cc:1950] T e730a00ad2e646a4ba594ba9434c3b50 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:08.266440 7412 raft_consensus.cc:2749] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.270797 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 151) took 2073 ms. Trace:
I20260927 13:50:08.270947 7098 rpcz_store.cc:276] 0927 13:50:06.197006 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.197766 (+ 760us) service_pool.cc:224] Handling call
0927 13:50:08.243533 (+2045767us) ts_tablet_manager.cc:1151] Deleting tablet e730a00ad2e646a4ba594ba9434c3b50
0927 13:50:08.243541 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.247763 (+ 4222us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.265887 (+ 18124us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.270778 (+ 4891us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2045638}
I20260927 13:50:08.271528 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 152) took 2074 ms. Trace:
I20260927 13:50:08.271860 7098 rpcz_store.cc:276] 0927 13:50:06.197094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.197922 (+ 828us) service_pool.cc:224] Handling call
0927 13:50:08.271440 (+2073518us) ts_tablet_manager.cc:1151] Deleting tablet 4b13c629908a47368846770c697aebd8
0927 13:50:08.271449 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.271514 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2073368}
I20260927 13:50:08.272588 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 153) took 2075 ms. Trace:
I20260927 13:50:08.272930 7098 rpcz_store.cc:276] 0927 13:50:06.197183 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.198099 (+ 916us) service_pool.cc:224] Handling call
0927 13:50:08.272491 (+2074392us) ts_tablet_manager.cc:1151] Deleting tablet 73546fba4ac846efbe9a9f4e346e4c21
0927 13:50:08.272498 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.272573 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2074236}
I20260927 13:50:08.273875 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 155) took 2076 ms. Trace:
I20260927 13:50:08.274222 7098 rpcz_store.cc:276] 0927 13:50:06.197398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.198293 (+ 895us) service_pool.cc:224] Handling call
0927 13:50:08.273783 (+2075490us) ts_tablet_manager.cc:1151] Deleting tablet 36181512a94c4702ae0a417665919faa
0927 13:50:08.273792 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.273859 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2075323}
I20260927 13:50:08.274735 5626 raft_consensus.cc:359] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.274909 5626 raft_consensus.cc:385] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.274972 5626 raft_consensus.cc:740] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.275195 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 156) took 2076 ms. Trace:
I20260927 13:50:08.275202 5626 consensus_queue.cc:260] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.275666 7098 rpcz_store.cc:276] 0927 13:50:06.198589 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.198629 (+ 40us) service_pool.cc:224] Handling call
0927 13:50:08.274828 (+2076199us) ts_tablet_manager.cc:1151] Deleting tablet 329fa4c25cec48f9830a8eb19794ea72
0927 13:50:08.274836 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.275180 (+ 344us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2076054}
I20260927 13:50:08.275876 5626 ts_tablet_manager.cc:1434] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260927 13:50:08.276573 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 148) took 2079 ms. Trace:
I20260927 13:50:08.277323 7098 rpcz_store.cc:276] 0927 13:50:06.196732 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.198938 (+ 2206us) service_pool.cc:224] Handling call
0927 13:50:08.276481 (+2077543us) ts_tablet_manager.cc:1151] Deleting tablet 614f1af61461466da975bea681162727
0927 13:50:08.276487 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.276557 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2077420}
I20260927 13:50:08.277232 5628 tablet_bootstrap.cc:492] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.277801 5628 ts_tablet_manager.cc:1403] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.003s
I20260927 13:50:08.278609 5628 raft_consensus.cc:359] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.278868 5628 raft_consensus.cc:385] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.278977 5628 raft_consensus.cc:740] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.279485 5628 consensus_queue.cc:260] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.281112 7265 consensus_queue.cc:1048] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.282070 5628 ts_tablet_manager.cc:1434] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 13:50:08.283305 5628 tablet_bootstrap.cc:492] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.285843 5628 tablet_bootstrap.cc:654] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.288230 5626 tablet_bootstrap.cc:492] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.288185 7394 tablet.cc:1751] T cbacda63c0d3427aabf3332b278576c5 P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 13:50:08.286063 7098 tablet_replica.cc:333] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:08.289618 7098 raft_consensus.cc:2243] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:08.289908 5626 tablet_bootstrap.cc:654] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.290053 7098 raft_consensus.cc:2272] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.290053 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]). Expected version 1 got 0
I20260927 13:50:08.290582 5045 leader_election.cc:304] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
W20260927 13:50:08.291003 5045 leader_election.cc:343] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.291097 5045 leader_election.cc:304] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.291632 6779 raft_consensus.cc:2804] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:08.291991 7388 raft_consensus.cc:2749] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.292132 7388 raft_consensus.cc:493] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.292220 7388 raft_consensus.cc:515] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.292857 7388 leader_election.cc:290] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:08.289551 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet f3f6a9c5e4be480796f433a68945dd72 (table default.Table_3e73c785e0d244c3ae23fc951d45174c [id=4538e58c268d44b59999b80f295c321d]) successfully deleted
I20260927 13:50:08.252218 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 71268fb7aa9646639ea41dc8ccebfc5c (table default.Table_cc0802f1f9f94b4b8f385d521fe95721 [id=eb6809c7866943b6b77be47fcee1e251]) successfully deleted
I20260927 13:50:08.293921 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e917382b6f3d4e009fa159ed38c342d8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:08.294173 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 24bd9a95e2d24242aba890ee9d01c023 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24bd9a95e2d24242aba890ee9d01c023 already in progress: creating tablet
I20260927 13:50:08.294440 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet e730a00ad2e646a4ba594ba9434c3b50 (table default.Table_ecc55f056cc941b8aa8dca7116d366bc [id=31cf8c2030814300a2b39d7ecccda6aa]) successfully deleted
W20260927 13:50:08.294732 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 4b13c629908a47368846770c697aebd8 because the tablet was not found. No further retry: Not found: Tablet not found: 4b13c629908a47368846770c697aebd8
W20260927 13:50:08.294971 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 73546fba4ac846efbe9a9f4e346e4c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73546fba4ac846efbe9a9f4e346e4c21 already in progress: creating tablet
W20260927 13:50:08.295218 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 36181512a94c4702ae0a417665919faa because the tablet was not found. No further retry: Not found: Tablet not found: 36181512a94c4702ae0a417665919faa
W20260927 13:50:08.296025 5044 leader_election.cc:343] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:08.296623 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 329fa4c25cec48f9830a8eb19794ea72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 329fa4c25cec48f9830a8eb19794ea72 already in progress: creating tablet
W20260927 13:50:08.296898 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 614f1af61461466da975bea681162727 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 614f1af61461466da975bea681162727 already in progress: creating tablet
W20260927 13:50:08.297106 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 97b46497d8254a248df8d421d0b09d8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97b46497d8254a248df8d421d0b09d8d already in progress: creating tablet
I20260927 13:50:08.297574 7449 tablet.cc:1751] T cbacda63c0d3427aabf3332b278576c5 P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 13:50:08.299299 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 78719428d7b34f28a99722b093f6ab54 (table default.Table_6d795d7a66ee42f3a7fb0cef447cddba [id=ed8d36823c5c43eaa1e8b0447c7f32e9]). Expected version 1 got 0
I20260927 13:50:08.299940 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc (table default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]). Expected version 1 got 0
I20260927 13:50:08.300325 7305 consensus_queue.cc:1048] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.303903 7394 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35946 (request call id 150) took 1741 ms. Trace:
I20260927 13:50:08.304286 7394 rpcz_store.cc:276] 0927 13:50:06.562045 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.562091 (+ 46us) service_pool.cc:224] Handling call
0927 13:50:08.303883 (+1741792us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.568988 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0927 13:50:06.569142 (+ 154us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 13:50:06.569152 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0927 13:50:06.569160 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0927 13:50:06.569211 (+ 51us) alter_schema_op.cc:128] START. Timestamp: 1790517006569114
0927 13:50:06.569214 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.569444 (+ 230us) log.cc:844] Serialized 173 byte log entry
0927 13:50:08.288052 (+1718608us) op_driver.cc:464] REPLICATION: finished
0927 13:50:08.288159 (+ 107us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0927 13:50:08.288715 (+ 556us) log.cc:844] Serialized 5 byte log entry
0927 13:50:08.295859 (+ 7144us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.303631 (+ 7772us) log.cc:844] Serialized 14 byte log entry
0927 13:50:08.303842 (+ 211us) alter_schema_op.cc:73] Released schema lock
0927 13:50:08.303847 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":57,"prepare.queue_time_us":6532,"prepare.run_cpu_time_us":2095,"prepare.run_wall_time_us":36533,"replication_time_us":1718800,"thread_start_us":35975,"threads_started":1,"wal-append.queue_time_us":35516,"wal-append.run_cpu_time_us":473,"wal-append.run_wall_time_us":1000520}]]}
I20260927 13:50:08.307085 7098 ts_tablet_manager.cc:1916] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.307695 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]). Expected version 1 got 0
I20260927 13:50:08.308243 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]). Expected version 2 got 0
I20260927 13:50:08.308622 7370 consensus_queue.cc:1048] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.308990 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]). Expected version 1 got 0
I20260927 13:50:08.309197 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 2cc7301d09b245328a851a0734669965 (table default.Table_7a5a607e5463433eb93aedb9f76696db [id=1f268483d3c7447abfe7a024dd0aec58]). Expected version 1 got 0
I20260927 13:50:08.309404 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:08.309691 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]). Expected version 2 got 0
I20260927 13:50:08.310422 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]). Expected version 1 got 0
I20260927 13:50:08.310627 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]). Expected version 1 got 0
I20260927 13:50:08.310904 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]). Expected version 1 got 0
I20260927 13:50:08.311769 5619 raft_consensus.cc:385] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.311918 5619 raft_consensus.cc:740] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.312119 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4c143d5824458be4a42945c338dc9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.312520 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e917382b6f3d4e009fa159ed38c342d8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.312721 5619 consensus_queue.cc:260] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.312919 5626 tablet_bootstrap.cc:492] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.313787 7461 tablet.cc:1751] T cbacda63c0d3427aabf3332b278576c5 P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260927 13:50:08.314055 5045 leader_election.cc:343] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.314194 5045 leader_election.cc:304] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:08.314615 5045 leader_election.cc:343] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.314713 5045 leader_election.cc:304] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.315038 7305 consensus_queue.cc:1048] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.315164 7428 raft_consensus.cc:2749] T fcf4c143d5824458be4a42945c338dc9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.315301 7428 raft_consensus.cc:2749] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.315442 7359 raft_consensus.cc:493] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.315558 7359 raft_consensus.cc:515] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.316140 7359 leader_election.cc:290] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:08.316397 5319 consensus_peers.cc:597] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e730a00ad2e646a4ba594ba9434c3b50. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:08.316592 7435 tablet.cc:1746] T 86ee31d13d1a4c3c99b9accb4e4f5cb6 P 34fc5fe0a32d42ab83f4aa6d07341409: Skipping requested alter to schema version 3, tablet already version 3
I20260927 13:50:08.317484 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82284e3fd1f4a2f95c7e47320abb30c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.318257 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82284e3fd1f4a2f95c7e47320abb30c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:08.318454 5096 raft_consensus.cc:2468] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:08.321396 7388 raft_consensus.cc:493] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.321547 7388 raft_consensus.cc:515] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.322170 7388 leader_election.cc:290] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.322772 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90d9bb192cf4e26812abb9c2ecc3682" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.323179 7359 raft_consensus.cc:493] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:50:08.323225 5044 leader_election.cc:343] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.323333 7359 raft_consensus.cc:515] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.323427 6779 raft_consensus.cc:697] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:50:08.313078 5626 ts_tablet_manager.cc:1403] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.003s
I20260927 13:50:08.323696 6779 consensus_queue.cc:237] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.323931 7359 leader_election.cc:290] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.328619 5619 ts_tablet_manager.cc:1434] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.170s user 0.014s sys 0.010s
I20260927 13:50:08.331126 5619 tablet_bootstrap.cc:492] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:08.338090 5619 tablet_bootstrap.cc:654] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.339824 5628 tablet_bootstrap.cc:492] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.340158 5628 ts_tablet_manager.cc:1403] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.057s user 0.006s sys 0.000s
I20260927 13:50:08.341527 5628 raft_consensus.cc:359] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.341797 5628 raft_consensus.cc:385] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.342101 5628 raft_consensus.cc:740] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.342410 5628 consensus_queue.cc:260] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.343060 5628 ts_tablet_manager.cc:1434] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:08.343662 5628 tablet_bootstrap.cc:492] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.343549 5626 raft_consensus.cc:359] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.343736 5626 raft_consensus.cc:385] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.343815 5626 raft_consensus.cc:740] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.345674 7098 ts_tablet_manager.cc:1929] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:08.346133 7203 consensus_queue.cc:1048] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.346621 6991 fs_manager.cc:714] Time spent opening directory manager: real 0.076s user 0.006s sys 0.004s
I20260927 13:50:08.346798 7098 log.cc:1199] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/c48ca4b429294782a9e6ed496c6dfb72
I20260927 13:50:08.347277 7098 ts_tablet_manager.cc:1950] T c48ca4b429294782a9e6ed496c6dfb72 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:08.346710 5628 tablet_bootstrap.cc:654] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.347908 5626 consensus_queue.cc:260] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.349651 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 146) took 2153 ms. Trace:
I20260927 13:50:08.350644 5626 ts_tablet_manager.cc:1434] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260927 13:50:08.350790 7098 rpcz_store.cc:276] 0927 13:50:06.196518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.199088 (+ 2570us) service_pool.cc:224] Handling call
0927 13:50:08.286016 (+2086928us) ts_tablet_manager.cc:1151] Deleting tablet c48ca4b429294782a9e6ed496c6dfb72
0927 13:50:08.286027 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.327171 (+ 41144us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.345615 (+ 18444us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.349630 (+ 4015us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2086778}
I20260927 13:50:08.351365 7098 tablet_replica.cc:333] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:08.351387 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet c48ca4b429294782a9e6ed496c6dfb72 (table default.Table_7a48c16d7a32465cbc86892633257ea3 [id=49b35f9188a141e4af0afc5b3d2fd897]) successfully deleted
I20260927 13:50:08.351677 7098 raft_consensus.cc:2243] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.351898 7098 raft_consensus.cc:2272] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.353041 5619 tablet_bootstrap.cc:492] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:08.353219 5619 ts_tablet_manager.cc:1403] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.004s
I20260927 13:50:08.353585 5626 tablet_bootstrap.cc:492] T c44dc61b4003469e8f404b73f22f7291 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.353972 7098 ts_tablet_manager.cc:1916] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.354030 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec130d31f6274fd9b730c2bb8bba817e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.354377 5619 raft_consensus.cc:359] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.355193 5619 raft_consensus.cc:385] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.355258 5619 raft_consensus.cc:740] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.355487 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90d9bb192cf4e26812abb9c2ecc3682" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.355868 5619 consensus_queue.cc:260] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.356087 5626 tablet_bootstrap.cc:654] T c44dc61b4003469e8f404b73f22f7291 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.356940 5319 leader_election.cc:304] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:08.357455 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]). Expected version 1 got 0
I20260927 13:50:08.357689 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]). Expected version 1 got 0
I20260927 13:50:08.358021 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 9e808336f5b746d486d375695536c052 (table default.Table_36609f3408124349b504ae9eb3275d87 [id=d088563f44224b01a3eba63ce70e5681]). Expected version 1 got 0
I20260927 13:50:08.358265 5619 ts_tablet_manager.cc:1434] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:50:08.358425 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]). Expected version 2 got 0
I20260927 13:50:08.358700 7305 raft_consensus.cc:2804] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:08.358776 7305 raft_consensus.cc:493] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:08.358863 7305 raft_consensus.cc:3060] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.360004 5619 tablet_bootstrap.cc:492] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:08.361629 7305 raft_consensus.cc:515] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.361830 5619 tablet_bootstrap.cc:654] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.362701 7305 leader_election.cc:290] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:08.367125 5319 leader_election.cc:343] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: ec130d31f6274fd9b730c2bb8bba817e
W20260927 13:50:08.367650 5319 leader_election.cc:343] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.369720 5619 tablet_bootstrap.cc:492] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:08.369854 5619 ts_tablet_manager.cc:1403] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260927 13:50:08.370628 5628 tablet_bootstrap.cc:492] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.370570 5619 raft_consensus.cc:359] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.370668 7111 ts_tablet_manager.cc:1929] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:08.370716 5619 raft_consensus.cc:385] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.370748 7111 log.cc:1199] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/84d9c94ee0af46e8aea12adac57829f7
I20260927 13:50:08.370774 5619 raft_consensus.cc:740] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.371112 5628 ts_tablet_manager.cc:1403] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.003s
I20260927 13:50:08.371142 7111 ts_tablet_manager.cc:1950] T 84d9c94ee0af46e8aea12adac57829f7 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:08.371781 7491 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 13:50:08.371845 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 143) took 1901 ms. Trace:
I20260927 13:50:08.371923 5628 raft_consensus.cc:359] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.371927 7111 rpcz_store.cc:276] 0927 13:50:06.470141 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.470186 (+ 45us) service_pool.cc:224] Handling call
0927 13:50:08.193139 (+1722953us) ts_tablet_manager.cc:1151] Deleting tablet 84d9c94ee0af46e8aea12adac57829f7
0927 13:50:08.193154 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.280958 (+ 87804us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.370617 (+ 89659us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.371814 (+ 1197us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1710429}
I20260927 13:50:08.372078 5619 consensus_queue.cc:260] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.372222 7111 tablet_replica.cc:333] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:08.372285 5626 tablet_bootstrap.cc:492] T c44dc61b4003469e8f404b73f22f7291 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.372200 5628 raft_consensus.cc:385] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.372397 7111 raft_consensus.cc:2243] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:08.372450 5626 ts_tablet_manager.cc:1403] T c44dc61b4003469e8f404b73f22f7291 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.001s
I20260927 13:50:08.372430 5628 raft_consensus.cc:740] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.372792 5628 consensus_queue.cc:260] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:08.372887 5319 leader_election.cc:343] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.372985 5319 leader_election.cc:304] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:08.373173 5626 raft_consensus.cc:359] T c44dc61b4003469e8f404b73f22f7291 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.373363 5626 raft_consensus.cc:385] T c44dc61b4003469e8f404b73f22f7291 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.373446 5626 raft_consensus.cc:740] T c44dc61b4003469e8f404b73f22f7291 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.373665 5626 consensus_queue.cc:260] T c44dc61b4003469e8f404b73f22f7291 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.375367 5626 ts_tablet_manager.cc:1434] T c44dc61b4003469e8f404b73f22f7291 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:08.375777 5619 ts_tablet_manager.cc:1434] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:50:08.373740 5628 ts_tablet_manager.cc:1434] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:08.377084 7423 raft_consensus.cc:2749] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.377333 5628 tablet_bootstrap.cc:492] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.377453 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]). Expected version 1 got 0
I20260927 13:50:08.378343 5626 tablet_bootstrap.cc:492] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:08.378312 5045 leader_election.cc:343] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.378469 5045 leader_election.cc:304] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.378963 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82284e3fd1f4a2f95c7e47320abb30c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:08.379385 6779 raft_consensus.cc:2749] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.380435 5626 tablet_bootstrap.cc:654] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.381117 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
I20260927 13:50:08.381407 6453 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]). Expected version 1 got 0
I20260927 13:50:08.381850 5619 tablet_bootstrap.cc:492] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:08.383841 6991 fs_manager.cc:730] Time spent opening block manager: real 0.033s user 0.005s sys 0.001s
I20260927 13:50:08.384684 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 84d9c94ee0af46e8aea12adac57829f7 (table default.Table_7ac056af78a84ab9b807aaed0fcf7c6a [id=4d64253f01f048778ee2ff75d95535ef]) successfully deleted
W20260927 13:50:08.385722 5319 leader_election.cc:343] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.386245 5628 tablet_bootstrap.cc:654] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.384718 6991 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data,/tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal
uuid: "802b83f09d3445359cfac825cd87c9de"
format_stamp: "Formatted at 2026-09-27 13:49:39 on dist-test-slave-bkfv"
I20260927 13:50:08.387742 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82284e3fd1f4a2f95c7e47320abb30c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:08.387909 5108 raft_consensus.cc:3060] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.387673 6991 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 13:50:08.391620 7098 ts_tablet_manager.cc:1929] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:08.391804 7098 log.cc:1199] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/50bc839e0fc54839a5d06c176760f618
I20260927 13:50:08.392243 7098 ts_tablet_manager.cc:1950] T 50bc839e0fc54839a5d06c176760f618 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:08.393277 5108 raft_consensus.cc:2468] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:08.393865 5619 tablet_bootstrap.cc:654] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.394832 7203 raft_consensus.cc:493] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.394995 7203 raft_consensus.cc:515] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.395663 7203 leader_election.cc:290] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.396008 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0827a26334c42728545a9eaa006fae0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:08.396944 6442 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e77aba9467864ad7ac9c1931c2162eef consensus state has no leader
I20260927 13:50:08.397140 6442 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:34390 (request call id 109) took 2653 ms. Trace:
I20260927 13:50:08.397221 6442 rpcz_store.cc:276] 0927 13:50:05.743675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.744077 (+1000402us) service_pool.cc:224] Handling call
0927 13:50:06.744514 (+ 437us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:06.744707 (+ 193us) catalog_manager.cc:3764] Apply alter schema
0927 13:50:06.903780 (+159073us) catalog_manager.cc:3796] Acquired catalog manager lock
0927 13:50:06.907051 (+ 3271us) catalog_manager.cc:3954] Updating metadata on disk
0927 13:50:06.920065 (+ 13014us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.920072 (+ 7us) write_op.cc:454] Released schema lock
0927 13:50:06.920175 (+ 103us) catalog_manager.cc:3985] Committing alterations to in-memory state
0927 13:50:08.397085 (+1476910us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.909931 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.910037 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.910046 (+ 9us) write_op.cc:435] Acquired schema lock
0927 13:50:06.910048 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:06.910169 (+ 121us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.910184 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.910188 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0927 13:50:06.910273 (+ 85us) tablet.cc:701] Row locks acquired
0927 13:50:06.910275 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:50:06.910313 (+ 38us) write_op.cc:270] Start()
0927 13:50:06.910352 (+ 39us) write_op.cc:276] Timestamp: P: 1790517006910281 usec, L: 0
0927 13:50:06.910355 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.910561 (+ 206us) log.cc:844] Serialized 405 byte log entry
0927 13:50:06.915725 (+ 5164us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.915876 (+ 151us) write_op.cc:301] APPLY: starting
0927 13:50:06.915895 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.915936 (+ 41us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.915960 (+ 24us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.916048 (+ 88us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.916090 (+ 42us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:06.916103 (+ 13us) write_op.cc:312] APPLY: finished
0927 13:50:06.916185 (+ 82us) log.cc:844] Serialized 23 byte log entry
0927 13:50:06.916261 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.916284 (+ 23us) write_op.cc:454] Released schema lock
0927 13:50:06.916293 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":474,"apply.run_wall_time_us":474,"num_ops":1,"prepare.queue_time_us":2334,"prepare.run_cpu_time_us":762,"prepare.run_wall_time_us":762,"raft.queue_time_us":1289,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":278,"replication_time_us":5340}]]}
I20260927 13:50:08.398420 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0827a26334c42728545a9eaa006fae0" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:08.398609 5108 raft_consensus.cc:2393] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:08.399080 5184 leader_election.cc:304] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.399471 6779 raft_consensus.cc:493] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.399581 6779 raft_consensus.cc:515] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.400127 6779 leader_election.cc:290] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.400599 7203 raft_consensus.cc:3060] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.400808 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d6a3af321049b099e72dbfeb6b7a24" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.401510 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 147) took 2204 ms. Trace:
I20260927 13:50:08.401598 7098 rpcz_store.cc:276] 0927 13:50:06.196641 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.199266 (+ 2625us) service_pool.cc:224] Handling call
0927 13:50:08.351312 (+2152046us) ts_tablet_manager.cc:1151] Deleting tablet 50bc839e0fc54839a5d06c176760f618
0927 13:50:08.351322 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.363440 (+ 12118us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.391559 (+ 28119us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.401488 (+ 9929us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2089,"tablet-delete.queue_time_us":2151896}
I20260927 13:50:08.402132 7098 tablet_replica.cc:333] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:08.402195 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 50bc839e0fc54839a5d06c176760f618 (table default.Table_16dc00b04267495ea0bf7b352b433889 [id=02b943faad65425ba6058acef5bff0eb]) successfully deleted
I20260927 13:50:08.402452 7098 raft_consensus.cc:2243] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.402756 7098 raft_consensus.cc:2272] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.403326 7203 raft_consensus.cc:2749] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:08.403565 5044 leader_election.cc:343] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.407529 7098 ts_tablet_manager.cc:1916] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.408906 7424 raft_consensus.cc:493] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.409041 7424 raft_consensus.cc:515] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.409595 7424 leader_election.cc:290] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.414076 7098 ts_tablet_manager.cc:1929] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:08.417353 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e2e305b92a4492a0df14a506c768f3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.418423 6447 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 187b3ceeccb142c4b798947e584d6044
I20260927 13:50:08.419231 6447 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34390 (request call id 108) took 2774 ms. Trace:
I20260927 13:50:08.419430 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 187b3ceeccb142c4b798947e584d6044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.419354 6447 rpcz_store.cc:276] 0927 13:50:05.644419 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.729987 (+1085568us) service_pool.cc:224] Handling call
0927 13:50:06.731224 (+ 1237us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:06.731381 (+ 157us) catalog_manager.cc:2854] Modifying in-memory table state
0927 13:50:06.731463 (+ 82us) catalog_manager.cc:2863] Locking tablets
0927 13:50:07.003734 (+272271us) catalog_manager.cc:2877] Removing table and tablets from system table
0927 13:50:07.011156 (+ 7422us) catalog_manager.cc:2895] Removing table from by-name map
0927 13:50:07.011257 (+ 101us) catalog_manager.cc:2911] Committing in-memory state
0927 13:50:08.418364 (+1407107us) catalog_manager.cc:2915] Aborting table tasks
0927 13:50:08.419142 (+ 778us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:07.004593 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:07.004727 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:07.004737 (+ 10us) write_op.cc:435] Acquired schema lock
0927 13:50:07.004741 (+ 4us) tablet.cc:662] Decoding operations
0927 13:50:07.004863 (+ 122us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:07.004881 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:07.004886 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:07.004995 (+ 109us) tablet.cc:701] Row locks acquired
0927 13:50:07.004998 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:07.005036 (+ 38us) write_op.cc:270] Start()
0927 13:50:07.005072 (+ 36us) write_op.cc:276] Timestamp: P: 1790517007004996 usec, L: 0
0927 13:50:07.005078 (+ 6us) op_driver.cc:348] REPLICATION: starting
0927 13:50:07.005292 (+ 214us) log.cc:844] Serialized 759 byte log entry
0927 13:50:07.009578 (+ 4286us) op_driver.cc:464] REPLICATION: finished
0927 13:50:07.009739 (+ 161us) write_op.cc:301] APPLY: starting
0927 13:50:07.009759 (+ 20us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:07.009806 (+ 47us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:07.009842 (+ 36us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:07.009938 (+ 96us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:07.009979 (+ 41us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:50:07.009991 (+ 12us) write_op.cc:312] APPLY: finished
0927 13:50:07.010076 (+ 85us) log.cc:844] Serialized 29 byte log entry
0927 13:50:07.010156 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:07.010180 (+ 24us) write_op.cc:454] Released schema lock
0927 13:50:07.010188 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:07.010290 (+ 102us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:07.010297 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":95,"apply.run_cpu_time_us":537,"apply.run_wall_time_us":537,"num_ops":2,"prepare.queue_time_us":57,"prepare.run_cpu_time_us":835,"prepare.run_wall_time_us":835,"raft.queue_time_us":919,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":281,"replication_time_us":4466}]]}
W20260927 13:50:08.420101 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 187b3ceeccb142c4b798947e584d6044 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 187b3ceeccb142c4b798947e584d6044 already in progress: creating tablet
I20260927 13:50:08.421355 6779 raft_consensus.cc:493] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.421438 7098 log.cc:1199] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/f702b0a6380543a8ac539125d4334cd5
I20260927 13:50:08.421514 6779 raft_consensus.cc:515] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.421860 7098 ts_tablet_manager.cc:1950] T f702b0a6380543a8ac539125d4334cd5 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:08.422156 6779 leader_election.cc:290] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.419420 5074 tablet_service.cc:1558] Processing DeleteTablet for tablet 187b3ceeccb142c4b798947e584d6044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:08.422775 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 157) took 2223 ms. Trace:
I20260927 13:50:08.422966 5626 tablet_bootstrap.cc:492] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.423120 5626 ts_tablet_manager.cc:1403] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.002s
I20260927 13:50:08.423055 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb99ad45d1445cb2e2854319a3d73d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.424021 5626 raft_consensus.cc:359] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.424192 5626 raft_consensus.cc:385] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.424263 5626 raft_consensus.cc:740] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.424468 5626 consensus_queue.cc:260] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:08.426059 5184 consensus_peers.cc:597] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 334b0349bfaa4a9c8b7d280177f1ecae. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:08.426430 5626 ts_tablet_manager.cc:1434] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260927 13:50:08.423532 5044 leader_election.cc:343] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.426723 7098 rpcz_store.cc:276] 0927 13:50:06.198899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.199460 (+ 561us) service_pool.cc:224] Handling call
0927 13:50:08.402057 (+2202597us) ts_tablet_manager.cc:1151] Deleting tablet f702b0a6380543a8ac539125d4334cd5
0927 13:50:08.402067 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.411028 (+ 8961us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.414028 (+ 3000us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.422753 (+ 8725us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2202472}
I20260927 13:50:08.427631 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet f702b0a6380543a8ac539125d4334cd5 (table default.Table_f62fc7820ff54165afff30f8e47b56ab [id=779da161cdef4cec9d98cfa465f747d6]) successfully deleted
I20260927 13:50:08.427470 5626 tablet_bootstrap.cc:492] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.428114 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 158) took 2228 ms. Trace:
I20260927 13:50:08.428743 7098 rpcz_store.cc:276] 0927 13:50:06.199733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.199796 (+ 63us) service_pool.cc:224] Handling call
0927 13:50:08.428025 (+2228229us) ts_tablet_manager.cc:1151] Deleting tablet ec130d31f6274fd9b730c2bb8bba817e
0927 13:50:08.428035 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.428098 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2228094}
W20260927 13:50:08.429617 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet ec130d31f6274fd9b730c2bb8bba817e because the tablet was not found. No further retry: Not found: Tablet not found: ec130d31f6274fd9b730c2bb8bba817e
I20260927 13:50:08.429963 7098 tablet_replica.cc:333] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:08.430294 7098 raft_consensus.cc:2243] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.430765 5626 tablet_bootstrap.cc:654] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.430487 5628 tablet_bootstrap.cc:492] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.431005 5628 ts_tablet_manager.cc:1403] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.009s
I20260927 13:50:08.431077 7098 raft_consensus.cc:2272] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.431624 7098 ts_tablet_manager.cc:1916] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.431685 7370 consensus_queue.cc:1048] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.431744 5628 raft_consensus.cc:359] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.431917 5628 raft_consensus.cc:385] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.431970 5628 raft_consensus.cc:740] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.432165 5628 consensus_queue.cc:260] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.432600 5628 ts_tablet_manager.cc:1434] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:08.432865 5628 tablet_bootstrap.cc:492] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.434468 6454 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 52050d7e35dc4fbab3c7c079d07478e8
I20260927 13:50:08.435094 6454 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34390 (request call id 101) took 2991 ms. Trace:
I20260927 13:50:08.435361 5074 tablet_service.cc:1558] Processing DeleteTablet for tablet 52050d7e35dc4fbab3c7c079d07478e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:08.435202 6454 rpcz_store.cc:276] 0927 13:50:05.443905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.120010 (+676105us) service_pool.cc:224] Handling call
0927 13:50:06.120525 (+ 515us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:06.120662 (+ 137us) catalog_manager.cc:2854] Modifying in-memory table state
0927 13:50:06.120726 (+ 64us) catalog_manager.cc:2863] Locking tablets
0927 13:50:06.120887 (+ 161us) catalog_manager.cc:2877] Removing table and tablets from system table
0927 13:50:06.137163 (+ 16276us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.137168 (+ 5us) write_op.cc:454] Released schema lock
0927 13:50:06.137242 (+ 74us) catalog_manager.cc:2895] Removing table from by-name map
0927 13:50:06.137308 (+ 66us) catalog_manager.cc:2911] Committing in-memory state
0927 13:50:08.434385 (+2297077us) catalog_manager.cc:2915] Aborting table tasks
0927 13:50:08.435045 (+ 660us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.121672 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.121779 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.121784 (+ 5us) write_op.cc:435] Acquired schema lock
0927 13:50:06.121786 (+ 2us) tablet.cc:662] Decoding operations
0927 13:50:06.121907 (+ 121us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.121920 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.121925 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.122045 (+ 120us) tablet.cc:701] Row locks acquired
0927 13:50:06.122047 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:50:06.122081 (+ 34us) write_op.cc:270] Start()
0927 13:50:06.122132 (+ 51us) write_op.cc:276] Timestamp: P: 1790517006122039 usec, L: 0
0927 13:50:06.122136 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.122320 (+ 184us) log.cc:844] Serialized 762 byte log entry
0927 13:50:06.126149 (+ 3829us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.126711 (+ 562us) write_op.cc:301] APPLY: starting
0927 13:50:06.126728 (+ 17us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.126772 (+ 44us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.126795 (+ 23us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.126887 (+ 92us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.126920 (+ 33us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:50:06.126927 (+ 7us) write_op.cc:312] APPLY: finished
0927 13:50:06.127001 (+ 74us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.127229 (+ 228us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.127250 (+ 21us) write_op.cc:454] Released schema lock
0927 13:50:06.127257 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":499,"apply.run_cpu_time_us":443,"apply.run_wall_time_us":604,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":750,"prepare.run_wall_time_us":750,"raft.queue_time_us":148,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":243,"replication_time_us":3965}]]}
I20260927 13:50:08.436662 5628 tablet_bootstrap.cc:654] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.438820 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 52050d7e35dc4fbab3c7c079d07478e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.439095 7190 tablet_replica.cc:333] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:08.439392 7190 raft_consensus.cc:2243] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.439582 7190 raft_consensus.cc:2272] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.440085 7190 ts_tablet_manager.cc:1916] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.448186 7190 ts_tablet_manager.cc:1929] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:08.448650 7190 log.cc:1199] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/52050d7e35dc4fbab3c7c079d07478e8
I20260927 13:50:08.449220 7190 ts_tablet_manager.cc:1950] T 52050d7e35dc4fbab3c7c079d07478e8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:08.451874 7370 consensus_queue.cc:1048] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.452615 5628 tablet_bootstrap.cc:492] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.452837 5628 ts_tablet_manager.cc:1403] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.003s
I20260927 13:50:08.453394 7370 consensus_queue.cc:1048] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.453748 5628 raft_consensus.cc:359] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.453994 5628 raft_consensus.cc:385] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.454129 5628 raft_consensus.cc:740] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.454432 5628 consensus_queue.cc:260] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.455005 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 52050d7e35dc4fbab3c7c079d07478e8 (table default.Table_8bd375289d574bfeba1cc363b93ad32f [id=77004a3da7944e7a9b9a4d2fa36021c3]) successfully deleted
I20260927 13:50:08.456013 5628 ts_tablet_manager.cc:1434] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:08.456682 7098 ts_tablet_manager.cc:1929] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:08.457437 6455 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet c16673cfe45f4c81806f4dda3246d476
I20260927 13:50:08.457995 7098 log.cc:1199] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a9503dd46ccf472581d1a667eea300ed
I20260927 13:50:08.458477 5074 tablet_service.cc:1558] Processing DeleteTablet for tablet c16673cfe45f4c81806f4dda3246d476 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:08.458564 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet c16673cfe45f4c81806f4dda3246d476 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.458599 6445 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 50c2661998134488a95b4750d0e653a6
I20260927 13:50:08.459491 7098 ts_tablet_manager.cc:1950] T a9503dd46ccf472581d1a667eea300ed P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:08.461036 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 159) took 2260 ms. Trace:
I20260927 13:50:08.463073 7098 rpcz_store.cc:276] 0927 13:50:06.200391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.200435 (+ 44us) service_pool.cc:224] Handling call
0927 13:50:08.429660 (+2229225us) ts_tablet_manager.cc:1151] Deleting tablet a9503dd46ccf472581d1a667eea300ed
0927 13:50:08.429670 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.439265 (+ 9595us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.456618 (+ 17353us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.461011 (+ 4393us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2229067}
I20260927 13:50:08.464475 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 160) took 2263 ms. Trace:
I20260927 13:50:08.465211 7098 rpcz_store.cc:276] 0927 13:50:06.200766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.200810 (+ 44us) service_pool.cc:224] Handling call
0927 13:50:08.464363 (+2263553us) ts_tablet_manager.cc:1151] Deleting tablet 12dd91ddaeff4f2a9d7a0761c08fc192
0927 13:50:08.464374 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.464456 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2263413}
W20260927 13:50:08.466262 6429 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 95726f690a71433ca63f95da4ee750e5 (table default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 95726f690a71433ca63f95da4ee750e5 consensus state has no leader
I20260927 13:50:08.466353 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 161) took 2265 ms. Trace:
I20260927 13:50:08.466815 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a9503dd46ccf472581d1a667eea300ed (table default.Table_06ee1270c5734798871c56d5e91a8a1d [id=4837357d958c4b8c8669d79813ef1a2b]) successfully deleted
I20260927 13:50:08.466925 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 50c2661998134488a95b4750d0e653a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:44390
W20260927 13:50:08.467127 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 because the tablet was not found. No further retry: Not found: Tablet not found: 12dd91ddaeff4f2a9d7a0761c08fc192
I20260927 13:50:08.466883 7098 rpcz_store.cc:276] 0927 13:50:06.201265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.201426 (+ 161us) service_pool.cc:224] Handling call
0927 13:50:08.466262 (+2264836us) ts_tablet_manager.cc:1151] Deleting tablet 496cffc2a8774185a0e0f63208bed8a5
0927 13:50:08.466270 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.466328 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2264691}
W20260927 13:50:08.467368 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet c16673cfe45f4c81806f4dda3246d476 because the tablet was not found. No further retry: Not found: Tablet not found: c16673cfe45f4c81806f4dda3246d476
W20260927 13:50:08.467619 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 50c2661998134488a95b4750d0e653a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50c2661998134488a95b4750d0e653a6 already in progress: creating tablet
W20260927 13:50:08.467914 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 496cffc2a8774185a0e0f63208bed8a5 because the tablet was not found. No further retry: Not found: Tablet not found: 496cffc2a8774185a0e0f63208bed8a5
I20260927 13:50:08.468286 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 162) took 2266 ms. Trace:
I20260927 13:50:08.468858 7098 rpcz_store.cc:276] 0927 13:50:06.201387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.201654 (+ 267us) service_pool.cc:224] Handling call
0927 13:50:08.467968 (+2266314us) ts_tablet_manager.cc:1151] Deleting tablet b9a1193719e140beb9b492927adeb78c
0927 13:50:08.467978 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.468270 (+ 292us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2266176}
I20260927 13:50:08.469753 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 163) took 2267 ms. Trace:
W20260927 13:50:08.469933 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b9a1193719e140beb9b492927adeb78c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a1193719e140beb9b492927adeb78c already in progress: creating tablet
I20260927 13:50:08.470598 7098 rpcz_store.cc:276] 0927 13:50:06.201978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.202019 (+ 41us) service_pool.cc:224] Handling call
0927 13:50:08.469636 (+2267617us) ts_tablet_manager.cc:1151] Deleting tablet 370553521753488ab81e40144f2536ae
0927 13:50:08.469645 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.469734 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2267461}
W20260927 13:50:08.471499 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 370553521753488ab81e40144f2536ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 370553521753488ab81e40144f2536ae already in progress: creating tablet
I20260927 13:50:08.471560 7098 tablet_replica.cc:333] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:08.472205 7098 raft_consensus.cc:2243] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.472920 7098 raft_consensus.cc:2272] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.457139 5628 tablet_bootstrap.cc:492] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.475746 5628 tablet_bootstrap.cc:654] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.478643 5626 tablet_bootstrap.cc:492] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.478855 5626 ts_tablet_manager.cc:1403] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.003s
I20260927 13:50:08.480036 5626 raft_consensus.cc:359] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.480257 5626 raft_consensus.cc:385] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.480346 5626 raft_consensus.cc:740] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.480598 5626 consensus_queue.cc:260] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.482556 5626 ts_tablet_manager.cc:1434] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:50:08.484524 5626 tablet_bootstrap.cc:492] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.473944 7098 ts_tablet_manager.cc:1916] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.488583 5626 tablet_bootstrap.cc:654] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.496667 7359 raft_consensus.cc:493] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.496821 7359 raft_consensus.cc:515] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.497488 7359 leader_election.cc:290] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.501519 5628 tablet_bootstrap.cc:492] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.501660 5628 ts_tablet_manager.cc:1403] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260927 13:50:08.502360 5628 raft_consensus.cc:359] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.502506 5628 raft_consensus.cc:385] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.502549 5628 raft_consensus.cc:740] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.502471 5319 leader_election.cc:304] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:08.502731 5628 consensus_queue.cc:260] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.503198 5628 ts_tablet_manager.cc:1434] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260927 13:50:08.503249 5319 leader_election.cc:343] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 98e2e305b92a4492a0df14a506c768f3
I20260927 13:50:08.503460 5628 tablet_bootstrap.cc:492] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.504572 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d6a3af321049b099e72dbfeb6b7a24" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.505236 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb99ad45d1445cb2e2854319a3d73d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.505512 5628 tablet_bootstrap.cc:654] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.505772 7424 raft_consensus.cc:2804] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:08.505894 7424 raft_consensus.cc:697] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
W20260927 13:50:08.506412 5319 leader_election.cc:343] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.506608 5319 leader_election.cc:304] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:08.506928 7388 raft_consensus.cc:493] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.507045 7388 raft_consensus.cc:515] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.507618 7388 leader_election.cc:290] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.507750 7388 raft_consensus.cc:493] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.507787 7305 raft_consensus.cc:2749] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.507838 7388 raft_consensus.cc:515] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.508262 7388 leader_election.cc:290] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.508438 7111 raft_consensus.cc:2272] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.509101 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf052a0645154d4c837a372173b8f610" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.509534 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1436bcea966646969789e6e09f91c557" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:08.509922 5044 leader_election.cc:343] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:08.510154 5044 leader_election.cc:343] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.510440 7370 raft_consensus.cc:493] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.510581 7370 raft_consensus.cc:515] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.510850 7424 consensus_queue.cc:237] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.510962 7111 ts_tablet_manager.cc:1916] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.511158 7370 leader_election.cc:290] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.512145 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9503dd46ccf472581d1a667eea300ed" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:08.513134 5184 leader_election.cc:343] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a9503dd46ccf472581d1a667eea300ed
I20260927 13:50:08.513351 5184 leader_election.cc:304] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.513849 7370 raft_consensus.cc:2749] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.514957 7098 ts_tablet_manager.cc:1929] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:08.515123 7098 log.cc:1199] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/0076228c3f224d1f9d76ccf2dd7064ae
I20260927 13:50:08.515475 7098 ts_tablet_manager.cc:1950] T 0076228c3f224d1f9d76ccf2dd7064ae P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:08.516288 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 164) took 2215 ms. Trace:
I20260927 13:50:08.516471 7098 rpcz_store.cc:276] 0927 13:50:06.301175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.301239 (+ 64us) service_pool.cc:224] Handling call
0927 13:50:08.471515 (+2170276us) ts_tablet_manager.cc:1151] Deleting tablet 0076228c3f224d1f9d76ccf2dd7064ae
0927 13:50:08.471525 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.495344 (+ 23819us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.514898 (+ 19554us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.516268 (+ 1370us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2170082}
I20260927 13:50:08.517197 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 165) took 2198 ms. Trace:
I20260927 13:50:08.517247 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 0076228c3f224d1f9d76ccf2dd7064ae (table default.Table_bf1d966c56b941bab74f8fe4cef3bbb6 [id=f07c60c3feb741e4b9dda75a2ab5660e]) successfully deleted
I20260927 13:50:08.517720 7098 rpcz_store.cc:276] 0927 13:50:06.318925 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.318980 (+ 55us) service_pool.cc:224] Handling call
0927 13:50:08.517078 (+2198098us) ts_tablet_manager.cc:1151] Deleting tablet 2e768c83fae54619ac849dfedd5ec654
0927 13:50:08.517088 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.517181 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2197877}
I20260927 13:50:08.518368 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 166) took 2198 ms. Trace:
W20260927 13:50:08.518720 6429 consensus_peers.cc:597] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c -> Peer 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095): Couldn't send request to peer 802b83f09d3445359cfac825cd87c9de. Status: Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260927 13:50:08.518770 7098 rpcz_store.cc:276] 0927 13:50:06.319443 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.319496 (+ 53us) service_pool.cc:224] Handling call
0927 13:50:08.518267 (+2198771us) ts_tablet_manager.cc:1151] Deleting tablet dd0126a6df14457ca5c62c129f3275f8
0927 13:50:08.518276 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.518353 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2198594}
I20260927 13:50:08.519601 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 167) took 2199 ms. Trace:
I20260927 13:50:08.520108 7098 rpcz_store.cc:276] 0927 13:50:06.320597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.320643 (+ 46us) service_pool.cc:224] Handling call
0927 13:50:08.519470 (+2198827us) ts_tablet_manager.cc:1151] Deleting tablet 26a8aca52f8c4566b274d13e6bb13ce5
0927 13:50:08.519482 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.519583 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2198672}
I20260927 13:50:08.520620 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 168) took 2199 ms. Trace:
I20260927 13:50:08.521003 7098 rpcz_store.cc:276] 0927 13:50:06.321512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.321551 (+ 39us) service_pool.cc:224] Handling call
0927 13:50:08.520533 (+2198982us) ts_tablet_manager.cc:1151] Deleting tablet c99bf2abdfc64f169a3937f3e4499f75
0927 13:50:08.520541 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.520608 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2198837}
I20260927 13:50:08.521569 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 169) took 2199 ms. Trace:
I20260927 13:50:08.521658 6779 raft_consensus.cc:493] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.526366 6779 raft_consensus.cc:515] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.526362 7098 rpcz_store.cc:276] 0927 13:50:06.322171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.322210 (+ 39us) service_pool.cc:224] Handling call
0927 13:50:08.521448 (+2199238us) ts_tablet_manager.cc:1151] Deleting tablet a003afa0fbb74d548cfaba51ea6cef58
0927 13:50:08.521460 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.521550 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2199061}
I20260927 13:50:08.527118 6779 leader_election.cc:290] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.527601 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 170) took 2204 ms. Trace:
I20260927 13:50:08.528159 7098 rpcz_store.cc:276] 0927 13:50:06.322736 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.322782 (+ 46us) service_pool.cc:224] Handling call
0927 13:50:08.527431 (+2204649us) ts_tablet_manager.cc:1151] Deleting tablet a0575418f5ea4d82b34112e1bc9ab8b4
0927 13:50:08.527447 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.527578 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2204460}
I20260927 13:50:08.528345 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaffd54534442e1aa6db158d313fab3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:08.529196 5044 leader_election.cc:343] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:08.518515 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 2e768c83fae54619ac849dfedd5ec654 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e768c83fae54619ac849dfedd5ec654 already in progress: creating tablet
W20260927 13:50:08.542258 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet dd0126a6df14457ca5c62c129f3275f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd0126a6df14457ca5c62c129f3275f8 already in progress: creating tablet
W20260927 13:50:08.542798 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 26a8aca52f8c4566b274d13e6bb13ce5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26a8aca52f8c4566b274d13e6bb13ce5 already in progress: creating tablet
W20260927 13:50:08.543061 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet c99bf2abdfc64f169a3937f3e4499f75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c99bf2abdfc64f169a3937f3e4499f75 already in progress: creating tablet
W20260927 13:50:08.543298 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a003afa0fbb74d548cfaba51ea6cef58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a003afa0fbb74d548cfaba51ea6cef58 already in progress: creating tablet
W20260927 13:50:08.543509 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a0575418f5ea4d82b34112e1bc9ab8b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0575418f5ea4d82b34112e1bc9ab8b4 already in progress: creating tablet
I20260927 13:50:08.551275 6445 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34390 (request call id 110) took 2675 ms. Trace:
I20260927 13:50:08.551409 6445 rpcz_store.cc:276] 0927 13:50:05.875396 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.790014 (+914618us) service_pool.cc:224] Handling call
0927 13:50:06.908970 (+118956us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:06.909110 (+ 140us) catalog_manager.cc:2854] Modifying in-memory table state
0927 13:50:06.909162 (+ 52us) catalog_manager.cc:2863] Locking tablets
0927 13:50:06.909314 (+ 152us) catalog_manager.cc:2877] Removing table and tablets from system table
0927 13:50:06.937746 (+ 28432us) catalog_manager.cc:2895] Removing table from by-name map
0927 13:50:06.937810 (+ 64us) catalog_manager.cc:2911] Committing in-memory state
0927 13:50:08.458546 (+1520736us) catalog_manager.cc:2915] Aborting table tasks
0927 13:50:08.551200 (+ 92654us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.921164 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.921274 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.921280 (+ 6us) write_op.cc:435] Acquired schema lock
0927 13:50:06.921284 (+ 4us) tablet.cc:662] Decoding operations
0927 13:50:06.921403 (+ 119us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.921413 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.921418 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.921555 (+ 137us) tablet.cc:701] Row locks acquired
0927 13:50:06.921557 (+ 2us) write_op.cc:260] PREPARE: finished
0927 13:50:06.921590 (+ 33us) write_op.cc:270] Start()
0927 13:50:06.921618 (+ 28us) write_op.cc:276] Timestamp: P: 1790517006921557 usec, L: 0
0927 13:50:06.921621 (+ 3us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.921781 (+ 160us) log.cc:844] Serialized 728 byte log entry
0927 13:50:06.926591 (+ 4810us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.927387 (+ 796us) write_op.cc:301] APPLY: starting
0927 13:50:06.927399 (+ 12us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.927438 (+ 39us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.927473 (+ 35us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.927530 (+ 57us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.927566 (+ 36us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:50:06.927577 (+ 11us) write_op.cc:312] APPLY: finished
0927 13:50:06.927636 (+ 59us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.927686 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.927704 (+ 18us) write_op.cc:454] Released schema lock
0927 13:50:06.927712 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:06.971002 (+ 43290us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.971014 (+ 12us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":758,"apply.run_cpu_time_us":369,"apply.run_wall_time_us":369,"mutex_wait_us":10458,"num_ops":2,"prepare.queue_time_us":11279,"prepare.run_cpu_time_us":6759,"prepare.run_wall_time_us":49822,"raft.queue_time_us":1771,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":8,"replication_time_us":4950,"thread_start_us":48766,"threads_started":1}]]}
I20260927 13:50:08.552441 6455 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34390 (request call id 111) took 2664 ms. Trace:
I20260927 13:50:08.552573 6455 rpcz_store.cc:276] 0927 13:50:05.887694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.800494 (+912800us) service_pool.cc:224] Handling call
0927 13:50:06.907812 (+107318us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0927 13:50:06.907963 (+ 151us) catalog_manager.cc:2854] Modifying in-memory table state
0927 13:50:06.908019 (+ 56us) catalog_manager.cc:2863] Locking tablets
0927 13:50:06.908196 (+ 177us) catalog_manager.cc:2877] Removing table and tablets from system table
0927 13:50:06.937047 (+ 28851us) catalog_manager.cc:2895] Removing table from by-name map
0927 13:50:06.937416 (+ 369us) catalog_manager.cc:2911] Committing in-memory state
0927 13:50:08.457341 (+1519925us) catalog_manager.cc:2915] Aborting table tasks
0927 13:50:08.552391 (+ 95050us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:06.920392 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:06.920509 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:06.920516 (+ 7us) write_op.cc:435] Acquired schema lock
0927 13:50:06.920519 (+ 3us) tablet.cc:662] Decoding operations
0927 13:50:06.920637 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:06.920655 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:06.920660 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:06.920778 (+ 118us) tablet.cc:701] Row locks acquired
0927 13:50:06.920782 (+ 4us) write_op.cc:260] PREPARE: finished
0927 13:50:06.920819 (+ 37us) write_op.cc:270] Start()
0927 13:50:06.920852 (+ 33us) write_op.cc:276] Timestamp: P: 1790517006920788 usec, L: 0
0927 13:50:06.920857 (+ 5us) op_driver.cc:348] REPLICATION: starting
0927 13:50:06.921028 (+ 171us) log.cc:844] Serialized 728 byte log entry
0927 13:50:06.926513 (+ 5485us) op_driver.cc:464] REPLICATION: finished
0927 13:50:06.926800 (+ 287us) write_op.cc:301] APPLY: starting
0927 13:50:06.926819 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:06.926868 (+ 49us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:06.926909 (+ 41us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:06.926989 (+ 80us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:06.927029 (+ 40us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 13:50:06.927041 (+ 12us) write_op.cc:312] APPLY: finished
0927 13:50:06.927123 (+ 82us) log.cc:844] Serialized 29 byte log entry
0927 13:50:06.927185 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.927208 (+ 23us) write_op.cc:454] Released schema lock
0927 13:50:06.927214 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 13:50:06.927301 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:06.927307 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":233,"apply.run_cpu_time_us":488,"apply.run_wall_time_us":488,"mutex_wait_us":11438,"num_ops":2,"prepare.queue_time_us":11538,"prepare.run_cpu_time_us":739,"prepare.run_wall_time_us":739,"raft.queue_time_us":2613,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":272,"replication_time_us":5622}]]}
W20260927 13:50:08.555011 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 47374.7us
I20260927 13:50:08.556519 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a397300cdd44eb899f2ef5b9fe8c09" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.557437 5074 tablet_service.cc:1558] Processing DeleteTablet for tablet 50c2661998134488a95b4750d0e653a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:08.557518 5103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a397300cdd44eb899f2ef5b9fe8c09" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:08.557703 5103 raft_consensus.cc:2468] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:50:08.557981 5045 leader_election.cc:343] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.558099 5045 leader_election.cc:304] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.558259 6455 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_9749d8dab54a412fb6dd1234772d3155" } new_table_name: "default.Table_d8c312de9e4b4110814525d9082a9bb7" modify_external_catalogs: true
I20260927 13:50:08.558501 6779 raft_consensus.cc:2749] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.558476 6445 master_service.cc:960] ReplaceTablet: received request to replace tablet 90fb369fec2d43149080ab2ad94ecc57 from {username='slave'} at 127.0.0.1:34390
W20260927 13:50:08.558897 5045 leader_election.cc:343] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.559016 5045 leader_election.cc:304] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.559387 6779 raft_consensus.cc:2749] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.560873 7305 raft_consensus.cc:493] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.560964 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 187b3ceeccb142c4b798947e584d6044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:08.561008 7305 raft_consensus.cc:515] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.561268 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 52050d7e35dc4fbab3c7c079d07478e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:08.561638 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 50c2661998134488a95b4750d0e653a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:08.561920 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet c16673cfe45f4c81806f4dda3246d476 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:08.561923 7305 leader_election.cc:290] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.562907 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880ce1300eac40b28aac8cba3e11077e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:08.562929 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880ce1300eac40b28aac8cba3e11077e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.563073 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1436bcea966646969789e6e09f91c557" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.563097 5108 raft_consensus.cc:2468] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:08.563372 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaffd54534442e1aa6db158d313fab3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:08.563455 5319 leader_election.cc:343] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.565974 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf052a0645154d4c837a372173b8f610" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.566479 7305 consensus_queue.cc:1048] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.582034 5619 tablet_bootstrap.cc:492] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:08.582216 5619 ts_tablet_manager.cc:1403] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.200s user 0.003s sys 0.031s
I20260927 13:50:08.599781 5626 tablet_bootstrap.cc:492] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.599961 5626 ts_tablet_manager.cc:1403] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.116s user 0.015s sys 0.022s
I20260927 13:50:08.600858 5626 raft_consensus.cc:359] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.601094 5626 raft_consensus.cc:385] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.601167 5626 raft_consensus.cc:740] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.601452 5626 consensus_queue.cc:260] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.603708 5626 ts_tablet_manager.cc:1434] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:50:08.605592 5626 tablet_bootstrap.cc:492] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.608840 5626 tablet_bootstrap.cc:654] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.529203 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 171) took 2205 ms. Trace:
I20260927 13:50:08.610263 7098 rpcz_store.cc:276] 0927 13:50:06.323339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.323383 (+ 44us) service_pool.cc:224] Handling call
0927 13:50:08.529075 (+2205692us) ts_tablet_manager.cc:1151] Deleting tablet d0a737bef14b4874b61a109305ebb993
0927 13:50:08.529087 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.529182 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2205555}
I20260927 13:50:08.610807 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 172) took 2286 ms. Trace:
W20260927 13:50:08.610896 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet d0a737bef14b4874b61a109305ebb993 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0a737bef14b4874b61a109305ebb993 already in progress: creating tablet
I20260927 13:50:08.610898 7098 rpcz_store.cc:276] 0927 13:50:06.324115 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.324156 (+ 41us) service_pool.cc:224] Handling call
0927 13:50:08.610657 (+2286501us) ts_tablet_manager.cc:1151] Deleting tablet bb980bca9f16480ba050971b58aa46f3
0927 13:50:08.610669 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.610785 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2286347}
W20260927 13:50:08.611352 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet bb980bca9f16480ba050971b58aa46f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb980bca9f16480ba050971b58aa46f3 already in progress: creating tablet
I20260927 13:50:08.611382 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 173) took 2286 ms. Trace:
I20260927 13:50:08.611488 7098 rpcz_store.cc:276] 0927 13:50:06.324825 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.324942 (+ 117us) service_pool.cc:224] Handling call
0927 13:50:08.611148 (+2286206us) ts_tablet_manager.cc:1151] Deleting tablet a4f4bc5cefef448d85ff31b7fafaca74
0927 13:50:08.611267 (+ 119us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.611365 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2286032}
I20260927 13:50:08.611795 7098 tablet_replica.cc:333] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
W20260927 13:50:08.611892 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet a4f4bc5cefef448d85ff31b7fafaca74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4f4bc5cefef448d85ff31b7fafaca74 already in progress: creating tablet
I20260927 13:50:08.612051 7098 raft_consensus.cc:2243] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.612396 7098 raft_consensus.cc:2272] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.612988 7098 ts_tablet_manager.cc:1916] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.619395 5628 tablet_bootstrap.cc:492] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.619613 5628 ts_tablet_manager.cc:1403] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.116s user 0.025s sys 0.020s
I20260927 13:50:08.620707 5628 raft_consensus.cc:359] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.621007 5628 raft_consensus.cc:385] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.621104 5628 raft_consensus.cc:740] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.621407 5628 consensus_queue.cc:260] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.622268 5626 tablet_bootstrap.cc:492] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.622448 5626 ts_tablet_manager.cc:1403] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.003s
I20260927 13:50:08.622772 5628 ts_tablet_manager.cc:1434] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260927 13:50:08.623107 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 56384.1us
W20260927 13:50:08.623423 5319 leader_election.cc:343] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.624238 5628 tablet_bootstrap.cc:492] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.627372 5628 tablet_bootstrap.cc:654] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.627548 5619 raft_consensus.cc:359] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.628129 5619 raft_consensus.cc:385] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.628278 5619 raft_consensus.cc:740] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.628739 5319 leader_election.cc:304] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:08.628980 5626 raft_consensus.cc:359] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.629175 5626 raft_consensus.cc:385] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.629168 7424 raft_consensus.cc:2804] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:08.629258 5626 raft_consensus.cc:740] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.629624 7424 raft_consensus.cc:493] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:08.629848 7424 raft_consensus.cc:3060] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.630695 5626 consensus_queue.cc:260] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.630312 5619 consensus_queue.cc:260] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.632679 5626 ts_tablet_manager.cc:1434] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 13:50:08.634202 5619 ts_tablet_manager.cc:1434] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.052s user 0.002s sys 0.000s
I20260927 13:50:08.637625 5619 tablet_bootstrap.cc:492] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:08.641134 6991 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260927 13:50:08.629356 5319 leader_election.cc:304] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:08.642308 7305 raft_consensus.cc:2804] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:08.642390 7305 raft_consensus.cc:493] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:08.642455 7305 raft_consensus.cc:3060] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:08.642603 5045 leader_election.cc:343] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.642779 5045 leader_election.cc:304] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:08.643221 5045 leader_election.cc:343] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.643373 5045 leader_election.cc:304] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:08.643770 5045 leader_election.cc:343] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.643913 5045 leader_election.cc:304] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.644304 6779 raft_consensus.cc:2749] T 1436bcea966646969789e6e09f91c557 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.644495 6779 raft_consensus.cc:2749] T 1aaffd54534442e1aa6db158d313fab3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.644682 6779 raft_consensus.cc:2749] T bf052a0645154d4c837a372173b8f610 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.645051 7305 raft_consensus.cc:515] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.645270 7370 raft_consensus.cc:493] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.645455 7370 raft_consensus.cc:515] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.645582 7305 leader_election.cc:290] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.646134 7370 leader_election.cc:290] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.646984 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6985779674646f4abe18cdf7c063c90" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:08.647220 5096 raft_consensus.cc:2393] T b6985779674646f4abe18cdf7c063c90 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:08.649102 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6985779674646f4abe18cdf7c063c90" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.649699 5185 leader_election.cc:304] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.649978 7370 raft_consensus.cc:3060] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.654970 5619 tablet_bootstrap.cc:654] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.654238 7424 raft_consensus.cc:515] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.658905 5628 tablet_bootstrap.cc:492] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.659096 5628 ts_tablet_manager.cc:1403] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.008s
I20260927 13:50:08.660496 5628 raft_consensus.cc:359] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.660727 5628 raft_consensus.cc:385] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.660848 5628 raft_consensus.cc:740] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.659997 7424 leader_election.cc:290] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.661115 5628 consensus_queue.cc:260] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.663019 5628 ts_tablet_manager.cc:1434] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260927 13:50:08.664052 5628 tablet_bootstrap.cc:492] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.664631 7370 raft_consensus.cc:2749] T b6985779674646f4abe18cdf7c063c90 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.665915 5628 tablet_bootstrap.cc:654] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.666936 5626 tablet_bootstrap.cc:492] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.668900 5619 tablet_bootstrap.cc:492] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:08.669164 5619 ts_tablet_manager.cc:1403] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.003s
I20260927 13:50:08.675624 7111 ts_tablet_manager.cc:1929] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:08.675792 7111 log.cc:1199] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b5a9f864e4274666a86baed43e1623cd
I20260927 13:50:08.676224 7111 ts_tablet_manager.cc:1950] T b5a9f864e4274666a86baed43e1623cd P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:08.677242 7424 raft_consensus.cc:493] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.677371 7424 raft_consensus.cc:515] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.677438 5619 raft_consensus.cc:359] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.677561 5619 raft_consensus.cc:385] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.677615 5619 raft_consensus.cc:740] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.677793 5619 consensus_queue.cc:260] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.677942 7424 leader_election.cc:290] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.678308 5619 ts_tablet_manager.cc:1434] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260927 13:50:08.678628 5619 tablet_bootstrap.cc:492] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:08.683416 5619 tablet_bootstrap.cc:654] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.684393 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880ce1300eac40b28aac8cba3e11077e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:08.686134 5626 tablet_bootstrap.cc:654] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.687793 7388 raft_consensus.cc:493] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.687969 7388 raft_consensus.cc:515] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.688876 7481 raft_consensus.cc:493] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.689031 7481 raft_consensus.cc:515] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.689153 7388 leader_election.cc:290] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.689718 7481 leader_election.cc:290] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.691403 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880ce1300eac40b28aac8cba3e11077e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:08.691601 5096 raft_consensus.cc:3060] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.690407 7370 raft_consensus.cc:493] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.690465 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3149f6bbaf043f08970e19fd66c4e2a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.693555 7370 raft_consensus.cc:515] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.690742 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b549d0d21d421cba1c830d8e0bd04d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.691536 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a397300cdd44eb899f2ef5b9fe8c09" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:50:08.694155 5044 leader_election.cc:343] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:08.694690 5044 leader_election.cc:343] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.695000 5096 raft_consensus.cc:2468] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:08.695403 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a397300cdd44eb899f2ef5b9fe8c09" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:08.695632 5096 raft_consensus.cc:3060] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:08.697639 5184 leader_election.cc:343] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bf557ac29964453583f224b46178c7dd
I20260927 13:50:08.697914 7370 leader_election.cc:290] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.698884 5096 raft_consensus.cc:2468] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:08.700026 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf557ac29964453583f224b46178c7dd" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.700248 5380 raft_consensus.cc:2468] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:08.700670 5185 leader_election.cc:304] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:08.701175 7370 raft_consensus.cc:2804] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:08.701318 7370 raft_consensus.cc:493] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:08.701457 7370 raft_consensus.cc:3060] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.704577 7370 raft_consensus.cc:515] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.705574 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf557ac29964453583f224b46178c7dd" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:08.705775 5380 raft_consensus.cc:3060] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.706043 7370 leader_election.cc:290] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:08.706537 5184 leader_election.cc:343] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bf557ac29964453583f224b46178c7dd
I20260927 13:50:08.710850 5380 raft_consensus.cc:2468] T bf557ac29964453583f224b46178c7dd P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:08.711489 5185 leader_election.cc:304] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:08.712070 7370 raft_consensus.cc:2804] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:08.712232 7370 raft_consensus.cc:697] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:08.713251 7370 consensus_queue.cc:237] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.716341 5626 tablet_bootstrap.cc:492] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.716560 5626 ts_tablet_manager.cc:1403] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.002s
I20260927 13:50:08.717510 5626 raft_consensus.cc:359] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.717810 5626 raft_consensus.cc:385] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.717967 5626 raft_consensus.cc:740] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.718341 5626 consensus_queue.cc:260] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.720309 5626 ts_tablet_manager.cc:1434] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260927 13:50:08.720727 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 144) took 2250 ms. Trace:
I20260927 13:50:08.720834 7111 rpcz_store.cc:276] 0927 13:50:06.470436 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.470486 (+ 50us) service_pool.cc:224] Handling call
0927 13:50:08.372175 (+1901689us) ts_tablet_manager.cc:1151] Deleting tablet b5a9f864e4274666a86baed43e1623cd
0927 13:50:08.372184 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.573601 (+201417us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.661395 (+ 87794us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.720699 (+ 59304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179164,"tablet-delete.queue_time_us":1889425}
I20260927 13:50:08.721345 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 147) took 2175 ms. Trace:
I20260927 13:50:08.721431 7111 rpcz_store.cc:276] 0927 13:50:06.546359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.546934 (+ 575us) service_pool.cc:224] Handling call
0927 13:50:08.721222 (+2174288us) ts_tablet_manager.cc:1151] Deleting tablet 50bc839e0fc54839a5d06c176760f618
0927 13:50:08.721236 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.721318 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2174051}
I20260927 13:50:08.721783 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 148) took 2174 ms. Trace:
I20260927 13:50:08.721860 7111 rpcz_store.cc:276] 0927 13:50:06.547423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.547472 (+ 49us) service_pool.cc:224] Handling call
0927 13:50:08.721673 (+2174201us) ts_tablet_manager.cc:1151] Deleting tablet 614f1af61461466da975bea681162727
0927 13:50:08.721684 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.721768 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2174045}
I20260927 13:50:08.722190 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 149) took 2160 ms. Trace:
I20260927 13:50:08.722272 7111 rpcz_store.cc:276] 0927 13:50:06.561548 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.561602 (+ 54us) service_pool.cc:224] Handling call
0927 13:50:08.722096 (+2160494us) ts_tablet_manager.cc:1151] Deleting tablet da75a470ec0c4ec9afa7c18a51cd7276
0927 13:50:08.722106 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.722176 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2160303}
I20260927 13:50:08.722554 7111 tablet_replica.cc:333] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:08.722779 7111 raft_consensus.cc:2243] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:08.723150 7111 raft_consensus.cc:2272] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.731803 7481 raft_consensus.cc:493] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.732038 7481 raft_consensus.cc:515] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.732854 7481 leader_election.cc:290] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:50:08.741153 5319 leader_election.cc:343] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:08.741394 5319 leader_election.cc:343] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.743058 7481 raft_consensus.cc:493] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.743228 7481 raft_consensus.cc:515] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.743914 7481 leader_election.cc:290] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:08.749751 6991 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 13:50:08.754197 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54a83664397460399960a0f73966fef" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.755134 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7b3a35b2e94bbea6be4b4a8f158593" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:08.755429 5044 leader_election.cc:343] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.755685 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2ee02044b64e3eaff8136ac43f02e4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:08.757051 5044 leader_election.cc:343] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.757302 6991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 13:50:08.764470 7481 raft_consensus.cc:493] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.764650 7481 raft_consensus.cc:515] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.765242 7481 leader_election.cc:290] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.766467 5223 tablet_service.cc:1511] Processing CreateTablet for tablet 8693dee8fa3f42388b0a728c223854a9 (DEFAULT_TABLE table=default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:08.766867 5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8693dee8fa3f42388b0a728c223854a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.767647 5074 tablet_service.cc:1511] Processing CreateTablet for tablet 8693dee8fa3f42388b0a728c223854a9 (DEFAULT_TABLE table=default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:08.768029 5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8693dee8fa3f42388b0a728c223854a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 13:50:08.769737 7098 ts_tablet_manager.cc:1929] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:08.769901 7098 log.cc:1199] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/d9cb99ad45d1445cb2e2854319a3d73d
I20260927 13:50:08.770311 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbde77915c7d4665965bef2298c3491f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:08.771005 5044 leader_election.cc:343] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.785413 7231 consensus_queue.cc:1048] T 5c69163fb77442be9215f8f285b904ef P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:08.786662 5319 consensus_peers.cc:597] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e26a3a50396940cf826442e4ba7356a8. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:08.794450 5626 tablet_bootstrap.cc:492] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.795730 5296 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:08.796212 5319 leader_election.cc:304] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:08.796484 7231 raft_consensus.cc:2804] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:08.796604 7231 raft_consensus.cc:697] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:08.796830 7231 consensus_queue.cc:237] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.803464 5626 tablet_bootstrap.cc:654] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.806820 5319 leader_election.cc:304] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:08.807498 7111 ts_tablet_manager.cc:1916] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.811966 7412 raft_consensus.cc:2804] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:08.812093 7412 raft_consensus.cc:697] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:08.812302 7412 consensus_queue.cc:237] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.817600 5432 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
W20260927 13:50:08.821249 5319 leader_election.cc:343] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bb7b3a35b2e94bbea6be4b4a8f158593
I20260927 13:50:08.822530 6445 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e421351a34d1463e9773dcebdeebae3c: Sending DeleteTablet for 3 replicas of tablet 90fb369fec2d43149080ab2ad94ecc57
I20260927 13:50:08.823271 6445 catalog_manager.cc:6934] ReplaceTablet: tablet 90fb369fec2d43149080ab2ad94ecc57 deleted and replaced by tablet 85d99842b86841ea965095c3ef8f22b4
I20260927 13:50:08.823300 5628 tablet_bootstrap.cc:492] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.823423 6445 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:34390 (request call id 112) took 2774 ms. Trace:
I20260927 13:50:08.823460 5628 ts_tablet_manager.cc:1403] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.160s user 0.010s sys 0.031s
I20260927 13:50:08.823553 6445 rpcz_store.cc:276] 0927 13:50:06.049113 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:08.557329 (+2508216us) service_pool.cc:224] Handling call
0927 13:50:08.823373 (+266044us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0927 13:50:08.707591 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 13:50:08.707723 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0927 13:50:08.707731 (+ 8us) write_op.cc:435] Acquired schema lock
0927 13:50:08.707734 (+ 3us) tablet.cc:662] Decoding operations
0927 13:50:08.707850 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0927 13:50:08.707865 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0927 13:50:08.707870 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0927 13:50:08.707961 (+ 91us) tablet.cc:701] Row locks acquired
0927 13:50:08.707964 (+ 3us) write_op.cc:260] PREPARE: finished
0927 13:50:08.708001 (+ 37us) write_op.cc:270] Start()
0927 13:50:08.708036 (+ 35us) write_op.cc:276] Timestamp: P: 1790517008707939 usec, L: 0
0927 13:50:08.708040 (+ 4us) op_driver.cc:348] REPLICATION: starting
0927 13:50:08.757526 (+ 49486us) log.cc:844] Serialized 625 byte log entry
0927 13:50:08.758593 (+ 1067us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fe7455cc1b2 00007fe7469e9fa5 00007fe7469e8ac9 00007fe7469f0ef0 00007fe7469f0cfd 0000000000aaef9c 00007fe739548aef 00007fe73954bdeb 00007fe73954bc68 0000000000aaef9c
0927 13:50:08.776563 (+ 17970us) op_driver.cc:464] REPLICATION: finished
0927 13:50:08.777077 (+ 514us) write_op.cc:301] APPLY: starting
0927 13:50:08.777096 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0927 13:50:08.777142 (+ 46us) tablet.cc:1397] finished BulkCheckPresence
0927 13:50:08.777144 (+ 2us) tablet.cc:1399] starting ApplyRowOperation cycle
0927 13:50:08.777258 (+ 114us) tablet.cc:1410] finished ApplyRowOperation cycle
0927 13:50:08.777325 (+ 67us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 13:50:08.777334 (+ 9us) write_op.cc:312] APPLY: finished
0927 13:50:08.777434 (+ 100us) log.cc:844] Serialized 29 byte log entry
0927 13:50:08.777508 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0927 13:50:08.777532 (+ 24us) write_op.cc:454] Released schema lock
0927 13:50:08.777539 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":451,"apply.run_cpu_time_us":528,"apply.run_wall_time_us":528,"mutex_wait_us":62,"num_ops":2,"prepare.queue_time_us":75,"prepare.run_cpu_time_us":1971,"prepare.run_wall_time_us":51152,"raft.queue_time_us":151,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":722,"replication_time_us":68454,"spinlock_wait_cycles":116675584}]]}
I20260927 13:50:08.824326 5628 raft_consensus.cc:359] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.824874 6445 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34390:
table { table_name: "default.Table_e03f455aec424b9fb05a1503d626ae3a" } new_table_name: "default.Table_77358cd49d914298965df74032c008b9" modify_external_catalogs: true
I20260927 13:50:08.826488 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 90fb369fec2d43149080ab2ad94ecc57 with delete_type TABLET_DATA_DELETED (replaced by tablet 85d99842b86841ea965095c3ef8f22b4) from {username='slave'} at 127.0.0.1:44390
W20260927 13:50:08.827152 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 90fb369fec2d43149080ab2ad94ecc57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90fb369fec2d43149080ab2ad94ecc57 already in progress: creating tablet
I20260927 13:50:08.833702 5074 tablet_service.cc:1558] Processing DeleteTablet for tablet 90fb369fec2d43149080ab2ad94ecc57 with delete_type TABLET_DATA_DELETED (replaced by tablet 85d99842b86841ea965095c3ef8f22b4) from {username='slave'} at 127.0.0.1:39028
I20260927 13:50:08.834077 5628 raft_consensus.cc:385] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.834272 5628 raft_consensus.cc:740] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.835485 5628 consensus_queue.cc:260] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.838703 7231 consensus_queue.cc:1048] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.840113 5234 raft_consensus.cc:3060] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.840365 5626 tablet_bootstrap.cc:492] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.840487 5626 ts_tablet_manager.cc:1403] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.046s user 0.011s sys 0.019s
I20260927 13:50:08.841068 5626 raft_consensus.cc:359] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.841210 5626 raft_consensus.cc:385] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.841266 5626 raft_consensus.cc:740] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.841485 5626 consensus_queue.cc:260] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.842339 5628 ts_tablet_manager.cc:1434] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260927 13:50:08.842770 5628 tablet_bootstrap.cc:492] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.843101 5626 ts_tablet_manager.cc:1434] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:50:08.844463 5628 tablet_bootstrap.cc:654] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.844560 5626 tablet_bootstrap.cc:492] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.846839 5619 tablet_bootstrap.cc:492] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:08.846968 5619 ts_tablet_manager.cc:1403] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.168s user 0.012s sys 0.023s
I20260927 13:50:08.847631 5619 raft_consensus.cc:359] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.847775 5619 raft_consensus.cc:385] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.847822 5619 raft_consensus.cc:740] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.848004 5619 consensus_queue.cc:260] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.848474 5619 ts_tablet_manager.cc:1434] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260927 13:50:08.849112 5626 tablet_bootstrap.cc:654] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.849710 5619 tablet_bootstrap.cc:492] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:08.850488 7481 raft_consensus.cc:493] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.850639 7481 raft_consensus.cc:515] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.851353 5619 tablet_bootstrap.cc:654] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.851344 7481 leader_election.cc:290] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.852345 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36314f4c93434b1f8d462aa9d838da78" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:08.852903 5044 leader_election.cc:343] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.858887 7481 raft_consensus.cc:493] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.859063 7481 raft_consensus.cc:515] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.859659 7481 leader_election.cc:290] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.860267 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b5a9f864e4274666a86baed43e1623cd (table default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]) successfully deleted
W20260927 13:50:08.860637 6429 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 50bc839e0fc54839a5d06c176760f618 because the tablet was not found. No further retry: Not found: Tablet not found: 50bc839e0fc54839a5d06c176760f618
W20260927 13:50:08.860852 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 614f1af61461466da975bea681162727 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 614f1af61461466da975bea681162727 already in progress: creating tablet
W20260927 13:50:08.861074 6429 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet da75a470ec0c4ec9afa7c18a51cd7276 because the tablet was not found. No further retry: Not found: Tablet not found: da75a470ec0c4ec9afa7c18a51cd7276
I20260927 13:50:08.862892 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58acd8932a2647a0a20679614cc2b68a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.864804 5348 tablet_service.cc:1511] Processing CreateTablet for tablet 8693dee8fa3f42388b0a728c223854a9 (DEFAULT_TABLE table=default.Table_4dba712f260c446c902cd0b9dade8e7f [id=d8929aa2e8714fd38a2fc2a5d1946815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 13:50:08.865229 5348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8693dee8fa3f42388b0a728c223854a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 13:50:08.866451 5044 leader_election.cc:343] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.868638 7481 raft_consensus.cc:493] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.868854 7481 raft_consensus.cc:515] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.869729 7481 leader_election.cc:290] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.871022 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284f6113fa4b443a869bce6d0c15f273" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:08.871603 5044 leader_election.cc:343] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.874147 7481 raft_consensus.cc:493] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.874342 7481 raft_consensus.cc:515] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.874975 5628 tablet_bootstrap.cc:492] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.875145 7481 leader_election.cc:290] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.875144 5628 ts_tablet_manager.cc:1403] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.002s
I20260927 13:50:08.875736 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b38f40431f47a0acf1e11092d7717b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.876021 5628 raft_consensus.cc:359] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.876202 5628 raft_consensus.cc:385] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 13:50:08.876296 5044 leader_election.cc:343] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.876950 5626 tablet_bootstrap.cc:492] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.877125 5626 ts_tablet_manager.cc:1403] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.008s
I20260927 13:50:08.877803 5626 raft_consensus.cc:359] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.878031 5626 raft_consensus.cc:385] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.878245 5626 raft_consensus.cc:740] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.878504 5626 consensus_queue.cc:260] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.878669 5628 raft_consensus.cc:740] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.878968 5628 consensus_queue.cc:260] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.880640 5626 ts_tablet_manager.cc:1434] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 13:50:08.881893 5619 tablet_bootstrap.cc:492] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:08.882021 5619 ts_tablet_manager.cc:1403] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260927 13:50:08.882645 5628 ts_tablet_manager.cc:1434] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260927 13:50:08.882946 5628 tablet_bootstrap.cc:492] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:08.882980 5626 tablet_bootstrap.cc:492] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.884649 5626 tablet_bootstrap.cc:654] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.884776 5628 tablet_bootstrap.cc:654] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.885164 5619 raft_consensus.cc:359] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.885347 5619 raft_consensus.cc:385] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.885409 5619 raft_consensus.cc:740] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.885632 5619 consensus_queue.cc:260] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.887405 5619 ts_tablet_manager.cc:1434] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 13:50:08.888471 5619 tablet_bootstrap.cc:492] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:08.890018 5619 tablet_bootstrap.cc:654] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.894054 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3149f6bbaf043f08970e19fd66c4e2a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.894280 5626 tablet_bootstrap.cc:492] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.894456 5626 ts_tablet_manager.cc:1403] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20260927 13:50:08.894544 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b549d0d21d421cba1c830d8e0bd04d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.894918 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2ee02044b64e3eaff8136ac43f02e4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.895298 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54a83664397460399960a0f73966fef" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.895346 5626 raft_consensus.cc:359] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.895591 5626 raft_consensus.cc:385] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.895689 5626 raft_consensus.cc:740] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.895664 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbde77915c7d4665965bef2298c3491f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.895987 5626 consensus_queue.cc:260] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.896229 5348 tablet_service.cc:1558] Processing DeleteTablet for tablet 90fb369fec2d43149080ab2ad94ecc57 with delete_type TABLET_DATA_DELETED (replaced by tablet 85d99842b86841ea965095c3ef8f22b4) from {username='slave'} at 127.0.0.1:35946
I20260927 13:50:08.896797 7098 ts_tablet_manager.cc:1950] T d9cb99ad45d1445cb2e2854319a3d73d P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:08.897583 5626 ts_tablet_manager.cc:1434] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 13:50:08.898262 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 174) took 2572 ms. Trace:
I20260927 13:50:08.898423 7098 rpcz_store.cc:276] 0927 13:50:06.325977 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.326029 (+ 52us) service_pool.cc:224] Handling call
0927 13:50:08.611731 (+2285702us) ts_tablet_manager.cc:1151] Deleting tablet d9cb99ad45d1445cb2e2854319a3d73d
0927 13:50:08.611739 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.765757 (+154018us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.769652 (+ 3895us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.898181 (+128529us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2285519}
I20260927 13:50:08.898737 5626 tablet_bootstrap.cc:492] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.899256 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 176) took 2571 ms. Trace:
I20260927 13:50:08.899464 7098 rpcz_store.cc:276] 0927 13:50:06.328091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.328134 (+ 43us) service_pool.cc:224] Handling call
0927 13:50:08.899029 (+2570895us) ts_tablet_manager.cc:1151] Deleting tablet 2d64750141d74d988612304ce050688d
0927 13:50:08.899044 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.899160 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2570717}
W20260927 13:50:08.900049 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 2d64750141d74d988612304ce050688d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d64750141d74d988612304ce050688d already in progress: creating tablet
I20260927 13:50:08.900372 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 175) took 2572 ms. Trace:
I20260927 13:50:08.900542 7098 rpcz_store.cc:276] 0927 13:50:06.327557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.327672 (+ 115us) service_pool.cc:224] Handling call
0927 13:50:08.900042 (+2572370us) ts_tablet_manager.cc:1151] Deleting tablet 7ef5969312044a2bab451841ec65aa84
0927 13:50:08.900054 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.900219 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21,"tablet-delete.queue_time_us":2571727}
I20260927 13:50:08.900823 5626 tablet_bootstrap.cc:654] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:08.901172 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7ef5969312044a2bab451841ec65aa84 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef5969312044a2bab451841ec65aa84 already in progress: creating tablet
I20260927 13:50:08.901436 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 177) took 2497 ms. Trace:
I20260927 13:50:08.903964 7370 raft_consensus.cc:493] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.904094 7370 raft_consensus.cc:515] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.904647 7370 leader_election.cc:290] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:08.906320 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82284e3fd1f4a2f95c7e47320abb30c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.907421 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36314f4c93434b1f8d462aa9d838da78" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.910523 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284f6113fa4b443a869bce6d0c15f273" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.910689 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58acd8932a2647a0a20679614cc2b68a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:08.910817 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b38f40431f47a0acf1e11092d7717b" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:08.911422 5319 leader_election.cc:343] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.911580 5319 leader_election.cc:304] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:08.911829 7231 raft_consensus.cc:2749] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.912509 7231 consensus_queue.cc:1048] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.914789 7231 consensus_queue.cc:1048] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.916201 5234 raft_consensus.cc:3060] T c44dc61b4003469e8f404b73f22f7291 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.922988 5626 tablet_bootstrap.cc:492] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.923146 5626 ts_tablet_manager.cc:1403] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.002s
I20260927 13:50:08.923825 5626 raft_consensus.cc:359] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.923983 5626 raft_consensus.cc:385] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.924048 5626 raft_consensus.cc:740] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.924245 5626 consensus_queue.cc:260] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.924688 5626 ts_tablet_manager.cc:1434] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260927 13:50:08.924971 5626 tablet_bootstrap.cc:492] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.928238 5626 tablet_bootstrap.cc:654] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:08.933370 7111 ts_tablet_manager.cc:1929] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:08.946645 5238 raft_consensus.cc:3060] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:08.954214 5626 tablet_bootstrap.cc:492] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:08.954355 5626 ts_tablet_manager.cc:1403] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.003s
I20260927 13:50:08.955041 5626 raft_consensus.cc:359] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.955199 5626 raft_consensus.cc:385] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:08.955245 5626 raft_consensus.cc:740] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:08.905794 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82284e3fd1f4a2f95c7e47320abb30c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:08.925632 7481 raft_consensus.cc:493] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.957020 5107 raft_consensus.cc:2393] T a82284e3fd1f4a2f95c7e47320abb30c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:08.957000 7481 raft_consensus.cc:515] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.957602 5184 leader_election.cc:304] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.957738 7481 leader_election.cc:290] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:08.945197 5045 leader_election.cc:343] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.957953 5045 leader_election.cc:304] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.958052 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9872d637765b4d719e2de63ae1eb3196" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:08.957500 5626 consensus_queue.cc:260] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.958436 7203 raft_consensus.cc:3060] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:08.958601 5045 leader_election.cc:343] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.958760 5045 leader_election.cc:304] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.959076 5626 ts_tablet_manager.cc:1434] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260927 13:50:08.959113 5045 leader_election.cc:343] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.959256 5045 leader_election.cc:304] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.959563 6779 raft_consensus.cc:2749] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.959738 6779 raft_consensus.cc:2749] T 01b549d0d21d421cba1c830d8e0bd04d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.959857 6779 raft_consensus.cc:2749] T 2a2ee02044b64e3eaff8136ac43f02e4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.949398 7388 raft_consensus.cc:493] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.960043 7388 raft_consensus.cc:515] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.960551 7388 leader_election.cc:290] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:50:08.958611 5044 leader_election.cc:343] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.961241 7203 raft_consensus.cc:2749] T a82284e3fd1f4a2f95c7e47320abb30c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.961550 5626 tablet_bootstrap.cc:492] T 3ee18063dc634385b9e61fae3b3ece99 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:08.961799 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a1193719e140beb9b492927adeb78c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:08.962342 5044 leader_election.cc:343] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.957013 7098 rpcz_store.cc:276] 0927 13:50:06.403815 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.403883 (+ 68us) service_pool.cc:224] Handling call
0927 13:50:08.901196 (+2497313us) ts_tablet_manager.cc:1151] Deleting tablet d9198ace6a264737a990d6fb573faf2d
0927 13:50:08.901208 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.901363 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2497133}
I20260927 13:50:08.965157 5626 tablet_bootstrap.cc:654] T 3ee18063dc634385b9e61fae3b3ece99 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:08.965174 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet d9198ace6a264737a990d6fb573faf2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9198ace6a264737a990d6fb573faf2d already in progress: creating tablet
I20260927 13:50:08.965476 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 178) took 2560 ms. Trace:
I20260927 13:50:08.971410 7370 raft_consensus.cc:493] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.971549 7370 raft_consensus.cc:515] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:08.972087 7370 leader_election.cc:290] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:08.973495 5185 leader_election.cc:343] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 992bf643dee64bccaa993a08027aa5fc
W20260927 13:50:08.974083 5184 leader_election.cc:343] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 992bf643dee64bccaa993a08027aa5fc
I20260927 13:50:08.974197 5184 leader_election.cc:304] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:08.974550 5157 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:08.974608 7370 raft_consensus.cc:2749] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:08.977959 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 008516a474cc40f2b9de77b2f3e762cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.978395 7190 tablet_replica.cc:333] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:08.978588 7190 raft_consensus.cc:2243] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.978732 7190 raft_consensus.cc:2272] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.979475 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 992bf643dee64bccaa993a08027aa5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.979662 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 413d863d9a564e5d8325b4479346730d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.979503 7190 ts_tablet_manager.cc:1916] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.979862 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet bf557ac29964453583f224b46178c7dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.980443 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b082227264e442a8b1db7a68fb0c3eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.980820 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e3fa4870d5547a2bbffe1745b964504 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.981040 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet e25f5898369f46fba32b7df27b334b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.981709 5225 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 with delete_type TABLET_DATA_DELETED (replaced by tablet c0d3e3f86440448a88404f0ac06e0c0c) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.981928 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 5978cb78bd974d669817def05007d0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.982095 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 417b99e95ab4422d96b606fc76698324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.982316 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 1087ad60dade46bb9d38f52a94dd536b with delete_type TABLET_DATA_DELETED (replaced by tablet 07830b76d7e14ff0b6b1b1523dda21bc) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.982470 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 334b0349bfaa4a9c8b7d280177f1ecae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.982942 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet c48ca4b429294782a9e6ed496c6dfb72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.983104 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bd182d7cb414f07944072b0c00ee35c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:08.987118 5628 tablet_bootstrap.cc:492] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:08.987167 7190 ts_tablet_manager.cc:1929] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:08.987354 7190 log.cc:1199] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/008516a474cc40f2b9de77b2f3e762cf
I20260927 13:50:08.987797 7190 ts_tablet_manager.cc:1950] T 008516a474cc40f2b9de77b2f3e762cf P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:08.987684 7481 raft_consensus.cc:493] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.988013 7481 raft_consensus.cc:515] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.988651 7481 leader_election.cc:290] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:08.989138 5628 ts_tablet_manager.cc:1403] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.106s user 0.040s sys 0.012s
I20260927 13:50:08.989171 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 008516a474cc40f2b9de77b2f3e762cf (table default.Table_c700b32dc7b84e708c594f19077a40d1 [id=de5e7f4beb904151afa92b9e3f1151b2]) successfully deleted
I20260927 13:50:08.989500 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdef4f56d9647118afe83ac3cd364fd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:08.990039 5044 leader_election.cc:343] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:08.995339 7111 log.cc:1199] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/9bd182d7cb414f07944072b0c00ee35c
I20260927 13:50:08.995752 7111 ts_tablet_manager.cc:1950] T 9bd182d7cb414f07944072b0c00ee35c P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:08.995995 7190 tablet_replica.cc:333] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:08.996277 7190 raft_consensus.cc:2243] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:08.996487 7190 raft_consensus.cc:2272] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.996541 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 152) took 2433 ms. Trace:
I20260927 13:50:08.996626 7111 rpcz_store.cc:276] 0927 13:50:06.563072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.563111 (+ 39us) service_pool.cc:224] Handling call
0927 13:50:08.722510 (+2159399us) ts_tablet_manager.cc:1151] Deleting tablet 9bd182d7cb414f07944072b0c00ee35c
0927 13:50:08.722519 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.928408 (+205889us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.933296 (+ 4888us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:08.996520 (+ 63224us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2159248}
I20260927 13:50:08.996924 7111 tablet_replica.cc:333] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:08.997107 7111 raft_consensus.cc:2243] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:08.997421 7111 raft_consensus.cc:2272] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:08.997818 7190 ts_tablet_manager.cc:1916] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:08.956691 5619 tablet_bootstrap.cc:492] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:08.984055 7424 raft_consensus.cc:493] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:08.998152 7424 raft_consensus.cc:515] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:08.998689 7424 leader_election.cc:290] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:08.992542 7231 consensus_queue.cc:1048] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.993501 7305 consensus_queue.cc:1048] T b0827a26334c42728545a9eaa006fae0 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.993876 7423 consensus_queue.cc:1048] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:08.999751 5619 ts_tablet_manager.cc:1403] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.111s user 0.003s sys 0.000s
I20260927 13:50:09.000764 7423 raft_consensus.cc:493] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.000870 7423 raft_consensus.cc:515] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.001353 7423 leader_election.cc:290] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.001776 5619 raft_consensus.cc:359] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.001962 5619 raft_consensus.cc:385] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.002045 5619 raft_consensus.cc:740] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.002353 5619 consensus_queue.cc:260] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.003728 5626 tablet_bootstrap.cc:492] T 3ee18063dc634385b9e61fae3b3ece99 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.003855 5626 ts_tablet_manager.cc:1403] T 3ee18063dc634385b9e61fae3b3ece99 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.004s
I20260927 13:50:09.003893 5619 ts_tablet_manager.cc:1434] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 13:50:09.005174 5619 tablet_bootstrap.cc:492] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:09.005240 5626 raft_consensus.cc:359] T 3ee18063dc634385b9e61fae3b3ece99 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.005399 5626 raft_consensus.cc:385] T 3ee18063dc634385b9e61fae3b3ece99 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.006469 5626 raft_consensus.cc:740] T 3ee18063dc634385b9e61fae3b3ece99 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.006893 5626 consensus_queue.cc:260] T 3ee18063dc634385b9e61fae3b3ece99 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:09.008456 5045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 49329.7us
W20260927 13:50:09.008766 5045 leader_election.cc:343] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.008958 5045 leader_election.cc:304] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:09.009435 5045 leader_election.cc:343] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.009598 5045 leader_election.cc:304] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.009861 7481 raft_consensus.cc:2749] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.010013 7481 raft_consensus.cc:2749] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:09.010476 5045 leader_election.cc:343] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.010643 5045 leader_election.cc:304] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.010916 7546 raft_consensus.cc:2749] T 36314f4c93434b1f8d462aa9d838da78 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:09.011057 5045 leader_election.cc:343] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.011202 5045 leader_election.cc:304] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:09.011639 5045 leader_election.cc:343] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.011802 5045 leader_election.cc:304] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.012046 7481 raft_consensus.cc:2749] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.012187 7481 raft_consensus.cc:2749] T 58acd8932a2647a0a20679614cc2b68a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:09.012559 5045 leader_election.cc:343] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.012691 5626 ts_tablet_manager.cc:1434] T 3ee18063dc634385b9e61fae3b3ece99 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260927 13:50:09.012706 5045 leader_election.cc:304] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.013206 7190 ts_tablet_manager.cc:1929] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:09.013501 5628 raft_consensus.cc:359] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.013743 5628 raft_consensus.cc:385] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.016171 5619 tablet_bootstrap.cc:654] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.016292 5628 raft_consensus.cc:740] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.016484 7481 raft_consensus.cc:2749] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.017398 5628 consensus_queue.cc:260] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.020866 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 9bd182d7cb414f07944072b0c00ee35c (table default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b [id=48d90d1ed51f4b18b9ad5a1b7fc3cde4]) successfully deleted
I20260927 13:50:09.014058 5626 tablet_bootstrap.cc:492] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.021523 5628 ts_tablet_manager.cc:1434] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260927 13:50:09.021696 7190 log.cc:1199] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/992bf643dee64bccaa993a08027aa5fc
I20260927 13:50:09.021803 5628 tablet_bootstrap.cc:492] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.022056 7190 ts_tablet_manager.cc:1950] T 992bf643dee64bccaa993a08027aa5fc P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:09.023408 5626 tablet_bootstrap.cc:654] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.023769 5628 tablet_bootstrap.cc:654] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.025914 7190 tablet_replica.cc:333] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:09.026280 7190 raft_consensus.cc:2243] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:09.026522 7190 pending_rounds.cc:70] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:50:09.026611 7190 pending_rounds.cc:77] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957667692204032 op_type: NO_OP noop_request { }
I20260927 13:50:09.026767 7190 raft_consensus.cc:2889] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:09.026902 7190 raft_consensus.cc:2272] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.028487 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 992bf643dee64bccaa993a08027aa5fc (table default.Table_85388904282441d09642d64019688c97 [id=00fdc87b0cbf4bc091a92db3004b4397]) successfully deleted
W20260927 13:50:09.028751 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 413d863d9a564e5d8325b4479346730d because the tablet was not found. No further retry: Not found: Tablet not found: 413d863d9a564e5d8325b4479346730d
I20260927 13:50:09.029359 7190 ts_tablet_manager.cc:1916] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.036424 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet f3f6a9c5e4be480796f433a68945dd72 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef5969312044a2bab451841ec65aa84) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.036892 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 84d9c94ee0af46e8aea12adac57829f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.037086 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet e26a3a50396940cf826442e4ba7356a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.037252 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bc839e0fc54839a5d06c176760f618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.037400 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 95726f690a71433ca63f95da4ee750e5 with delete_type TABLET_DATA_DELETED (replaced by tablet cddf1b48a78e4ff789e0bb0bf75e307b) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.037760 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 03a1f13b31934baa8ce18fc499e94806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.038189 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e1acd618fc44be9169fa1d56fa510a with delete_type TABLET_DATA_DELETED (replaced by tablet 14f5479761f94ee0b339e125d06a808c) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.038357 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet da75a470ec0c4ec9afa7c18a51cd7276 with delete_type TABLET_DATA_DELETED (replaced by tablet bad30e7310c842e6818471272f5d669e) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.038847 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet e730a00ad2e646a4ba594ba9434c3b50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.038863 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 52050d7e35dc4fbab3c7c079d07478e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:06 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.039093 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a07adcd33414d18ae9720e7a307548a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.039767 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet f46f45a0a13b4e05802a08880d7f6a01 with delete_type TABLET_DATA_DELETED (replaced by tablet b594c65e18d94d1dba45b34dc520823c) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.039914 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 58d9274ad0934f19a7c36325eee3dd59 with delete_type TABLET_DATA_DELETED (replaced by tablet 0dbdc347bc9845b2b577f551577d070b) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.040025 5225 tablet_service.cc:1558] Processing DeleteTablet for tablet 614f1af61461466da975bea681162727 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.040452 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet b5a9f864e4274666a86baed43e1623cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.040839 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 0361e3b244a1437b8e402dd8602528fe with delete_type TABLET_DATA_DELETED (replaced by tablet 187b3ceeccb142c4b798947e584d6044) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.042725 7370 raft_consensus.cc:493] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.042860 7370 raft_consensus.cc:515] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.042884 5099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d48db9b20a41419d5be703190fadd8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:09.043059 5099 raft_consensus.cc:2468] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:09.043447 7370 leader_election.cc:290] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:09.044512 5185 leader_election.cc:343] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: f3f6a9c5e4be480796f433a68945dd72
I20260927 13:50:09.045605 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a98e712fb3492f9e4ebccfd489c16f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.046167 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d48db9b20a41419d5be703190fadd8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.046304 5628 tablet_bootstrap.cc:492] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.046473 5628 ts_tablet_manager.cc:1403] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260927 13:50:09.047286 5628 raft_consensus.cc:359] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.047523 5628 raft_consensus.cc:385] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.047631 5628 raft_consensus.cc:740] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.047942 5628 consensus_queue.cc:260] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.048627 5628 ts_tablet_manager.cc:1434] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:08.997938 7111 ts_tablet_manager.cc:1916] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.050943 5619 tablet_bootstrap.cc:492] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:09.051091 5619 ts_tablet_manager.cc:1403] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.000s
I20260927 13:50:09.051734 5628 tablet_bootstrap.cc:492] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.051983 7305 raft_consensus.cc:493] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.052114 7305 raft_consensus.cc:515] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.052640 7305 leader_election.cc:290] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.054364 7190 ts_tablet_manager.cc:1929] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.054534 7190 log.cc:1199] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/bf557ac29964453583f224b46178c7dd
I20260927 13:50:09.054949 7190 ts_tablet_manager.cc:1950] T bf557ac29964453583f224b46178c7dd P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:09.055236 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9872d637765b4d719e2de63ae1eb3196" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.055687 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a1193719e140beb9b492927adeb78c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.056044 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdef4f56d9647118afe83ac3cd364fd" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:09.056144 5184 leader_election.cc:343] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f3f6a9c5e4be480796f433a68945dd72
I20260927 13:50:09.056260 5184 leader_election.cc:304] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.056553 7190 tablet_replica.cc:333] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:09.056749 7190 raft_consensus.cc:2243] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.056802 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet bf557ac29964453583f224b46178c7dd (table default.Table_2f83c545334d4bc995f6afb456fb190b [id=00aa74ea071b484daf2c9854a1e87728]) successfully deleted
I20260927 13:50:09.056881 7190 raft_consensus.cc:2272] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.056931 7370 raft_consensus.cc:2749] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:09.057034 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 5e3fa4870d5547a2bbffe1745b964504 because the tablet was not found. No further retry: Not found: Tablet not found: 5e3fa4870d5547a2bbffe1745b964504
W20260927 13:50:09.057214 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2b082227264e442a8b1db7a68fb0c3eb because the tablet was not found. No further retry: Not found: Tablet not found: 2b082227264e442a8b1db7a68fb0c3eb
I20260927 13:50:09.057694 7190 ts_tablet_manager.cc:1916] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.057971 7359 consensus_queue.cc:1048] T c44dc61b4003469e8f404b73f22f7291 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:09.057969 7305 consensus_queue.cc:1048] T 0dc69551c99942b09862904266572471 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:09.059957 7305 raft_consensus.cc:493] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:09.060089 7305 raft_consensus.cc:515] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.060588 7305 leader_election.cc:290] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.066498 5619 raft_consensus.cc:359] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.066679 5619 raft_consensus.cc:385] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.066725 5619 raft_consensus.cc:740] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.069113 7190 ts_tablet_manager.cc:1929] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:09.070149 5619 consensus_queue.cc:260] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.072790 5628 tablet_bootstrap.cc:654] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.072790 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a98e712fb3492f9e4ebccfd489c16f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:09.073285 5096 raft_consensus.cc:2468] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:09.070533 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 4211f338c6a648c5b3e36c6df0b3c510 with delete_type TABLET_DATA_DELETED (replaced by tablet 85debab98b0f42a5b50f1b0d132147d3) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.075029 7190 log.cc:1199] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/e25f5898369f46fba32b7df27b334b28
I20260927 13:50:09.075562 7190 ts_tablet_manager.cc:1950] T e25f5898369f46fba32b7df27b334b28 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:09.076663 7190 tablet_replica.cc:333] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:09.077085 7190 raft_consensus.cc:2243] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.077101 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet e25f5898369f46fba32b7df27b334b28 (table default.Table_13777f8bd8dc43b6b1da8868bbdc5e40 [id=248111d3c564489c80ec8b9d1629f49a]) successfully deleted
I20260927 13:50:09.077546 7190 raft_consensus.cc:2272] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.082957 5619 ts_tablet_manager.cc:1434] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260927 13:50:09.086263 7305 consensus_queue.cc:1048] T b6985779674646f4abe18cdf7c063c90 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:09.088809 5628 tablet_bootstrap.cc:492] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.089027 5628 ts_tablet_manager.cc:1403] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.003s
I20260927 13:50:09.089932 5628 raft_consensus.cc:359] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.090040 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet f702b0a6380543a8ac539125d4334cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.090250 5628 raft_consensus.cc:385] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.090233 7305 consensus_queue.cc:1048] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:09.090372 5628 raft_consensus.cc:740] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.090835 5628 consensus_queue.cc:260] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.092049 5628 ts_tablet_manager.cc:1434] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:09.092494 5628 tablet_bootstrap.cc:492] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.098749 5619 tablet_bootstrap.cc:492] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:09.098850 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.099215 5628 tablet_bootstrap.cc:654] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:09.101632 5319 consensus_peers.cc:597] T 52050d7e35dc4fbab3c7c079d07478e8 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Couldn't send request to peer 79c1646c9659434b9a659382d2eb1d8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52050d7e35dc4fbab3c7c079d07478e8. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:09.107290 7190 ts_tablet_manager.cc:1916] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.109949 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet b57886cc11a2423983c2b7bac79150a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.109949 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet bb25bb5ee153494d803130f1ad4f7c2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.110257 5628 tablet_bootstrap.cc:492] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.110464 5628 ts_tablet_manager.cc:1403] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.004s
I20260927 13:50:09.111223 5628 raft_consensus.cc:359] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.111466 5628 raft_consensus.cc:385] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.111557 5628 raft_consensus.cc:740] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.111855 5628 consensus_queue.cc:260] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.113036 5628 ts_tablet_manager.cc:1434] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:09.113777 5628 tablet_bootstrap.cc:492] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.116205 5628 tablet_bootstrap.cc:654] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.127139 7305 raft_consensus.cc:493] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:09.127318 7305 raft_consensus.cc:515] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.128098 7305 leader_election.cc:290] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:09.131933 5319 leader_election.cc:343] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:09.132136 5319 leader_election.cc:343] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.132712 7370 raft_consensus.cc:493] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.132856 7370 raft_consensus.cc:515] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.133577 7370 leader_election.cc:290] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.134285 5628 tablet_bootstrap.cc:492] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.134322 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.134533 5628 ts_tablet_manager.cc:1403] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.000s
I20260927 13:50:09.135319 5628 raft_consensus.cc:359] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.135538 5628 raft_consensus.cc:385] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.135663 5628 raft_consensus.cc:740] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.136566 5619 tablet_bootstrap.cc:654] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.135974 5628 consensus_queue.cc:260] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.137642 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:09.137856 5108 raft_consensus.cc:2468] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:09.138027 5628 ts_tablet_manager.cc:1434] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:09.138547 5184 leader_election.cc:304] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.138382 5628 tablet_bootstrap.cc:492] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.138893 5626 tablet_bootstrap.cc:492] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.138942 7370 raft_consensus.cc:2804] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260927 13:50:09.139027 7370 raft_consensus.cc:493] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.139102 7370 raft_consensus.cc:3060] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:50:09.139225 5626 ts_tablet_manager.cc:1403] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.126s user 0.007s sys 0.003s
I20260927 13:50:09.140132 5626 raft_consensus.cc:359] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.140292 5626 raft_consensus.cc:385] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.140338 5626 raft_consensus.cc:740] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.140560 5626 consensus_queue.cc:260] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.140941 5628 tablet_bootstrap.cc:654] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.140972 5626 ts_tablet_manager.cc:1434] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:09.141225 5626 tablet_bootstrap.cc:492] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.142294 7370 raft_consensus.cc:515] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.142899 7370 leader_election.cc:290] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.143302 5626 tablet_bootstrap.cc:654] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.144164 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:09.146024 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e8ae1a0ce2496cb2eed2066eb37a13" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:09.146227 5108 raft_consensus.cc:3060] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:50:09.147274 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet a9503dd46ccf472581d1a667eea300ed with delete_type TABLET_DATA_DELETED (replaced by tablet 4cb71dd1785841b1b031cb09422a505d) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.148221 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 with delete_type TABLET_DATA_DELETED (replaced by tablet cf1a58c67bf54493a3c62fb175acabb8) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.148833 5628 tablet_bootstrap.cc:492] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.148890 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b13c629908a47368846770c697aebd8 with delete_type TABLET_DATA_DELETED (replaced by tablet dec7c4c6b46d4b5791d9b7af1a8e55cc) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.149083 5628 ts_tablet_manager.cc:1403] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.001s
I20260927 13:50:09.149546 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c2f814bb9ff41ebab19e8c16cf4affa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.149865 5108 raft_consensus.cc:2468] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 2.
I20260927 13:50:09.150041 5628 raft_consensus.cc:359] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.150305 5628 raft_consensus.cc:385] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.150413 5628 raft_consensus.cc:740] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.150377 5184 leader_election.cc:304] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters: bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.150532 7190 ts_tablet_manager.cc:1929] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:09.150709 7190 log.cc:1199] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/8ca5b5f9ca1e44eb8cc8bb9e1ff11102
I20260927 13:50:09.150724 5628 consensus_queue.cc:260] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.150801 7370 raft_consensus.cc:2804] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Leader election won for term 2
I20260927 13:50:09.151916 5628 ts_tablet_manager.cc:1434] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:09.151895 7370 raft_consensus.cc:697] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 2 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:09.152262 5628 tablet_bootstrap.cc:492] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.152356 7370 consensus_queue.cc:237] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.153759 7190 ts_tablet_manager.cc:1950] T 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:09.154765 5628 tablet_bootstrap.cc:654] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.155901 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 8ca5b5f9ca1e44eb8cc8bb9e1ff11102 (table default.Table_7675c4eea2d04c06b01cf0466c4ed466 [id=c58f2a8e5acf483d89fb782663512587]) successfully deleted
I20260927 13:50:09.156064 7370 raft_consensus.cc:493] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.156193 7370 raft_consensus.cc:515] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.157080 7370 leader_election.cc:290] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.157080 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880ce1300eac40b28aac8cba3e11077e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.159567 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880ce1300eac40b28aac8cba3e11077e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:09.159770 5108 raft_consensus.cc:2393] T 880ce1300eac40b28aac8cba3e11077e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:09.160297 7190 tablet_replica.cc:333] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:09.160262 5184 leader_election.cc:304] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.160491 7190 raft_consensus.cc:2243] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 13:50:09.160930 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 5978cb78bd974d669817def05007d0ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5978cb78bd974d669817def05007d0ea already in progress: creating tablet
I20260927 13:50:09.161173 7190 raft_consensus.cc:2272] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:09.161393 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 417b99e95ab4422d96b606fc76698324 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 417b99e95ab4422d96b606fc76698324 already in progress: creating tablet
I20260927 13:50:09.161715 7370 raft_consensus.cc:3060] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.163532 5628 tablet_bootstrap.cc:492] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.163707 5628 ts_tablet_manager.cc:1403] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260927 13:50:09.164857 5628 raft_consensus.cc:359] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.165016 7370 raft_consensus.cc:2749] T 880ce1300eac40b28aac8cba3e11077e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.165130 5628 raft_consensus.cc:385] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.165228 5628 raft_consensus.cc:740] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.165520 5628 consensus_queue.cc:260] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.167150 5628 ts_tablet_manager.cc:1434] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:09.168010 5628 tablet_bootstrap.cc:492] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.168180 7551 raft_consensus.cc:493] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:09.168341 7551 raft_consensus.cc:515] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.168917 7551 leader_election.cc:290] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.170583 5628 tablet_bootstrap.cc:654] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.170603 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 0880140d99004eb1803d6b5dcf41af13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.173524 5099 raft_consensus.cc:1240] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 2 FOLLOWER]: Rejecting Update request from peer bb28c54312c94d7dafb1c2abf7870735 for earlier term 1. Current term is 2. Ops: []
I20260927 13:50:09.173636 5238 raft_consensus.cc:3060] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.175088 7481 raft_consensus.cc:493] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.175202 7481 raft_consensus.cc:515] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.175731 7481 leader_election.cc:290] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.176285 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709e969569b43a7aace8d7cfe4e64c5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:09.176833 5044 leader_election.cc:343] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.179751 5626 tablet_bootstrap.cc:492] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.179911 5626 ts_tablet_manager.cc:1403] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.003s
I20260927 13:50:09.181319 5626 raft_consensus.cc:359] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.181475 5626 raft_consensus.cc:385] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.181516 5626 raft_consensus.cc:740] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.181704 5626 consensus_queue.cc:260] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.182101 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 3933c0a2fd6547f28528fae7d443a2c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.182224 5626 ts_tablet_manager.cc:1434] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260927 13:50:09.182503 5626 tablet_bootstrap.cc:492] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:09.184178 5045 leader_election.cc:343] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.184304 5045 leader_election.cc:304] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:09.184659 5045 leader_election.cc:343] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.184741 5045 leader_election.cc:304] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.184942 7546 raft_consensus.cc:2749] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:09.185024 5045 leader_election.cc:343] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.185088 5045 leader_election.cc:304] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.185113 7546 raft_consensus.cc:2749] T b9a1193719e140beb9b492927adeb78c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.185243 7546 raft_consensus.cc:2749] T 9fdef4f56d9647118afe83ac3cd364fd P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.186594 5626 tablet_bootstrap.cc:654] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.190258 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb0c2c2be04a598e011a9d99c5492a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.192047 5626 tablet_bootstrap.cc:492] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.192181 5626 ts_tablet_manager.cc:1403] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260927 13:50:09.192857 5626 raft_consensus.cc:359] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.193025 5626 raft_consensus.cc:385] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.193074 5626 raft_consensus.cc:740] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.193189 5628 tablet_bootstrap.cc:492] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.193392 5628 ts_tablet_manager.cc:1403] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.002s
I20260927 13:50:09.193318 5626 consensus_queue.cc:260] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.194299 5628 raft_consensus.cc:359] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.194572 5628 raft_consensus.cc:385] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.194679 5628 raft_consensus.cc:740] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.195021 5628 consensus_queue.cc:260] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.195212 5626 ts_tablet_manager.cc:1434] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:09.196234 5628 ts_tablet_manager.cc:1434] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:09.196419 5626 tablet_bootstrap.cc:492] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.197214 5628 tablet_bootstrap.cc:492] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.198288 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 36181512a94c4702ae0a417665919faa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.198501 5626 tablet_bootstrap.cc:654] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.199375 5628 tablet_bootstrap.cc:654] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.201143 5626 tablet_bootstrap.cc:492] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.201315 5626 ts_tablet_manager.cc:1403] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 13:50:09.201818 5619 tablet_bootstrap.cc:492] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:09.201982 5619 ts_tablet_manager.cc:1403] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.000s
I20260927 13:50:09.202260 5626 raft_consensus.cc:359] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.202482 5626 raft_consensus.cc:385] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.202553 5626 raft_consensus.cc:740] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.202855 5626 consensus_queue.cc:260] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.203330 5626 ts_tablet_manager.cc:1434] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:09.204226 5626 tablet_bootstrap.cc:492] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.205296 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dc140bba42a43758fa0c6540d728275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.206421 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 329fa4c25cec48f9830a8eb19794ea72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.208973 5626 tablet_bootstrap.cc:654] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.161733 7190 ts_tablet_manager.cc:1916] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.217185 5626 tablet_bootstrap.cc:492] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.217334 5626 ts_tablet_manager.cc:1403] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20260927 13:50:09.218056 5626 raft_consensus.cc:359] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.218264 5626 raft_consensus.cc:385] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.218318 5626 raft_consensus.cc:740] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.218547 5626 consensus_queue.cc:260] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.220135 7481 raft_consensus.cc:493] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.220278 7481 raft_consensus.cc:515] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.220902 7481 leader_election.cc:290] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.221733 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet a813939920244be781d546311fe8a33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.223307 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85130d7ea68545518ca3c255e28a20d3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.223755 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet ec130d31f6274fd9b730c2bb8bba817e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.224447 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet f75847513dcf4c84913a4073176f2507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:50 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.224874 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1b4494b7e895454f81fef308950729ef) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.225181 5626 ts_tablet_manager.cc:1434] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 13:50:09.225443 5626 tablet_bootstrap.cc:492] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.228356 5626 tablet_bootstrap.cc:654] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:09.228677 5044 leader_election.cc:343] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.228665 5619 raft_consensus.cc:359] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.228837 5619 raft_consensus.cc:385] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.228894 5619 raft_consensus.cc:740] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.229193 5619 consensus_queue.cc:260] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:09.232929 6429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.124:37095, user_credentials={real_user=slave}} blocked reactor thread for 106022us
I20260927 13:50:09.234232 7111 ts_tablet_manager.cc:1929] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.234346 7111 log.cc:1199] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/e26a3a50396940cf826442e4ba7356a8
I20260927 13:50:09.234874 7111 ts_tablet_manager.cc:1950] T e26a3a50396940cf826442e4ba7356a8 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:09.236392 7481 raft_consensus.cc:493] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.236523 7481 raft_consensus.cc:515] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.237074 7481 leader_election.cc:290] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:09.237632 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73546fba4ac846efbe9a9f4e346e4c21" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:09.238271 5044 leader_election.cc:343] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.238996 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 794da0992403462dbbce644134b8aab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.239388 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet b3fbf1e7f5e04122a65f6e192ffdae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.239704 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e30216e0487496f8efdb8a3b06deb5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.240304 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 98e2e305b92a4492a0df14a506c768f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.240491 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 06c810fde988439c97a8445fc88626b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 0191cfad4e7a4b088b2ecdc246bfa58a) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.240767 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cec272546cb4373bf69e3ab344c46e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.240998 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 14f5479761f94ee0b339e125d06a808c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.241750 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet f3e0e8d6bc744d69a9f41d45459d3b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:49 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.242717 5245 raft_consensus.cc:1240] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [term 2 LEADER]: Rejecting Update request from peer bb28c54312c94d7dafb1c2abf7870735 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260927 13:50:09.250608 7481 raft_consensus.cc:493] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.250754 7481 raft_consensus.cc:515] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.251382 7481 leader_election.cc:290] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.252118 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef5969312044a2bab451841ec65aa84" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:09.252713 5044 leader_election.cc:343] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.257710 5626 tablet_bootstrap.cc:492] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.257836 5626 ts_tablet_manager.cc:1403] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.032s user 0.015s sys 0.001s
I20260927 13:50:09.258566 5626 raft_consensus.cc:359] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.258725 5626 raft_consensus.cc:385] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.258774 5626 raft_consensus.cc:740] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.259058 5626 consensus_queue.cc:260] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.259524 5626 ts_tablet_manager.cc:1434] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:09.260461 5626 tablet_bootstrap.cc:492] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:09.267017 5184 consensus_peers.cc:597] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f702b0a6380543a8ac539125d4334cd5. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:09.267473 5626 tablet_bootstrap.cc:654] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.271559 7551 raft_consensus.cc:493] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:09.271790 7551 raft_consensus.cc:515] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.272665 7551 leader_election.cc:290] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.274585 5619 ts_tablet_manager.cc:1434] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.073s user 0.003s sys 0.000s
I20260927 13:50:09.276561 5626 tablet_bootstrap.cc:492] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.276813 5626 ts_tablet_manager.cc:1403] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.006s
I20260927 13:50:09.277505 5626 raft_consensus.cc:359] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.277680 5626 raft_consensus.cc:385] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.277742 5626 raft_consensus.cc:740] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.277988 5626 consensus_queue.cc:260] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.278571 5626 ts_tablet_manager.cc:1434] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:09.278889 7551 raft_consensus.cc:493] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.279093 7551 raft_consensus.cc:515] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.279558 5626 tablet_bootstrap.cc:492] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.280428 7551 leader_election.cc:290] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:09.282085 5626 tablet_bootstrap.cc:654] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.287544 5319 leader_election.cc:304] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:09.287899 7305 raft_consensus.cc:2804] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.288017 7305 raft_consensus.cc:493] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.288115 7305 raft_consensus.cc:3060] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.289958 5626 tablet_bootstrap.cc:492] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.290086 5626 ts_tablet_manager.cc:1403] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260927 13:50:09.290791 5626 raft_consensus.cc:359] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.290954 5626 raft_consensus.cc:385] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.291005 5626 raft_consensus.cc:740] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.292418 7305 raft_consensus.cc:515] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.291252 5626 consensus_queue.cc:260] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.293102 7359 raft_consensus.cc:493] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.293242 7359 raft_consensus.cc:515] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.293495 5626 ts_tablet_manager.cc:1434] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 13:50:09.293753 5626 tablet_bootstrap.cc:492] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.293901 7359 leader_election.cc:290] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.295565 5626 tablet_bootstrap.cc:654] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.296949 7305 leader_election.cc:290] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:09.298071 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 153) took 2734 ms. Trace:
I20260927 13:50:09.298255 7111 rpcz_store.cc:276] 0927 13:50:06.563405 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.563445 (+ 40us) service_pool.cc:224] Handling call
0927 13:50:08.996883 (+2433438us) ts_tablet_manager.cc:1151] Deleting tablet e26a3a50396940cf826442e4ba7356a8
0927 13:50:08.996893 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.084817 (+ 87924us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.234171 (+149354us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.298045 (+ 63874us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2433288}
I20260927 13:50:09.304323 7481 raft_consensus.cc:493] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.304488 7481 raft_consensus.cc:515] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.305073 7481 leader_election.cc:290] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.305276 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet bbb4f42522e84964aeb19358ee02dfc2 with delete_type TABLET_DATA_DELETED (replaced by tablet fcf4c143d5824458be4a42945c338dc9) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.310271 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4494b7e895454f81fef308950729ef" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:09.311218 5044 leader_election.cc:343] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.311544 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 26a8aca52f8c4566b274d13e6bb13ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.311776 5626 tablet_bootstrap.cc:492] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.311932 5626 ts_tablet_manager.cc:1403] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.000s
I20260927 13:50:09.312281 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a3f40a2da8649e0898c0e09b6e14a61 with delete_type TABLET_DATA_DELETED (replaced by tablet ead437e93bb14a73a820631b0be041aa) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.312824 5626 raft_consensus.cc:359] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.313416 5626 raft_consensus.cc:385] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.313469 5626 raft_consensus.cc:740] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.313683 5626 consensus_queue.cc:260] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.313858 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 081f18e00af74e5c811f774d29422351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:55 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.314154 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet b0827a26334c42728545a9eaa006fae0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5978cb78bd974d669817def05007d0ea) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.314291 5626 ts_tablet_manager.cc:1434] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 13:50:09.314631 5626 tablet_bootstrap.cc:492] T 6fdacca4b5bd4afb95c83f6c72091b2f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.314988 7265 raft_consensus.cc:493] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.315119 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:09.315109 7265 raft_consensus.cc:515] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.315645 7265 leader_election.cc:290] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.315649 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:09.316401 5626 tablet_bootstrap.cc:654] T 6fdacca4b5bd4afb95c83f6c72091b2f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.316378 5099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a98e712fb3492f9e4ebccfd489c16f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:09.316565 5099 raft_consensus.cc:2468] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:09.316812 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:09.317296 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]). Expected version 1 got 0
I20260927 13:50:09.317669 5184 leader_election.cc:304] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:09.317786 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:50:09.317987 7265 raft_consensus.cc:2804] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.318058 7265 raft_consensus.cc:493] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.318089 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:09.318156 7265 raft_consensus.cc:3060] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.318761 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
I20260927 13:50:09.318940 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:09.319551 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]). Expected version 1 got 0
I20260927 13:50:09.320220 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]). Expected version 1 got 0
I20260927 13:50:09.320832 7265 raft_consensus.cc:515] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.321653 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 2cc7301d09b245328a851a0734669965 (table default.Table_7a5a607e5463433eb93aedb9f76696db [id=1f268483d3c7447abfe7a024dd0aec58]). Expected version 1 got 0
I20260927 13:50:09.321944 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
I20260927 13:50:09.322507 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]). Expected version 1 got 0
I20260927 13:50:09.322510 5099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a98e712fb3492f9e4ebccfd489c16f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:09.322701 5099 raft_consensus.cc:3060] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.322827 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]). Expected version 3 got 0
I20260927 13:50:09.323115 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]). Expected version 5 got 0
I20260927 13:50:09.323277 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
I20260927 13:50:09.323781 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cddf1b48a78e4ff789e0bb0bf75e307b (table default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e]). Expected version 1 got 0
I20260927 13:50:09.324028 6442 catalog_manager.cc:5838] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:50:09.324587 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]). Expected version 1 got 0
I20260927 13:50:09.324806 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_954f47d3ef8846b8ade030d87002460e [id=750521adcb384c75841d7e1ff89af83d]). Expected version 2 got 0
I20260927 13:50:09.325186 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:50:09.325510 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:50:09.325611 5099 raft_consensus.cc:2468] T b1a98e712fb3492f9e4ebccfd489c16f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:09.325770 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
I20260927 13:50:09.326617 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]). Expected version 2 got 0
I20260927 13:50:09.326948 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]). Expected version 1 got 0
I20260927 13:50:09.327175 5184 leader_election.cc:304] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:09.327462 7203 raft_consensus.cc:2804] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.327497 7265 leader_election.cc:290] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.327634 7203 raft_consensus.cc:697] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:09.327867 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]). Expected version 2 got 0
I20260927 13:50:09.327893 7203 consensus_queue.cc:237] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.328075 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_cfdab7814ecc495089389612e0a7e4fe [id=ae170bbebc4e460fb58beb7f95f013a2]). Expected version 2 got 0
I20260927 13:50:09.328459 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_6ac0611179c743808ff8a129f463dd61 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 3 got 0
I20260927 13:50:09.328891 6442 catalog_manager.cc:5838] T 449e6bf85bf1434ab6ce42e751d31c6f P 79c1646c9659434b9a659382d2eb1d8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66). New cstate: current_term: 1 leader_uuid: "79c1646c9659434b9a659382d2eb1d8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:50:09.329865 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b594c65e18d94d1dba45b34dc520823c (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]). Expected version 1 got 0
I20260927 13:50:09.330767 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet e6b1e7169cdd4f6b8dced0a807bc17e8 (table default.Table_c74dcd01d43b41babf48734ca8244f9f [id=d45c549bb1fe42f48f0aff415f91c29b]). Expected version 2 got 0
I20260927 13:50:09.331395 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:09.331591 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]). Expected version 2 got 0
I20260927 13:50:09.331915 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]). Expected version 1 got 0
I20260927 13:50:09.332240 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:09.332815 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 9e808336f5b746d486d375695536c052 (table default.Table_36609f3408124349b504ae9eb3275d87 [id=d088563f44224b01a3eba63ce70e5681]). Expected version 1 got 0
I20260927 13:50:09.333065 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]). Expected version 1 got 0
I20260927 13:50:09.338346 5234 raft_consensus.cc:3060] T 3ee18063dc634385b9e61fae3b3ece99 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:09.338660 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 51147us
I20260927 13:50:09.339653 5319 leader_election.cc:304] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:09.342861 7481 consensus_queue.cc:1048] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:09.346239 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]). Expected version 1 got 0
I20260927 13:50:09.346519 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]). Expected version 1 got 0
I20260927 13:50:09.346721 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]). Expected version 1 got 0
I20260927 13:50:09.346930 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]). Expected version 2 got 0
I20260927 13:50:09.347344 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]). Expected version 2 got 0
I20260927 13:50:09.345225 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a98e712fb3492f9e4ebccfd489c16f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:09.347820 5380 raft_consensus.cc:3060] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.348109 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]). Expected version 1 got 0
I20260927 13:50:09.348572 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]). Expected version 1 got 0
I20260927 13:50:09.349244 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]). Expected version 1 got 0
I20260927 13:50:09.349442 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet c655651f9cb24310a5aa2e5b84c2a455 (table default.Table_5c96e3711de04429a590499eb47d5784 [id=db63359dda9d4b729446d6ddf78c30b8]). Expected version 1 got 0
I20260927 13:50:09.349694 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
I20260927 13:50:09.349872 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]). Expected version 1 got 0
I20260927 13:50:09.345242 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a98e712fb3492f9e4ebccfd489c16f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.346992 5619 tablet_bootstrap.cc:492] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:09.352983 5619 tablet_bootstrap.cc:654] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.354488 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 78719428d7b34f28a99722b093f6ab54 (table default.Table_6d795d7a66ee42f3a7fb0cef447cddba [id=ed8d36823c5c43eaa1e8b0447c7f32e9]). Expected version 1 got 0
I20260927 13:50:09.354658 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]). Expected version 2 got 0
I20260927 13:50:09.354890 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]). Expected version 1 got 0
I20260927 13:50:09.355154 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 3b26289ed050454d817c13159295ec37 (table default.Table_5b64a307e44a471598ef010e33a82fe3 [id=9c86bcdd37654832b7a92763aa42e6c4]). Expected version 1 got 0
I20260927 13:50:09.355706 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet a4099c41981f46758a8f478d7fdb4182 (table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]). Expected version 1 got 0
I20260927 13:50:09.356096 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]). Expected version 1 got 0
I20260927 13:50:09.356336 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet e3765fe06c664e60a11acf76c825bc42 (table default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee]). Expected version 1 got 0
I20260927 13:50:09.356524 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet ead437e93bb14a73a820631b0be041aa (table default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]). Expected version 1 got 0
I20260927 13:50:09.356849 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 85debab98b0f42a5b50f1b0d132147d3 (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]). Expected version 1 got 0
I20260927 13:50:09.357096 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 5678703b72c8471583147786f49122a5 (table default.Table_f3c5680fa304438d9df88d573453cd6f [id=0d85f9f0d28e43debda43f83a3e59637]). Expected version 2 got 0
I20260927 13:50:09.357456 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet e77aba9467864ad7ac9c1931c2162eef (table default.Table_de28ad6c05ff40b99876d163d6273ffc [id=03a2b911229f4ca989e3c0a76374ddb8]). Expected version 1 got 0
I20260927 13:50:09.357765 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6 (table default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]). Expected version 1 got 0
I20260927 13:50:09.357753 5380 raft_consensus.cc:2468] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:09.357960 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 0fe47041b75d492bbce62c95d90de021 (table default.Table_eabbc608c09045b095cdfe05e9660ac7 [id=a6d3f0f894904a738cc54fe5d8631f06]). Expected version 1 got 0
I20260927 13:50:09.347584 7111 tablet_replica.cc:333] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:09.367268 7111 raft_consensus.cc:2243] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:09.367697 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc (table default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]). Expected version 1 got 0
I20260927 13:50:09.367981 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 07830b76d7e14ff0b6b1b1523dda21bc (table default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]). Expected version 2 got 0
I20260927 13:50:09.368394 6442 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_b68a6b76e8684ab9ab1e52fbfaad3740 [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 2 got 0
I20260927 13:50:09.393186 7388 raft_consensus.cc:493] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.393392 7388 raft_consensus.cc:515] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.394201 7388 leader_election.cc:290] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:09.395310 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45096e907a9c44b7ace81357cdd575d4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:09.395983 5044 leader_election.cc:343] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.367616 7551 raft_consensus.cc:2764] T b1a98e712fb3492f9e4ebccfd489c16f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260927 13:50:09.379319 5619 tablet_bootstrap.cc:492] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:09.398262 5619 ts_tablet_manager.cc:1403] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.051s user 0.008s sys 0.000s
I20260927 13:50:09.398475 7111 raft_consensus.cc:2272] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.399029 5619 raft_consensus.cc:359] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.399194 5619 raft_consensus.cc:385] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.399269 5619 raft_consensus.cc:740] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.399446 5619 consensus_queue.cc:260] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.399931 5619 ts_tablet_manager.cc:1434] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:09.399951 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet d3149f6bbaf043f08970e19fd66c4e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.400137 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 76a397300cdd44eb899f2ef5b9fe8c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 9858d2c788f54e30b67c1235af8f51af) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.400209 5619 tablet_bootstrap.cc:492] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:09.401684 7603 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e421351a34d1463e9773dcebdeebae3c)
I20260927 13:50:09.401887 7603 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:50:09.402927 7603 leader_election.cc:290] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:50:09.403684 6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13a42ae8b95b495c9bcea85d6732cd77" candidate_term: 5 candidate_status { last_received { term: 4 index: 1091 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c" is_pre_election: true
I20260927 13:50:09.405135 5619 tablet_bootstrap.cc:654] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:09.389760 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 50137.7us
I20260927 13:50:09.412217 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet d51c3fa3624340059f6508ced1a2220e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.412457 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8bf79954c2429f886ac7afc9a8455f with delete_type TABLET_DATA_DELETED (replaced by tablet 502fe193f2034e37a53b245bbf049ae8) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.413049 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ed33e78ee5448bcae633cc874c3e171 with delete_type TABLET_DATA_DELETED (replaced by tablet f4cfddedc5cc4ec4a40b071253254703) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.413589 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff7d501f7704e69b696053cb1b1ffe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.415055 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 9855fd321e4b4d0aa37f7b31d7a5efca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.415277 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet bb7b3a35b2e94bbea6be4b4a8f158593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.415442 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet a0e14fd01a9141cdb2df030ee0dd05db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.415999 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64750141d74d988612304ce050688d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.416677 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 46537e1b33f24d50b705d53f6978da3c with delete_type TABLET_DATA_DELETED (replaced by tablet 34cd6225aaf34bdbbec06df453d57301) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.417827 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet d9cb99ad45d1445cb2e2854319a3d73d with delete_type TABLET_DATA_DELETED (replaced by tablet c16673cfe45f4c81806f4dda3246d476) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.422191 7111 ts_tablet_manager.cc:1916] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.424168 5619 tablet_bootstrap.cc:492] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:09.424337 5619 ts_tablet_manager.cc:1403] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.001s
I20260927 13:50:09.425253 5619 raft_consensus.cc:359] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.425482 5619 raft_consensus.cc:385] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.425547 5619 raft_consensus.cc:740] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.425841 5619 consensus_queue.cc:260] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.427716 5619 ts_tablet_manager.cc:1434] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:50:09.429590 5619 tablet_bootstrap.cc:492] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:09.429924 7305 consensus_queue.cc:1059] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:09.430258 7359 raft_consensus.cc:3055] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Stepping down as leader of term 1
I20260927 13:50:09.430330 7359 raft_consensus.cc:740] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
W20260927 13:50:09.430519 5319 consensus_peers.cc:597] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9503dd46ccf472581d1a667eea300ed. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:09.430596 7359 consensus_queue.cc:260] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:09.430701 5319 leader_election.cc:343] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 8aeb0c2c2be04a598e011a9d99c5492a
I20260927 13:50:09.431180 7359 raft_consensus.cc:3060] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Advancing to term 2
W20260927 13:50:09.433009 5711 leader_election.cc:336] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095): Network error: Client connection negotiation failed: client connection to 127.4.163.124:37095: connect: Connection refused (error 111)
I20260927 13:50:09.433284 5711 leader_election.cc:304] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13a42ae8b95b495c9bcea85d6732cd77; no voters: 802b83f09d3445359cfac825cd87c9de, e421351a34d1463e9773dcebdeebae3c
I20260927 13:50:09.433697 7603 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260927 13:50:09.439837 5619 tablet_bootstrap.cc:654] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:09.440063 5319 leader_election.cc:343] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3a07adcd33414d18ae9720e7a307548a
I20260927 13:50:09.440356 7305 consensus_queue.cc:1048] T 6ff7d501f7704e69b696053cb1b1ffe5 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:09.441526 5628 tablet_bootstrap.cc:492] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.441717 5628 ts_tablet_manager.cc:1403] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.245s user 0.061s sys 0.097s
I20260927 13:50:09.442523 5628 raft_consensus.cc:359] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.442750 5628 raft_consensus.cc:385] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.442801 7190 ts_tablet_manager.cc:1929] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:09.442857 5628 raft_consensus.cc:740] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.443077 5628 consensus_queue.cc:260] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.443624 5628 ts_tablet_manager.cc:1434] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260927 13:50:09.444828 5319 leader_election.cc:343] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 2657276c4b2f43c1ad64a8c1fd58ada9
I20260927 13:50:09.447286 5628 tablet_bootstrap.cc:492] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.449007 5628 tablet_bootstrap.cc:654] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.451498 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef5969312044a2bab451841ec65aa84" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.451890 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73546fba4ac846efbe9a9f4e346e4c21" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.451960 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709e969569b43a7aace8d7cfe4e64c5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.452209 5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85130d7ea68545518ca3c255e28a20d3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.452368 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4494b7e895454f81fef308950729ef" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.452800 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45096e907a9c44b7ace81357cdd575d4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.456442 5099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdacca4b5bd4afb95c83f6c72091b2f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:09.456630 5099 raft_consensus.cc:2468] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:09.457608 5108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d48db9b20a41419d5be703190fadd8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:09.457758 5108 raft_consensus.cc:3060] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.459830 5628 tablet_bootstrap.cc:492] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.459950 5628 ts_tablet_manager.cc:1403] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.002s
I20260927 13:50:09.460067 7551 raft_consensus.cc:493] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:09.460208 7551 raft_consensus.cc:515] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.460685 5108 raft_consensus.cc:2468] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:09.460816 7551 leader_election.cc:290] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:09.460991 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet e26a3a50396940cf826442e4ba7356a8 (table default.Table_3c83565e14ba4bdf96fcfceb17acdff3 [id=5f94649e22074c50b31b2156366e8993]) successfully deleted
I20260927 13:50:09.461278 5628 raft_consensus.cc:359] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.461431 5628 raft_consensus.cc:385] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.461421 7305 raft_consensus.cc:493] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:09.461483 5628 raft_consensus.cc:740] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.461555 7305 raft_consensus.cc:515] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.461668 5628 consensus_queue.cc:260] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.462055 7305 leader_election.cc:290] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:09.462508 5045 leader_election.cc:343] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.462878 7388 consensus_queue.cc:1048] T 3ee18063dc634385b9e61fae3b3ece99 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:09.462946 5045 leader_election.cc:304] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.463260 7388 raft_consensus.cc:2749] T 7ef5969312044a2bab451841ec65aa84 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:09.463306 5045 leader_election.cc:343] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.463389 5045 leader_election.cc:304] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:09.463703 5045 leader_election.cc:343] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.463781 5045 leader_election.cc:304] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:09.464080 5045 leader_election.cc:343] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.464145 5045 leader_election.cc:304] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:09.464398 5045 leader_election.cc:343] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.464465 5045 leader_election.cc:304] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.465261 7546 raft_consensus.cc:2749] T 73546fba4ac846efbe9a9f4e346e4c21 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.465407 7546 raft_consensus.cc:2749] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.465503 7546 raft_consensus.cc:2749] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.465587 7546 raft_consensus.cc:2749] T 1b4494b7e895454f81fef308950729ef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:09.472553 5045 leader_election.cc:343] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.472750 5045 leader_election.cc:304] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.473074 7617 raft_consensus.cc:2749] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.474336 5628 ts_tablet_manager.cc:1434] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260927 13:50:09.475119 5628 tablet_bootstrap.cc:492] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.476900 5628 tablet_bootstrap.cc:654] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.485134 5628 tablet_bootstrap.cc:492] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.485786 5628 ts_tablet_manager.cc:1403] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.005s
I20260927 13:50:09.486784 5628 raft_consensus.cc:359] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.487915 5628 raft_consensus.cc:385] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.488098 5628 raft_consensus.cc:740] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.488519 5628 consensus_queue.cc:260] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.488885 7481 raft_consensus.cc:493] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.489333 7481 raft_consensus.cc:515] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.490160 5628 ts_tablet_manager.cc:1434] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260927 13:50:09.490420 5628 tablet_bootstrap.cc:492] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.490778 7359 consensus_queue.cc:1048] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260927 13:50:09.491593 7481 leader_election.cc:290] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:50:09.490773 5319 leader_election.cc:343] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.492614 5319 leader_election.cc:304] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:09.492910 7359 raft_consensus.cc:2749] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.493031 5628 tablet_bootstrap.cc:654] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:09.493211 5319 leader_election.cc:343] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 3a07adcd33414d18ae9720e7a307548a
I20260927 13:50:09.493340 5319 leader_election.cc:304] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:09.497095 7424 raft_consensus.cc:2749] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260927 13:50:09.497553 5319 leader_election.cc:343] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 2657276c4b2f43c1ad64a8c1fd58ada9
I20260927 13:50:09.500555 5319 leader_election.cc:304] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:09.500835 7359 raft_consensus.cc:2749] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:50:09.503320 5628 tablet_bootstrap.cc:492] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.503778 5628 ts_tablet_manager.cc:1403] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.002s
I20260927 13:50:09.504650 5628 raft_consensus.cc:359] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.505695 5628 raft_consensus.cc:385] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 13:50:09.505069 5319 leader_election.cc:343] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 50fb1288684c45f6a778d809a5e2c160
I20260927 13:50:09.505990 5628 raft_consensus.cc:740] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:50:09.506016 5319 leader_election.cc:343] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 7c2f814bb9ff41ebab19e8c16cf4affa
I20260927 13:50:09.506515 5628 consensus_queue.cc:260] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.507316 5628 ts_tablet_manager.cc:1434] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:50:09.513718 5628 tablet_bootstrap.cc:492] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.516028 5628 tablet_bootstrap.cc:654] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.521718 7424 raft_consensus.cc:493] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.521965 7424 raft_consensus.cc:515] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.522835 7424 leader_election.cc:290] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:09.524154 5319 leader_election.cc:343] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 50fb1288684c45f6a778d809a5e2c160
I20260927 13:50:09.524420 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cf11a5af384512b361a83487c8b117" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.525187 5628 tablet_bootstrap.cc:492] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.525372 5628 ts_tablet_manager.cc:1403] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260927 13:50:09.526234 5628 raft_consensus.cc:359] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.526553 5628 raft_consensus.cc:385] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.526650 5628 raft_consensus.cc:740] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.526958 5628 consensus_queue.cc:260] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.524295 5319 leader_election.cc:304] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:09.527508 7412 raft_consensus.cc:2749] T 50fb1288684c45f6a778d809a5e2c160 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:50:09.527673 5628 ts_tablet_manager.cc:1434] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260927 13:50:09.527691 5319 leader_election.cc:343] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 0191cfad4e7a4b088b2ecdc246bfa58a
W20260927 13:50:09.527864 5319 leader_election.cc:343] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7c2f814bb9ff41ebab19e8c16cf4affa
I20260927 13:50:09.527963 5319 leader_election.cc:304] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:09.528064 5628 tablet_bootstrap.cc:492] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.528187 7359 raft_consensus.cc:2749] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260927 13:50:09.529199 6427 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e77aba9467864ad7ac9c1931c2162eef (table default.Table_de28ad6c05ff40b99876d163d6273ffc [id=03a2b911229f4ca989e3c0a76374ddb8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e77aba9467864ad7ac9c1931c2162eef consensus state has no leader
I20260927 13:50:09.531534 5628 tablet_bootstrap.cc:654] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.535298 5619 tablet_bootstrap.cc:492] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:09.535492 5619 ts_tablet_manager.cc:1403] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.106s user 0.008s sys 0.003s
I20260927 13:50:09.536460 5619 raft_consensus.cc:359] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.536708 5619 raft_consensus.cc:385] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.536801 5619 raft_consensus.cc:740] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.537087 5619 consensus_queue.cc:260] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.537735 5619 ts_tablet_manager.cc:1434] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:09.451707 5223 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fdef4f56d9647118afe83ac3cd364fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.452700 5215 tablet_service.cc:1558] Processing DeleteTablet for tablet 39fa23553c554826ad811ebe2e978ef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.538407 7190 log.cc:1199] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/1087ad60dade46bb9d38f52a94dd536b
I20260927 13:50:09.453207 5225 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b4494b7e895454f81fef308950729ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.453528 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 45096e907a9c44b7ace81357cdd575d4 with delete_type TABLET_DATA_DELETED (replaced by tablet fd861e06085e4c7b8bdf1101432bdc31) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.455200 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191cfad4e7a4b088b2ecdc246bfa58a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.538937 5238 raft_consensus.cc:2468] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:09.456082 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdacca4b5bd4afb95c83f6c72091b2f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.457216 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d48db9b20a41419d5be703190fadd8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:09.491290 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cf11a5af384512b361a83487c8b117" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.513465 5626 tablet_bootstrap.cc:492] T 6fdacca4b5bd4afb95c83f6c72091b2f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.539644 5626 ts_tablet_manager.cc:1403] T 6fdacca4b5bd4afb95c83f6c72091b2f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.225s user 0.022s sys 0.058s
I20260927 13:50:09.539670 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 269cda0876e346149512e0b4985c6890 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
W20260927 13:50:09.540119 5044 leader_election.cc:343] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.540445 5626 raft_consensus.cc:359] T 6fdacca4b5bd4afb95c83f6c72091b2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.540606 5626 raft_consensus.cc:385] T 6fdacca4b5bd4afb95c83f6c72091b2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.540661 5626 raft_consensus.cc:740] T 6fdacca4b5bd4afb95c83f6c72091b2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.540860 5626 consensus_queue.cc:260] T 6fdacca4b5bd4afb95c83f6c72091b2f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.540961 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 0191cfad4e7a4b088b2ecdc246bfa58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.541319 5626 ts_tablet_manager.cc:1434] T 6fdacca4b5bd4afb95c83f6c72091b2f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:09.541595 5626 tablet_bootstrap.cc:492] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.541867 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cb1d6091729498698924e6857ebfd6c with delete_type TABLET_DATA_DELETED (replaced by tablet 55f62f4ba23f4b82b9bcde89126ce1e6) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.527779 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet b9a1193719e140beb9b492927adeb78c with delete_type TABLET_DATA_DELETED (replaced by tablet a583d84f0f9247c68f330149b41e65ae) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.529147 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 370553521753488ab81e40144f2536ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.529932 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 284f6113fa4b443a869bce6d0c15f273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.544353 5626 tablet_bootstrap.cc:654] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.544824 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a737bef14b4874b61a109305ebb993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.545604 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet fbde77915c7d4665965bef2298c3491f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.546087 5628 tablet_bootstrap.cc:492] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.546281 5628 ts_tablet_manager.cc:1403] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.002s
I20260927 13:50:09.546694 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 12dd91ddaeff4f2a9d7a0761c08fc192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.538921 7190 ts_tablet_manager.cc:1950] T 1087ad60dade46bb9d38f52a94dd536b P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:09.547933 5319 leader_election.cc:304] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:09.548053 7190 tablet_replica.cc:333] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:09.548270 7359 raft_consensus.cc:2804] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.548269 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 1087ad60dade46bb9d38f52a94dd536b (table default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]) successfully deleted
I20260927 13:50:09.548377 5319 leader_election.cc:304] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:09.548434 7359 raft_consensus.cc:493] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.548555 7359 raft_consensus.cc:3060] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.548662 7424 raft_consensus.cc:2804] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.548816 7424 raft_consensus.cc:697] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:09.549065 7424 consensus_queue.cc:237] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.554478 7359 raft_consensus.cc:515] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.555387 7359 leader_election.cc:290] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.554533 7203 raft_consensus.cc:493] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.555709 7203 raft_consensus.cc:515] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.555815 7190 raft_consensus.cc:2243] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:09.556136 7190 raft_consensus.cc:2272] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.556347 7203 leader_election.cc:290] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.556478 5628 raft_consensus.cc:359] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.556699 5628 raft_consensus.cc:385] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.556756 5628 raft_consensus.cc:740] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.556842 7203 raft_consensus.cc:493] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.556948 7203 raft_consensus.cc:515] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.557153 7190 ts_tablet_manager.cc:1916] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.557560 7203 leader_election.cc:290] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.559036 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e2e305b92a4492a0df14a506c768f3" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.559283 5381 raft_consensus.cc:2468] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:09.559578 7620 raft_consensus.cc:493] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.559695 7620 raft_consensus.cc:515] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.559990 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec130d31f6274fd9b730c2bb8bba817e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.560151 5381 raft_consensus.cc:2468] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:09.560328 7620 leader_election.cc:290] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:09.561163 5185 leader_election.cc:304] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:09.561195 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb369fec2d43149080ab2ad94ecc57" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.561244 5628 consensus_queue.cc:260] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.561524 7203 raft_consensus.cc:2804] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.561594 7203 raft_consensus.cc:493] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.561652 7203 raft_consensus.cc:3060] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.561834 5628 ts_tablet_manager.cc:1434] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.015s user 0.000s sys 0.001s
I20260927 13:50:09.562418 5628 tablet_bootstrap.cc:492] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.564100 5628 tablet_bootstrap.cc:654] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.564455 7412 consensus_queue.cc:1048] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:09.564477 7203 raft_consensus.cc:515] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.564985 7203 leader_election.cc:290] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.565665 7481 raft_consensus.cc:493] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.565788 7481 raft_consensus.cc:515] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.566350 7481 leader_election.cc:290] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:50:09.566864 5319 leader_election.cc:343] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 081f18e00af74e5c811f774d29422351
W20260927 13:50:09.567015 5184 leader_election.cc:343] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: ec130d31f6274fd9b730c2bb8bba817e
W20260927 13:50:09.567193 5184 leader_election.cc:343] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 98e2e305b92a4492a0df14a506c768f3
W20260927 13:50:09.567579 5184 leader_election.cc:343] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 98e2e305b92a4492a0df14a506c768f3
I20260927 13:50:09.567941 5185 leader_election.cc:304] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
W20260927 13:50:09.568451 5044 leader_election.cc:343] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.569296 7265 raft_consensus.cc:2804] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.569371 7265 raft_consensus.cc:493] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.569428 7265 raft_consensus.cc:3060] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.569439 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed33e78ee5448bcae633cc874c3e171" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.572063 7265 raft_consensus.cc:515] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.572609 7265 leader_election.cc:290] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.572757 7265 raft_consensus.cc:493] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.572872 7265 raft_consensus.cc:515] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.573365 7265 leader_election.cc:290] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
W20260927 13:50:09.574043 5044 leader_election.cc:343] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.575043 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec130d31f6274fd9b730c2bb8bba817e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:09.575251 5381 raft_consensus.cc:3060] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.575362 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e2e305b92a4492a0df14a506c768f3" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:09.575505 5383 raft_consensus.cc:3060] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.578032 5381 raft_consensus.cc:2468] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
W20260927 13:50:09.579035 5184 leader_election.cc:343] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: da5d9bda857f467da6930a6c64266f3a
W20260927 13:50:09.579283 5184 leader_election.cc:343] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: ec130d31f6274fd9b730c2bb8bba817e
I20260927 13:50:09.579341 5628 tablet_bootstrap.cc:492] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.579460 5628 ts_tablet_manager.cc:1403] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.003s
I20260927 13:50:09.580027 5185 leader_election.cc:304] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.580211 5628 raft_consensus.cc:359] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.580437 5628 raft_consensus.cc:385] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.580497 7203 raft_consensus.cc:2804] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.580534 5628 raft_consensus.cc:740] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.580713 7203 raft_consensus.cc:697] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:09.580785 5628 consensus_queue.cc:260] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.581296 5628 ts_tablet_manager.cc:1434] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:09.582032 5628 tablet_bootstrap.cc:492] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.581557 7203 consensus_queue.cc:237] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.582386 7190 ts_tablet_manager.cc:1929] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.582688 7190 log.cc:1199] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/334b0349bfaa4a9c8b7d280177f1ecae
I20260927 13:50:09.583348 7190 ts_tablet_manager.cc:1950] T 334b0349bfaa4a9c8b7d280177f1ecae P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:09.578097 5383 raft_consensus.cc:2468] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:09.579079 7359 raft_consensus.cc:493] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:50:09.579879 5319 leader_election.cc:343] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7dc140bba42a43758fa0c6540d728275
I20260927 13:50:09.584040 7359 raft_consensus.cc:515] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.583180 7412 raft_consensus.cc:493] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:09.584307 5628 tablet_bootstrap.cc:654] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.584359 7412 raft_consensus.cc:515] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.584676 7359 leader_election.cc:290] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.584857 7412 leader_election.cc:290] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.579886 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5d9bda857f467da6930a6c64266f3a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.585145 5381 raft_consensus.cc:2468] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:09.585384 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fbf1e7f5e04122a65f6e192ffdae20" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.585628 5243 raft_consensus.cc:2468] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:09.586181 5626 tablet_bootstrap.cc:492] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.586351 5626 ts_tablet_manager.cc:1403] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.045s user 0.007s sys 0.010s
I20260927 13:50:09.586593 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 334b0349bfaa4a9c8b7d280177f1ecae (table default.Table_add07d0ee556457283038281d97f840b [id=28c3b0590cd643b988ee77d18c7afaec]) successfully deleted
I20260927 13:50:09.586844 7190 tablet_replica.cc:333] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:09.587198 7190 raft_consensus.cc:2243] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.587208 5626 raft_consensus.cc:359] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.587471 5626 raft_consensus.cc:385] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.587559 5626 raft_consensus.cc:740] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.587615 7190 raft_consensus.cc:2272] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.587826 5626 consensus_queue.cc:260] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.588368 5626 ts_tablet_manager.cc:1434] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:09.588691 5626 tablet_bootstrap.cc:492] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.588912 7190 ts_tablet_manager.cc:1916] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.590740 5626 tablet_bootstrap.cc:654] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.591795 5185 leader_election.cc:304] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.592133 7265 raft_consensus.cc:2804] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
W20260927 13:50:09.592301 5045 leader_election.cc:343] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.592417 5045 leader_election.cc:304] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.592427 7265 raft_consensus.cc:697] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:09.592676 7265 consensus_queue.cc:237] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.593163 7481 raft_consensus.cc:2749] T 76cf11a5af384512b361a83487c8b117 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.594970 5101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdacca4b5bd4afb95c83f6c72091b2f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:09.595144 5101 raft_consensus.cc:3060] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.595026 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.595160 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdacca4b5bd4afb95c83f6c72091b2f" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:09.595307 5243 raft_consensus.cc:3060] T 6fdacca4b5bd4afb95c83f6c72091b2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.595311 5245 raft_consensus.cc:2468] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:09.596271 5628 tablet_bootstrap.cc:492] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.596464 5628 ts_tablet_manager.cc:1403] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.005s
I20260927 13:50:09.597252 5628 raft_consensus.cc:359] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.597476 5628 raft_consensus.cc:385] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.597609 5628 raft_consensus.cc:740] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.597851 5628 consensus_queue.cc:260] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.599367 5628 ts_tablet_manager.cc:1434] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:50:09.599363 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:09.599743 5628 tablet_bootstrap.cc:492] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.600162 5107 raft_consensus.cc:2468] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:09.601389 5101 raft_consensus.cc:2468] T 6fdacca4b5bd4afb95c83f6c72091b2f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:09.601622 5628 tablet_bootstrap.cc:654] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:09.603529 5319 leader_election.cc:343] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 081f18e00af74e5c811f774d29422351
I20260927 13:50:09.603672 5319 leader_election.cc:304] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:09.603933 7305 raft_consensus.cc:2749] T 081f18e00af74e5c811f774d29422351 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260927 13:50:09.604387 5319 leader_election.cc:343] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 7dc140bba42a43758fa0c6540d728275
I20260927 13:50:09.605365 5319 leader_election.cc:304] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:09.605681 7305 raft_consensus.cc:2749] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:50:09.607024 5243 raft_consensus.cc:2468] T 6fdacca4b5bd4afb95c83f6c72091b2f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:09.607869 5185 leader_election.cc:304] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.608253 7361 raft_consensus.cc:2804] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.608384 7361 raft_consensus.cc:493] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.608465 7361 raft_consensus.cc:3060] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.612182 7361 raft_consensus.cc:515] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.613123 7190 ts_tablet_manager.cc:1929] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.613306 7190 log.cc:1199] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/c48ca4b429294782a9e6ed496c6dfb72
I20260927 13:50:09.613421 7361 leader_election.cc:290] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.613808 7190 ts_tablet_manager.cc:1950] T c48ca4b429294782a9e6ed496c6dfb72 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
W20260927 13:50:09.614367 5184 leader_election.cc:343] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: da5d9bda857f467da6930a6c64266f3a
I20260927 13:50:09.618701 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5d9bda857f467da6930a6c64266f3a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:09.618938 5381 raft_consensus.cc:3060] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.619948 7361 raft_consensus.cc:493] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.620194 7361 raft_consensus.cc:515] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.621536 7361 leader_election.cc:290] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.621973 5381 raft_consensus.cc:2468] T da5d9bda857f467da6930a6c64266f3a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:09.622295 5319 leader_election.cc:304] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
W20260927 13:50:09.622349 5184 leader_election.cc:343] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 4b13c629908a47368846770c697aebd8
I20260927 13:50:09.622588 7412 raft_consensus.cc:2804] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.622771 7412 raft_consensus.cc:493] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.622951 7412 raft_consensus.cc:3060] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.628029 7412 raft_consensus.cc:515] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.628912 7412 leader_election.cc:290] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:09.630486 5185 leader_election.cc:304] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.631939 7203 raft_consensus.cc:2804] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.632160 7203 raft_consensus.cc:697] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:09.632664 7203 consensus_queue.cc:237] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.634608 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e7e50142e447158f90770322609a2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.634717 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet a90d9bb192cf4e26812abb9c2ecc3682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.634473 5619 tablet_bootstrap.cc:492] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:09.635447 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet b0d6a3af321049b099e72dbfeb6b7a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
W20260927 13:50:09.629447 5319 leader_election.cc:343] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.635829 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet d9198ace6a264737a990d6fb573faf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
W20260927 13:50:09.636154 5319 leader_election.cc:343] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.636363 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 6964f549d6214ad9a21cf213a9bfa3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.636546 5319 leader_election.cc:304] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:09.636956 5319 leader_election.cc:304] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:09.637507 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet dd0126a6df14457ca5c62c129f3275f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.637627 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e768c83fae54619ac849dfedd5ec654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.637883 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet bb980bca9f16480ba050971b58aa46f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.638569 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.639423 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f4bc5cefef448d85ff31b7fafaca74 with delete_type TABLET_DATA_DELETED (replaced by tablet f3e3ebd06dd1429fa5ec20396e4bb5b6) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.640045 7359 raft_consensus.cc:2804] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.640154 7359 raft_consensus.cc:493] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.640260 7359 raft_consensus.cc:3060] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.640443 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet c99bf2abdfc64f169a3937f3e4499f75 with delete_type TABLET_DATA_DELETED (replaced by tablet d212ee5cd8f7416a840d307b16ba5e28) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.640792 7265 raft_consensus.cc:493] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.640923 7265 raft_consensus.cc:515] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.641485 7265 leader_election.cc:290] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.643211 7359 raft_consensus.cc:515] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.643530 5619 tablet_bootstrap.cc:654] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.643746 7359 leader_election.cc:290] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.643975 7618 raft_consensus.cc:493] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.644110 7359 raft_consensus.cc:2804] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260927 13:50:09.644191 7359 raft_consensus.cc:493] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.644105 7618 raft_consensus.cc:515] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.644289 7359 raft_consensus.cc:3060] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:50:09.644884 7618 leader_election.cc:290] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
W20260927 13:50:09.645503 5185 leader_election.cc:343] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 4b13c629908a47368846770c697aebd8
I20260927 13:50:09.645596 5185 leader_election.cc:304] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.646382 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7b3a35b2e94bbea6be4b4a8f158593" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.646569 5381 raft_consensus.cc:2468] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:09.646938 7265 raft_consensus.cc:2749] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.647136 7359 raft_consensus.cc:515] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.647730 7359 leader_election.cc:290] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.648681 5185 leader_election.cc:304] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:09.648691 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23d0d77dfb548c0b77295f185894c7c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:09.649286 5044 leader_election.cc:343] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.649637 7203 raft_consensus.cc:2804] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.649716 7203 raft_consensus.cc:493] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.649780 7203 raft_consensus.cc:3060] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.650803 7111 ts_tablet_manager.cc:1929] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.650966 7111 log.cc:1199] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/0361e3b244a1437b8e402dd8602528fe
I20260927 13:50:09.651387 7111 ts_tablet_manager.cc:1950] T 0361e3b244a1437b8e402dd8602528fe P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:09.652374 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 154) took 3088 ms. Trace:
I20260927 13:50:09.652463 7111 rpcz_store.cc:276] 0927 13:50:06.563730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.563769 (+ 39us) service_pool.cc:224] Handling call
0927 13:50:09.298778 (+2735009us) ts_tablet_manager.cc:1151] Deleting tablet 0361e3b244a1437b8e402dd8602528fe
0927 13:50:09.345104 (+ 46326us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.533166 (+188062us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.650738 (+117572us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.652308 (+ 1570us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2734864}
I20260927 13:50:09.652812 7111 tablet_replica.cc:333] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:09.652796 7098 rpcz_store.cc:276] 0927 13:50:06.405266 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.405367 (+ 101us) service_pool.cc:224] Handling call
0927 13:50:08.965146 (+2559779us) ts_tablet_manager.cc:1151] Deleting tablet 6964f549d6214ad9a21cf213a9bfa3ce
0927 13:50:08.965160 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:08.965393 (+ 233us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2559625}
I20260927 13:50:09.653043 7111 raft_consensus.cc:2243] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.653414 7111 raft_consensus.cc:2272] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:09.653474 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 6964f549d6214ad9a21cf213a9bfa3ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6964f549d6214ad9a21cf213a9bfa3ce already in progress: creating tablet
I20260927 13:50:09.654452 7190 tablet_replica.cc:333] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:09.654680 7190 raft_consensus.cc:2243] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.654677 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet c48ca4b429294782a9e6ed496c6dfb72 (table default.Table_7a48c16d7a32465cbc86892633257ea3 [id=49b35f9188a141e4af0afc5b3d2fd897]) successfully deleted
I20260927 13:50:09.654834 7190 raft_consensus.cc:2272] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.655452 7190 ts_tablet_manager.cc:1916] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.658039 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet a003afa0fbb74d548cfaba51ea6cef58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.658209 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 362f660cac76436aba54bb707d8a991c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:04 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.658603 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a40f69bb7d842889be30c4629d6786f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.658807 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c14a6b95c1e460a8e7a299340f09498 with delete_type TABLET_DATA_DELETED (replaced by tablet 8acd411b965c49919dc77c8c94853548) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.658838 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet a0575418f5ea4d82b34112e1bc9ab8b4 with delete_type TABLET_DATA_DELETED (replaced by tablet e3765fe06c664e60a11acf76c825bc42) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.659006 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet ecb5cdc007074e0c8f44d963e527a955 with delete_type TABLET_DATA_DELETED (replaced by tablet fc25ff5c6a3545759e7de977f91a9453) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.659724 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet 0076228c3f224d1f9d76ccf2dd7064ae with delete_type TABLET_DATA_DELETED (replaced by tablet 7710c6561bd84945a9ff017daf74a085) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.660692 7203 raft_consensus.cc:515] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.661963 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 179) took 3255 ms. Trace:
I20260927 13:50:09.662412 7098 rpcz_store.cc:276] 0927 13:50:06.406422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.406467 (+ 45us) service_pool.cc:224] Handling call
0927 13:50:09.661787 (+3255320us) ts_tablet_manager.cc:1151] Deleting tablet 9cb1d6091729498698924e6857ebfd6c
0927 13:50:09.661805 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.661936 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3246580}
W20260927 13:50:09.657860 6441 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 187b3ceeccb142c4b798947e584d6044 (table default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 187b3ceeccb142c4b798947e584d6044 consensus state has no leader
W20260927 13:50:09.664085 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 9cb1d6091729498698924e6857ebfd6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb1d6091729498698924e6857ebfd6c already in progress: creating tablet
I20260927 13:50:09.664361 7111 ts_tablet_manager.cc:1916] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.665400 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 180) took 3258 ms. Trace:
I20260927 13:50:09.666373 7098 rpcz_store.cc:276] 0927 13:50:06.407373 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.407427 (+ 54us) service_pool.cc:224] Handling call
0927 13:50:09.665228 (+3257801us) ts_tablet_manager.cc:1151] Deleting tablet 4bb8dc5aadf243e6838a48f6219b9ae2
0927 13:50:09.665256 (+ 28us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.665373 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3256261}
W20260927 13:50:09.667689 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bb8dc5aadf243e6838a48f6219b9ae2 already in progress: creating tablet
I20260927 13:50:09.668078 7098 tablet_replica.cc:333] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:09.663674 5228 tablet_service.cc:1558] Processing DeleteTablet for tablet cf1a58c67bf54493a3c62fb175acabb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9abb473dbb3d491c9d15a161541fe795) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.665232 5219 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bd9a95e2d24242aba890ee9d01c023 with delete_type TABLET_DATA_DELETED (replaced by tablet ad2b4316eeb643cc8c2440ed04191a57) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.665969 5626 tablet_bootstrap.cc:492] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.666216 5221 tablet_service.cc:1558] Processing DeleteTablet for tablet 71268fb7aa9646639ea41dc8ccebfc5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.667193 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 44d85213c05c465abda78cc49c70d36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.668447 5626 ts_tablet_manager.cc:1403] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.080s user 0.006s sys 0.013s
I20260927 13:50:09.669435 5626 raft_consensus.cc:359] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.669737 5626 raft_consensus.cc:385] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.669804 5626 raft_consensus.cc:740] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.669829 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 496cffc2a8774185a0e0f63208bed8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.670037 5626 consensus_queue.cc:260] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:09.669754 5184 leader_election.cc:343] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bb7b3a35b2e94bbea6be4b4a8f158593
I20260927 13:50:09.670514 5626 ts_tablet_manager.cc:1434] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:09.670778 5626 tablet_bootstrap.cc:492] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.672091 5626 tablet_bootstrap.cc:654] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.673077 7098 raft_consensus.cc:2243] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.673882 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 60de1c28618f4e478aae68ad07fbcf98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.673943 5619 tablet_bootstrap.cc:492] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:09.674132 5619 ts_tablet_manager.cc:1403] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.136s user 0.004s sys 0.000s
W20260927 13:50:09.675179 5319 leader_election.cc:343] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: bb25bb5ee153494d803130f1ad4f7c2e
I20260927 13:50:09.675136 5619 raft_consensus.cc:359] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.675390 5619 raft_consensus.cc:385] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.675436 5319 leader_election.cc:304] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:09.675513 5619 raft_consensus.cc:740] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.675760 5619 consensus_queue.cc:260] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.675963 7412 raft_consensus.cc:2804] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.676294 7412 raft_consensus.cc:697] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:09.676755 7412 consensus_queue.cc:237] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:09.677498 5184 leader_election.cc:343] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bb7b3a35b2e94bbea6be4b4a8f158593
I20260927 13:50:09.677951 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb369fec2d43149080ab2ad94ecc57" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.679025 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e3b98290dc74d88856e13f003a1e4c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.679847 7203 leader_election.cc:290] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.680277 7098 raft_consensus.cc:2272] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.681496 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7b3a35b2e94bbea6be4b4a8f158593" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:09.681753 5381 raft_consensus.cc:3060] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.684628 5381 raft_consensus.cc:2468] T bb7b3a35b2e94bbea6be4b4a8f158593 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:09.681164 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 08798185a7c641f98d7dc6a6b1b72e0a with delete_type TABLET_DATA_DELETED (replaced by tablet ecb5cdc007074e0c8f44d963e527a955) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.685032 5185 leader_election.cc:304] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.685509 7265 raft_consensus.cc:2804] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.686102 7265 raft_consensus.cc:697] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:09.686561 7265 consensus_queue.cc:237] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.687829 7618 raft_consensus.cc:493] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.688045 7618 raft_consensus.cc:515] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.676383 5619 ts_tablet_manager.cc:1434] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:09.688858 5619 tablet_bootstrap.cc:492] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:09.689144 7618 leader_election.cc:290] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:09.694931 5626 tablet_bootstrap.cc:492] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.695076 5626 ts_tablet_manager.cc:1403] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20260927 13:50:09.695884 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75594e5ee0427a80016bb8a19b6703" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.695850 5626 raft_consensus.cc:359] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.696241 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed33e78ee5448bcae633cc874c3e171" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.696400 5626 raft_consensus.cc:385] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.696487 5626 raft_consensus.cc:740] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.696789 5626 consensus_queue.cc:260] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.697608 5626 ts_tablet_manager.cc:1434] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260927 13:50:09.697690 5044 leader_election.cc:343] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.698068 5626 tablet_bootstrap.cc:492] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.701956 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet f49384587bfa41d6aabfa8ee175d6abe with delete_type TABLET_DATA_DELETED (replaced by tablet dd0126a6df14457ca5c62c129f3275f8) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.702544 7098 ts_tablet_manager.cc:1916] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.703835 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.704612 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet da5d9bda857f467da6930a6c64266f3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:02 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.706257 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23d0d77dfb548c0b77295f185894c7c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.706352 5619 tablet_bootstrap.cc:654] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.707047 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 2885e0829d014765b54124a0eb23a4dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.707670 5626 tablet_bootstrap.cc:654] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.708011 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet d3b38f40431f47a0acf1e11092d7717b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.708280 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75594e5ee0427a80016bb8a19b6703" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.708767 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 50fb1288684c45f6a778d809a5e2c160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.709337 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191cfad4e7a4b088b2ecdc246bfa58a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:09.709496 5234 raft_consensus.cc:3060] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.709875 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 467aa7fb4edf4b1b8dad6514d1d017b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:50:03 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.710966 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:09.711112 5245 raft_consensus.cc:3060] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:50:09.711215 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3f40a2da8649e0898c0e09b6e14a61" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:09.711386 5096 raft_consensus.cc:3060] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:50:09.711541 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ef5969312044a2bab451841ec65aa84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:59 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.712095 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet db75594e5ee0427a80016bb8a19b6703 with delete_type TABLET_DATA_DELETED (replaced by tablet a4099c41981f46758a8f478d7fdb4182) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.712455 5234 raft_consensus.cc:2468] T 0191cfad4e7a4b088b2ecdc246bfa58a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:09.712661 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ae6b1e46bdc4c28a2d0a2633d40f92a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:53 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.712733 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fbf1e7f5e04122a65f6e192ffdae20" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:09.712872 5238 raft_consensus.cc:3060] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.713276 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c7919f5076406186000cd4077aadaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.713862 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 73546fba4ac846efbe9a9f4e346e4c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.713989 5245 raft_consensus.cc:2468] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 2.
I20260927 13:50:09.714383 5096 raft_consensus.cc:2468] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 2.
I20260927 13:50:09.715848 5238 raft_consensus.cc:2468] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:09.719094 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 8aeb0c2c2be04a598e011a9d99c5492a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:54 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.719919 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a50f61eec39438f9d2b652f0346a0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:58 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.720866 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aed7fe630f64213846ad37d904f6516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.721809 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet c57b60cbc1ca462789fd8e7a235f7119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:56 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.723608 7111 ts_tablet_manager.cc:1929] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:09.723783 7111 log.cc:1199] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/4211f338c6a648c5b3e36c6df0b3c510
I20260927 13:50:09.724174 7111 ts_tablet_manager.cc:1950] T 4211f338c6a648c5b3e36c6df0b3c510 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:09.724594 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 3add644bb1f544e1b3c91fecfd6a541b with delete_type TABLET_DATA_DELETED (replaced by tablet c27872794fb24934b723c56935d94702) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.724980 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 155) took 3160 ms. Trace:
I20260927 13:50:09.725093 7111 rpcz_store.cc:276] 0927 13:50:06.564173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.564213 (+ 40us) service_pool.cc:224] Handling call
0927 13:50:09.652700 (+3088487us) ts_tablet_manager.cc:1151] Deleting tablet 4211f338c6a648c5b3e36c6df0b3c510
0927 13:50:09.652710 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.689766 (+ 37056us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.723520 (+ 33754us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.724959 (+ 1439us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3088338}
I20260927 13:50:09.725493 7111 tablet_replica.cc:333] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:09.725704 7111 raft_consensus.cc:2243] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.726011 7111 raft_consensus.cc:2272] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:09.725970 5045 leader_election.cc:343] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.726097 5045 leader_election.cc:304] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.726362 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 715b9af057f6425eb664e2399677890f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.726586 7618 raft_consensus.cc:2749] T 90fb369fec2d43149080ab2ad94ecc57 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.726967 5626 tablet_bootstrap.cc:492] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.727101 5626 ts_tablet_manager.cc:1403] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.002s
I20260927 13:50:09.727782 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6073174dbb4ca1933685b7bd3a22e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 13ad5733322545f699d980df99ae0dff) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.728087 5626 raft_consensus.cc:359] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.728261 5626 raft_consensus.cc:385] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.728329 5626 raft_consensus.cc:740] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.728673 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:52 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.728621 5626 consensus_queue.cc:260] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.729856 5212 tablet_service.cc:1558] Processing DeleteTablet for tablet 3700a1f40c0644848da62392cb0c297f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 13:49:51 UTC) from {username='slave'} at 127.0.0.1:44390
I20260927 13:50:09.732703 5628 tablet_bootstrap.cc:492] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.732856 5628 ts_tablet_manager.cc:1403] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.133s user 0.014s sys 0.023s
I20260927 13:50:09.732946 5626 ts_tablet_manager.cc:1434] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260927 13:50:09.733206 5626 tablet_bootstrap.cc:492] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.733582 5628 raft_consensus.cc:359] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.733750 5628 raft_consensus.cc:385] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.733819 5628 raft_consensus.cc:740] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.734030 5628 consensus_queue.cc:260] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.734668 5626 tablet_bootstrap.cc:654] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.737090 7190 ts_tablet_manager.cc:1929] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.739167 5619 tablet_bootstrap.cc:492] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:09.739326 5619 ts_tablet_manager.cc:1403] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.000s
I20260927 13:50:09.740383 5619 raft_consensus.cc:359] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.740545 5619 raft_consensus.cc:385] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.740593 5619 raft_consensus.cc:740] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.740754 5619 consensus_queue.cc:260] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:09.741669 6441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.4.163.66:54649 (request call id 112) took 4481 ms (client timeout 1000 ms). Trace:
I20260927 13:50:09.741820 7190 log.cc:1199] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/9bd182d7cb414f07944072b0c00ee35c
I20260927 13:50:09.742273 5619 ts_tablet_manager.cc:1434] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:09.742436 7190 ts_tablet_manager.cc:1950] T 9bd182d7cb414f07944072b0c00ee35c P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:09.744100 5619 tablet_bootstrap.cc:492] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:09.742520 7111 ts_tablet_manager.cc:1916] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.743502 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 9bd182d7cb414f07944072b0c00ee35c (table default.Table_ccb1421ca33b4475a2d09ef1c70b2b2b [id=48d90d1ed51f4b18b9ad5a1b7fc3cde4]) successfully deleted
W20260927 13:50:09.744467 6441 rpcz_store.cc:269] 0927 13:50:05.260238 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:05.299087 (+ 38849us) service_pool.cc:224] Handling call
0927 13:50:05.628507 (+329420us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x616000051754. stack: 00007fe7395025c6 00007fe739502380 00007fe73850a34d 00000000009a4cb4 00000000009a4c7d 00007fe748a7c65d 00007fe748a7c753 00007fe7455f9db1 00007fe74d3eda7d 00007fe74d5776e8 00007fe743f461f6 00007fe743f45f25 00007fe74064c63e 00007fe74064b51e 00007fe740651758 00007fe7406520bf
0927 13:50:09.741603 (+4113096us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189072,"reported_tablets":286,"spinlock_wait_cycles":323010944}
I20260927 13:50:09.746420 7098 ts_tablet_manager.cc:1929] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:09.746913 7190 tablet_replica.cc:333] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:09.747191 7098 log.cc:1199] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/45096e907a9c44b7ace81357cdd575d4
W20260927 13:50:09.747692 5045 leader_election.cc:343] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.747829 5045 leader_election.cc:304] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.748090 7190 raft_consensus.cc:2243] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.748452 7265 raft_consensus.cc:493] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.748569 7265 raft_consensus.cc:515] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
W20260927 13:50:09.748647 5045 leader_election.cc:343] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.748733 5045 leader_election.cc:304] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.748826 7618 raft_consensus.cc:2749] T d23d0d77dfb548c0b77295f185894c7c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.748993 7618 raft_consensus.cc:2749] T db75594e5ee0427a80016bb8a19b6703 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.749599 7265 leader_election.cc:290] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.750123 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e3bb24afad4d789041b6a557512618" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.750298 5381 raft_consensus.cc:2468] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:09.750815 5628 ts_tablet_manager.cc:1434] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260927 13:50:09.750838 5185 leader_election.cc:304] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:09.751164 5619 tablet_bootstrap.cc:654] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.751207 7265 raft_consensus.cc:2804] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.751399 7265 raft_consensus.cc:493] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.751513 7265 raft_consensus.cc:3060] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.754169 7265 raft_consensus.cc:515] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.754235 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e3bb24afad4d789041b6a557512618" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:09.754401 5096 raft_consensus.cc:2468] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:09.754925 7412 raft_consensus.cc:493] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.755045 7412 raft_consensus.cc:515] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.755625 7412 leader_election.cc:290] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.755937 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e3bb24afad4d789041b6a557512618" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:09.756134 5096 raft_consensus.cc:3060] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.756352 7265 leader_election.cc:290] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.756877 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e3bb24afad4d789041b6a557512618" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:09.757016 5381 raft_consensus.cc:3060] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.750849 5626 tablet_bootstrap.cc:492] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.758294 5626 ts_tablet_manager.cc:1403] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260927 13:50:09.758960 5626 raft_consensus.cc:359] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.759095 5626 raft_consensus.cc:385] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.759145 5626 raft_consensus.cc:740] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.759158 5096 raft_consensus.cc:2468] T 23e3bb24afad4d789041b6a557512618 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:09.759361 5626 consensus_queue.cc:260] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.759588 5628 tablet_bootstrap.cc:492] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.759667 5381 raft_consensus.cc:2468] T 23e3bb24afad4d789041b6a557512618 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:09.759840 5626 ts_tablet_manager.cc:1434] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 13:50:09.760089 5626 tablet_bootstrap.cc:492] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.760027 5184 leader_election.cc:304] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:09.760358 7203 raft_consensus.cc:2804] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.760495 7203 raft_consensus.cc:697] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:09.760707 7203 consensus_queue.cc:237] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.761780 7361 raft_consensus.cc:493] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.761889 7361 raft_consensus.cc:515] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.762403 7361 leader_election.cc:290] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.763640 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb0c2c2be04a598e011a9d99c5492a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.763783 5381 raft_consensus.cc:2468] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:09.764158 5185 leader_election.cc:304] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:09.764395 7265 raft_consensus.cc:2804] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.764464 7265 raft_consensus.cc:493] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.764529 7265 raft_consensus.cc:3060] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.766520 5628 tablet_bootstrap.cc:654] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.767771 7265 raft_consensus.cc:515] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:09.769115 5184 leader_election.cc:343] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 8aeb0c2c2be04a598e011a9d99c5492a
W20260927 13:50:09.769423 5319 leader_election.cc:343] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b3fbf1e7f5e04122a65f6e192ffdae20
I20260927 13:50:09.770063 7424 consensus_queue.cc:1048] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:09.770531 5319 leader_election.cc:343] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bb25bb5ee153494d803130f1ad4f7c2e
W20260927 13:50:09.771128 5184 leader_election.cc:343] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 8aeb0c2c2be04a598e011a9d99c5492a
I20260927 13:50:09.771288 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb0c2c2be04a598e011a9d99c5492a" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:09.771435 5381 raft_consensus.cc:3060] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.770982 5319 leader_election.cc:304] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:09.771685 7424 raft_consensus.cc:2749] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260927 13:50:09.772032 5319 leader_election.cc:343] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 0191cfad4e7a4b088b2ecdc246bfa58a
W20260927 13:50:09.772248 5319 leader_election.cc:343] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: b3fbf1e7f5e04122a65f6e192ffdae20
I20260927 13:50:09.772521 5319 leader_election.cc:304] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:09.772872 7359 raft_consensus.cc:2804] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Leader election won for term 2
I20260927 13:50:09.773000 7359 raft_consensus.cc:697] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [term 2 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:09.773204 7359 consensus_queue.cc:237] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.774804 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 4211f338c6a648c5b3e36c6df0b3c510 (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]) successfully deleted
I20260927 13:50:09.776269 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496cffc2a8774185a0e0f63208bed8a5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.776448 5238 raft_consensus.cc:2468] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:09.778066 5626 tablet_bootstrap.cc:654] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.786638 7111 ts_tablet_manager.cc:1929] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.790933 5626 tablet_bootstrap.cc:492] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.791143 7111 log.cc:1199] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b57886cc11a2423983c2b7bac79150a0
I20260927 13:50:09.792209 5626 ts_tablet_manager.cc:1403] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.001s
I20260927 13:50:09.792730 7111 ts_tablet_manager.cc:1950] T b57886cc11a2423983c2b7bac79150a0 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:09.793705 5626 raft_consensus.cc:359] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.794432 5626 raft_consensus.cc:385] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.794567 5626 raft_consensus.cc:740] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.794869 5626 consensus_queue.cc:260] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.798561 5626 ts_tablet_manager.cc:1434] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 13:50:09.799436 5626 tablet_bootstrap.cc:492] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.803081 5626 tablet_bootstrap.cc:654] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.789858 5381 raft_consensus.cc:2468] T 8aeb0c2c2be04a598e011a9d99c5492a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:09.810006 5185 leader_election.cc:304] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.818185 5319 leader_election.cc:304] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.818199 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 156) took 3253 ms. Trace:
I20260927 13:50:09.818462 7111 rpcz_store.cc:276] 0927 13:50:06.564580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.564619 (+ 39us) service_pool.cc:224] Handling call
0927 13:50:09.725443 (+3160824us) ts_tablet_manager.cc:1151] Deleting tablet b57886cc11a2423983c2b7bac79150a0
0927 13:50:09.725453 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.747367 (+ 21914us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.786538 (+ 39171us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.818170 (+ 31632us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23233,"tablet-delete.queue_time_us":3160682}
I20260927 13:50:09.818637 7551 raft_consensus.cc:2804] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.818760 7551 raft_consensus.cc:697] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:09.818907 7111 tablet_replica.cc:333] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:09.818977 7551 consensus_queue.cc:237] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.819098 7111 raft_consensus.cc:2243] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:09.819437 7111 raft_consensus.cc:2272] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.819468 5628 tablet_bootstrap.cc:492] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.819615 5628 ts_tablet_manager.cc:1403] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.060s user 0.011s sys 0.010s
I20260927 13:50:09.819694 7361 raft_consensus.cc:2804] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.819835 7361 raft_consensus.cc:697] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:09.820101 7361 consensus_queue.cc:237] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.821069 5319 leader_election.cc:304] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.821444 7551 raft_consensus.cc:2804] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.821560 7551 raft_consensus.cc:697] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:09.821759 7551 consensus_queue.cc:237] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.822029 7111 ts_tablet_manager.cc:1916] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.816674 7265 leader_election.cc:290] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.747762 7098 ts_tablet_manager.cc:1950] T 45096e907a9c44b7ace81357cdd575d4 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:09.823167 7305 raft_consensus.cc:493] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:09.823285 7305 raft_consensus.cc:515] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.823812 7305 leader_election.cc:290] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.822938 7190 raft_consensus.cc:2272] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.824607 5619 tablet_bootstrap.cc:492] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:09.824736 5619 ts_tablet_manager.cc:1403] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.081s user 0.010s sys 0.011s
I20260927 13:50:09.825986 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 181) took 3416 ms. Trace:
I20260927 13:50:09.826229 7190 ts_tablet_manager.cc:1916] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.826169 5619 raft_consensus.cc:359] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.826380 5619 raft_consensus.cc:385] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.826453 5619 raft_consensus.cc:740] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.826658 5619 consensus_queue.cc:260] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.828038 5619 ts_tablet_manager.cc:1434] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 13:50:09.828337 7098 rpcz_store.cc:276] 0927 13:50:06.409281 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.409333 (+ 52us) service_pool.cc:224] Handling call
0927 13:50:09.668029 (+3258696us) ts_tablet_manager.cc:1151] Deleting tablet 45096e907a9c44b7ace81357cdd575d4
0927 13:50:09.668038 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.715590 (+ 47552us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.746358 (+ 30768us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.825964 (+ 79606us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3256228}
I20260927 13:50:09.829030 5619 tablet_bootstrap.cc:492] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:09.829502 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 45096e907a9c44b7ace81357cdd575d4 (table default.Table_3b716a51ffbe4613a958b62eef4cdcb6 [id=f4ff4dd6b47a4ce9a42f7b13a6a1ce34]) successfully deleted
I20260927 13:50:09.829564 5628 raft_consensus.cc:359] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.829741 5628 raft_consensus.cc:385] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.830049 7098 tablet_replica.cc:333] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:09.831076 5619 tablet_bootstrap.cc:654] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.831393 7098 raft_consensus.cc:2243] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.829802 5628 raft_consensus.cc:740] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.834342 7098 raft_consensus.cc:2272] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.834404 5628 consensus_queue.cc:260] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.835039 5628 ts_tablet_manager.cc:1434] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260927 13:50:09.835389 5628 tablet_bootstrap.cc:492] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:09.836972 5628 tablet_bootstrap.cc:654] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.837289 7098 ts_tablet_manager.cc:1916] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.840474 5319 leader_election.cc:304] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:09.840984 7305 raft_consensus.cc:2804] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.841068 7305 raft_consensus.cc:493] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.841147 7305 raft_consensus.cc:3060] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.842872 5626 tablet_bootstrap.cc:492] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.843019 5626 ts_tablet_manager.cc:1403] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260927 13:50:09.843123 7111 ts_tablet_manager.cc:1929] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.843235 7111 log.cc:1199] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/a9503dd46ccf472581d1a667eea300ed
I20260927 13:50:09.843577 7111 ts_tablet_manager.cc:1950] T a9503dd46ccf472581d1a667eea300ed P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:09.843890 5626 raft_consensus.cc:359] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.844058 5626 raft_consensus.cc:385] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.844005 7305 raft_consensus.cc:515] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.844121 5626 raft_consensus.cc:740] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.844329 5626 consensus_queue.cc:260] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.844609 7305 leader_election.cc:290] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.844805 5626 ts_tablet_manager.cc:1434] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:09.845101 7424 raft_consensus.cc:493] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.845276 7424 raft_consensus.cc:515] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.845878 7424 leader_election.cc:290] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.846144 5626 tablet_bootstrap.cc:492] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.846602 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 157) took 3281 ms. Trace:
W20260927 13:50:09.846993 5045 leader_election.cc:343] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.846954 7111 rpcz_store.cc:276] 0927 13:50:06.564930 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.564971 (+ 41us) service_pool.cc:224] Handling call
0927 13:50:09.818843 (+3253872us) ts_tablet_manager.cc:1151] Deleting tablet a9503dd46ccf472581d1a667eea300ed
0927 13:50:09.818857 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.825492 (+ 6635us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.843068 (+ 17576us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.845731 (+ 2663us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3253664}
I20260927 13:50:09.847110 5045 leader_election.cc:304] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.847257 7111 tablet_replica.cc:333] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:09.847334 7618 raft_consensus.cc:2749] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.847445 7111 raft_consensus.cc:2243] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.847587 7111 raft_consensus.cc:2272] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.848037 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b57886cc11a2423983c2b7bac79150a0 (table default.Table_020de70ec7bc4e119d5c6a3e22d8d32d [id=c2bdd45c34a24472b95b237d46efe194]) successfully deleted
I20260927 13:50:09.848762 5626 tablet_bootstrap.cc:654] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.854242 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496cffc2a8774185a0e0f63208bed8a5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:09.854429 5238 raft_consensus.cc:3060] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.854795 7111 ts_tablet_manager.cc:1916] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.857450 5238 raft_consensus.cc:2468] T 496cffc2a8774185a0e0f63208bed8a5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:09.858000 7618 raft_consensus.cc:493] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.858150 7618 raft_consensus.cc:515] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.858726 7618 leader_election.cc:290] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.859102 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0126a6df14457ca5c62c129f3275f8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.859285 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd91ddaeff4f2a9d7a0761c08fc192" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.859431 5245 raft_consensus.cc:2468] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
W20260927 13:50:09.859812 5044 leader_election.cc:343] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.860809 7305 consensus_queue.cc:1048] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:09.861186 7190 ts_tablet_manager.cc:1929] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:09.861300 7190 log.cc:1199] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f3f6a9c5e4be480796f433a68945dd72
W20260927 13:50:09.861460 5319 leader_election.cc:343] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 496cffc2a8774185a0e0f63208bed8a5
I20260927 13:50:09.861624 7190 ts_tablet_manager.cc:1950] T f3f6a9c5e4be480796f433a68945dd72 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:09.862500 7190 tablet_replica.cc:333] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:09.862728 7190 raft_consensus.cc:2243] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.862708 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f3f6a9c5e4be480796f433a68945dd72 (table default.Table_3e73c785e0d244c3ae23fc951d45174c [id=4538e58c268d44b59999b80f295c321d]) successfully deleted
I20260927 13:50:09.862890 7190 raft_consensus.cc:2272] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.863517 7190 ts_tablet_manager.cc:1916] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.864111 7618 raft_consensus.cc:493] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.864233 7618 raft_consensus.cc:515] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.864764 7618 leader_election.cc:290] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.865258 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502fe193f2034e37a53b245bbf049ae8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.865598 7265 raft_consensus.cc:493] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 13:50:09.865666 5044 leader_election.cc:343] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.865710 7265 raft_consensus.cc:515] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.866271 7265 leader_election.cc:290] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.866611 5381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a397300cdd44eb899f2ef5b9fe8c09" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.867129 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a397300cdd44eb899f2ef5b9fe8c09" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:09.867332 5100 raft_consensus.cc:2393] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:09.867733 5184 leader_election.cc:304] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.868170 7265 raft_consensus.cc:3060] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.871017 7265 raft_consensus.cc:2749] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.871348 7111 ts_tablet_manager.cc:1929] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.871467 7111 log.cc:1199] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/3afb800e7ff44aadaed8f8d85aa9efe2
I20260927 13:50:09.871799 7111 ts_tablet_manager.cc:1950] T 3afb800e7ff44aadaed8f8d85aa9efe2 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:50:09.872164 5319 leader_election.cc:343] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 64c7919f5076406186000cd4077aadaf
W20260927 13:50:09.872371 5319 leader_election.cc:343] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 496cffc2a8774185a0e0f63208bed8a5
I20260927 13:50:09.873172 5619 tablet_bootstrap.cc:492] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:09.873342 5619 ts_tablet_manager.cc:1403] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.007s
I20260927 13:50:09.873492 5626 tablet_bootstrap.cc:492] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.873615 5626 ts_tablet_manager.cc:1403] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.000s
W20260927 13:50:09.873771 5319 leader_election.cc:343] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 12dd91ddaeff4f2a9d7a0761c08fc192
I20260927 13:50:09.874138 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet a9503dd46ccf472581d1a667eea300ed (table default.Table_06ee1270c5734798871c56d5e91a8a1d [id=4837357d958c4b8c8669d79813ef1a2b]) successfully deleted
I20260927 13:50:09.874903 7098 ts_tablet_manager.cc:1929] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:09.874769 5626 raft_consensus.cc:359] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.874989 5626 raft_consensus.cc:385] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.875061 5626 raft_consensus.cc:740] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.875324 5626 consensus_queue.cc:260] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.875900 7098 log.cc:1199] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/ecb5cdc007074e0c8f44d963e527a955
I20260927 13:50:09.875960 5626 ts_tablet_manager.cc:1434] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:09.876323 5626 tablet_bootstrap.cc:492] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.882557 7305 consensus_queue.cc:1048] T a82284e3fd1f4a2f95c7e47320abb30c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:09.883219 5319 leader_election.cc:343] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 64c7919f5076406186000cd4077aadaf
I20260927 13:50:09.883338 5319 leader_election.cc:304] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:09.883563 7424 raft_consensus.cc:2749] T 64c7919f5076406186000cd4077aadaf P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:50:09.883720 5319 leader_election.cc:304] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.883944 7424 raft_consensus.cc:2804] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.884104 7424 raft_consensus.cc:697] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:09.885190 7424 consensus_queue.cc:237] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.888899 5626 tablet_bootstrap.cc:654] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.880932 7618 raft_consensus.cc:493] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.890555 7618 raft_consensus.cc:515] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.891117 7618 leader_election.cc:290] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:09.887038 5628 tablet_bootstrap.cc:492] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:09.891304 5628 ts_tablet_manager.cc:1403] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.004s
I20260927 13:50:09.891660 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f4bc5cefef448d85ff31b7fafaca74" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.891958 5628 raft_consensus.cc:359] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.892100 5628 raft_consensus.cc:385] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.892141 5628 raft_consensus.cc:740] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:50:09.892206 5044 leader_election.cc:343] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.892356 5628 consensus_queue.cc:260] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.892974 5628 ts_tablet_manager.cc:1434] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:09.893411 7618 raft_consensus.cc:493] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:09.893584 7618 raft_consensus.cc:515] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.893674 7265 raft_consensus.cc:493] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.893875 7265 raft_consensus.cc:515] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.894126 7618 leader_election.cc:290] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.893291 5628 tablet_bootstrap.cc:492] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:50:09.894843 5044 leader_election.cc:343] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: a0e14fd01a9141cdb2df030ee0dd05db
I20260927 13:50:09.894960 7098 ts_tablet_manager.cc:1950] T ecb5cdc007074e0c8f44d963e527a955 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:09.894815 7361 raft_consensus.cc:493] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.895103 7361 raft_consensus.cc:515] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.895601 7361 leader_election.cc:290] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:09.896952 5184 leader_election.cc:343] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bb6073174dbb4ca1933685b7bd3a22e1
I20260927 13:50:09.897178 5296 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:09.897701 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 182) took 3487 ms. Trace:
I20260927 13:50:09.898265 7265 leader_election.cc:290] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:09.898667 5184 leader_election.cc:343] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 30bbc6c76a194e5dbd5e9ea08e95f4f7
I20260927 13:50:09.898795 7098 rpcz_store.cc:276] 0927 13:50:06.410430 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.410479 (+ 49us) service_pool.cc:224] Handling call
0927 13:50:09.829984 (+3419505us) ts_tablet_manager.cc:1151] Deleting tablet ecb5cdc007074e0c8f44d963e527a955
0927 13:50:09.829998 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.856891 (+ 26893us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.874854 (+ 17963us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.897645 (+ 22791us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32,"tablet-delete.queue_time_us":3418175}
I20260927 13:50:09.899369 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet ecb5cdc007074e0c8f44d963e527a955 (table default.Table_0cbf2e94c8cc43f29dda9cfeaaa88c46 [id=9c67e7b696e94c3da030c8d13b11fdd7]) successfully deleted
I20260927 13:50:09.899974 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 183) took 3488 ms. Trace:
I20260927 13:50:09.900404 5619 raft_consensus.cc:359] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.900570 5619 raft_consensus.cc:385] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.900625 5619 raft_consensus.cc:740] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.900817 7098 rpcz_store.cc:276] 0927 13:50:06.411978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.412095 (+ 117us) service_pool.cc:224] Handling call
0927 13:50:09.899830 (+3487735us) ts_tablet_manager.cc:1151] Deleting tablet 7a40f69bb7d842889be30c4629d6786f
0927 13:50:09.899839 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.899922 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3486818}
I20260927 13:50:09.900835 5619 consensus_queue.cc:260] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:09.901830 7098 tablet_replica.cc:333] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
W20260927 13:50:09.901841 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 7a40f69bb7d842889be30c4629d6786f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a40f69bb7d842889be30c4629d6786f already in progress: creating tablet
I20260927 13:50:09.903865 5432 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:09.904132 7098 raft_consensus.cc:2243] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.904852 5619 ts_tablet_manager.cc:1434] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.031s user 0.001s sys 0.000s
I20260927 13:50:09.905117 7098 raft_consensus.cc:2272] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.907667 7098 ts_tablet_manager.cc:1916] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.884308 5319 leader_election.cc:304] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.911048 7551 raft_consensus.cc:2804] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.911123 7551 raft_consensus.cc:493] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.911180 7551 raft_consensus.cc:3060] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.914513 7551 raft_consensus.cc:515] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.914932 5626 tablet_bootstrap.cc:492] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.915053 7551 leader_election.cc:290] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.915110 5626 ts_tablet_manager.cc:1403] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.003s
I20260927 13:50:09.915688 5626 raft_consensus.cc:359] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.915856 5626 raft_consensus.cc:385] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.915927 5626 raft_consensus.cc:740] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.916141 5626 consensus_queue.cc:260] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.917078 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd91ddaeff4f2a9d7a0761c08fc192" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:09.917224 5243 raft_consensus.cc:3060] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:09.917955 5319 leader_election.cc:343] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 12dd91ddaeff4f2a9d7a0761c08fc192
I20260927 13:50:09.920845 7190 ts_tablet_manager.cc:1929] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.920938 7190 log.cc:1199] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/84d9c94ee0af46e8aea12adac57829f7
I20260927 13:50:09.920993 5243 raft_consensus.cc:2468] T 12dd91ddaeff4f2a9d7a0761c08fc192 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:09.921262 7190 ts_tablet_manager.cc:1950] T 84d9c94ee0af46e8aea12adac57829f7 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:09.916949 5626 ts_tablet_manager.cc:1434] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:09.921801 5626 tablet_bootstrap.cc:492] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.922160 5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6073174dbb4ca1933685b7bd3a22e1" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.922287 5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502fe193f2034e37a53b245bbf049ae8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.922468 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bbc6c76a194e5dbd5e9ea08e95f4f7" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.922644 5385 raft_consensus.cc:2468] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
W20260927 13:50:09.923077 5185 leader_election.cc:343] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.923174 5185 leader_election.cc:304] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.923748 5185 leader_election.cc:304] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.924062 7203 raft_consensus.cc:2749] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.924340 7203 raft_consensus.cc:2804] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:09.924407 7203 raft_consensus.cc:493] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:09.924479 7203 raft_consensus.cc:3060] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:09.927909 7203 raft_consensus.cc:515] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.928596 7203 leader_election.cc:290] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.929169 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bbc6c76a194e5dbd5e9ea08e95f4f7" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:09.929349 5385 raft_consensus.cc:3060] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:09.929548 5184 leader_election.cc:343] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 30bbc6c76a194e5dbd5e9ea08e95f4f7
I20260927 13:50:09.930182 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0126a6df14457ca5c62c129f3275f8" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.930444 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 84d9c94ee0af46e8aea12adac57829f7 (table default.Table_7ac056af78a84ab9b807aaed0fcf7c6a [id=4d64253f01f048778ee2ff75d95535ef]) successfully deleted
I20260927 13:50:09.930662 7190 tablet_replica.cc:333] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:09.930862 7190 raft_consensus.cc:2243] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.930992 7190 raft_consensus.cc:2272] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:09.930970 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet e26a3a50396940cf826442e4ba7356a8 because the tablet was not found. No further retry: Not found: Tablet not found: e26a3a50396940cf826442e4ba7356a8
W20260927 13:50:09.931233 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 50bc839e0fc54839a5d06c176760f618 because the tablet was not found. No further retry: Not found: Tablet not found: 50bc839e0fc54839a5d06c176760f618
W20260927 13:50:09.931439 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 95726f690a71433ca63f95da4ee750e5 because the tablet was not found. No further retry: Not found: Tablet not found: 95726f690a71433ca63f95da4ee750e5
I20260927 13:50:09.931473 7190 ts_tablet_manager.cc:1916] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.932120 5385 raft_consensus.cc:2468] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:09.932855 5185 leader_election.cc:304] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.933506 5626 tablet_bootstrap.cc:654] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.934360 7203 raft_consensus.cc:2804] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.935024 7203 raft_consensus.cc:697] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:09.934610 7098 ts_tablet_manager.cc:1929] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.935333 7098 log.cc:1199] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a0e14fd01a9141cdb2df030ee0dd05db
I20260927 13:50:09.936086 7203 consensus_queue.cc:237] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.936173 7098 ts_tablet_manager.cc:1950] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:09.936643 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 185) took 3472 ms. Trace:
I20260927 13:50:09.936738 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 158) took 3371 ms. Trace:
I20260927 13:50:09.936813 7111 rpcz_store.cc:276] 0927 13:50:06.565274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.565312 (+ 38us) service_pool.cc:224] Handling call
0927 13:50:09.847208 (+3281896us) ts_tablet_manager.cc:1151] Deleting tablet 3afb800e7ff44aadaed8f8d85aa9efe2
0927 13:50:09.847221 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.868195 (+ 20974us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.871301 (+ 3106us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.936718 (+ 65417us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3281737}
I20260927 13:50:09.936775 7098 rpcz_store.cc:276] 0927 13:50:06.464047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.464099 (+ 52us) service_pool.cc:224] Handling call
0927 13:50:09.901753 (+3437654us) ts_tablet_manager.cc:1151] Deleting tablet a0e14fd01a9141cdb2df030ee0dd05db
0927 13:50:09.901762 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.924700 (+ 22938us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.934508 (+ 9808us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.936598 (+ 2090us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3405520}
I20260927 13:50:09.937143 7098 tablet_replica.cc:333] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:09.937304 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 159) took 3371 ms. Trace:
I20260927 13:50:09.937371 7098 raft_consensus.cc:2243] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.937387 7111 rpcz_store.cc:276] 0927 13:50:06.565634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.565673 (+ 39us) service_pool.cc:224] Handling call
0927 13:50:09.937206 (+3371533us) ts_tablet_manager.cc:1151] Deleting tablet 4b13c629908a47368846770c697aebd8
0927 13:50:09.937215 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.937289 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3371393}
I20260927 13:50:09.937497 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a0e14fd01a9141cdb2df030ee0dd05db (table default.Table_8442b904c41d4d39a56497c27763e7f4 [id=6bf215680ef94518ae98737c9e63301d]) successfully deleted
I20260927 13:50:09.937635 7111 tablet_replica.cc:333] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:09.937860 7111 raft_consensus.cc:2243] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.937920 5619 tablet_bootstrap.cc:492] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:09.938495 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 5678703b72c8471583147786f49122a5 (table default.Table_f3c5680fa304438d9df88d573453cd6f [id=0d85f9f0d28e43debda43f83a3e59637]). Expected version 2 got 0
I20260927 13:50:09.938783 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
I20260927 13:50:09.939100 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:09.939330 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:09.939534 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_b68a6b76e8684ab9ab1e52fbfaad3740 [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 2 got 0
I20260927 13:50:09.939605 5619 tablet_bootstrap.cc:654] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.939844 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:09.940125 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]). Expected version 1 got 0
I20260927 13:50:09.940402 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]). Expected version 2 got 0
I20260927 13:50:09.940829 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e3765fe06c664e60a11acf76c825bc42 (table default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee]). Expected version 1 got 0
I20260927 13:50:09.941052 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:50:09.941701 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]). Expected version 1 got 0
I20260927 13:50:09.942055 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_cfdab7814ecc495089389612e0a7e4fe [id=ae170bbebc4e460fb58beb7f95f013a2]). Expected version 2 got 0
I20260927 13:50:09.942407 7618 raft_consensus.cc:493] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.942556 7618 raft_consensus.cc:515] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.943249 7618 leader_election.cc:290] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.943747 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e14fd01a9141cdb2df030ee0dd05db" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:09.944404 7098 raft_consensus.cc:2272] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.944746 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d85213c05c465abda78cc49c70d36f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:09.945883 5045 leader_election.cc:343] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.946024 5045 leader_election.cc:304] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.946264 7618 raft_consensus.cc:2749] T 502fe193f2034e37a53b245bbf049ae8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.947171 7098 ts_tablet_manager.cc:1916] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:09.947870 5045 leader_election.cc:343] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.947980 5045 leader_election.cc:304] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.948197 7618 raft_consensus.cc:2749] T dd0126a6df14457ca5c62c129f3275f8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.948908 5045 leader_election.cc:304] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.948948 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f4bc5cefef448d85ff31b7fafaca74" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:09.949081 5045 raft_consensus.cc:2686] T a0e14fd01a9141cdb2df030ee0dd05db P 34fc5fe0a32d42ab83f4aa6d07341409: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 13:50:09.949797 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d85213c05c465abda78cc49c70d36f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:09.950212 5045 leader_election.cc:343] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:09.950417 5044 leader_election.cc:343] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.950536 5044 leader_election.cc:304] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.950920 7618 raft_consensus.cc:2749] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.951299 5319 leader_election.cc:304] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:09.951565 7424 raft_consensus.cc:2804] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:09.951774 7551 consensus_queue.cc:1048] T 880ce1300eac40b28aac8cba3e11077e P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:09.952129 7424 raft_consensus.cc:697] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:09.952431 7424 consensus_queue.cc:237] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:09.952711 5045 leader_election.cc:343] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.952885 5045 leader_election.cc:304] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:09.953152 7618 raft_consensus.cc:2749] T a4f4bc5cefef448d85ff31b7fafaca74 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:09.957604 7190 ts_tablet_manager.cc:1929] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:09.938010 7111 pending_rounds.cc:70] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:50:09.963352 7111 pending_rounds.cc:77] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957646595747840 op_type: NO_OP noop_request { }
I20260927 13:50:09.963464 7111 raft_consensus.cc:2889] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:09.963547 7111 raft_consensus.cc:2272] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.963646 7618 raft_consensus.cc:493] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.963810 7618 raft_consensus.cc:515] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.964068 7111 ts_tablet_manager.cc:1916] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.964396 7618 leader_election.cc:290] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:09.964784 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370553521753488ab81e40144f2536ae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.965551 7190 log.cc:1199] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/03a1f13b31934baa8ce18fc499e94806
W20260927 13:50:09.965968 5044 leader_election.cc:343] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.966681 7190 ts_tablet_manager.cc:1950] T 03a1f13b31934baa8ce18fc499e94806 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:09.969141 7481 raft_consensus.cc:493] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.969293 7481 raft_consensus.cc:515] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.969610 7190 tablet_replica.cc:333] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:09.969790 7190 raft_consensus.cc:2243] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.969956 7190 raft_consensus.cc:2272] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.969950 7481 leader_election.cc:290] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:09.970068 7481 raft_consensus.cc:493] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:09.971457 7481 raft_consensus.cc:515] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.971952 7481 leader_election.cc:290] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:09.970824 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614f1af61461466da975bea681162727" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.973142 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abb473dbb3d491c9d15a161541fe795" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:09.970508 7190 ts_tablet_manager.cc:1916] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:09.975385 5044 leader_election.cc:343] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:09.975636 5044 leader_election.cc:343] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:09.976233 5619 tablet_bootstrap.cc:492] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:09.976361 5619 ts_tablet_manager.cc:1403] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.039s user 0.007s sys 0.001s
I20260927 13:50:09.977028 5619 raft_consensus.cc:359] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.977190 5619 raft_consensus.cc:385] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.977241 5619 raft_consensus.cc:740] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.977417 5619 consensus_queue.cc:260] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.978485 7098 ts_tablet_manager.cc:1929] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:09.978847 7098 log.cc:1199] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b0d6a3af321049b099e72dbfeb6b7a24
I20260927 13:50:09.979079 5619 ts_tablet_manager.cc:1434] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:50:09.979475 7098 ts_tablet_manager.cc:1950] T b0d6a3af321049b099e72dbfeb6b7a24 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:09.980196 5619 tablet_bootstrap.cc:492] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:09.980341 5626 tablet_bootstrap.cc:492] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:09.980470 5626 ts_tablet_manager.cc:1403] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.006s
I20260927 13:50:09.981238 5626 raft_consensus.cc:359] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.981416 5626 raft_consensus.cc:385] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:09.981477 5626 raft_consensus.cc:740] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:09.981710 5626 consensus_queue.cc:260] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.981911 5619 tablet_bootstrap.cc:654] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.983098 5626 ts_tablet_manager.cc:1434] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 13:50:09.983443 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 188) took 3514 ms. Trace:
I20260927 13:50:09.984006 5626 tablet_bootstrap.cc:492] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:09.984027 7098 rpcz_store.cc:276] 0927 13:50:06.467959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.468012 (+ 53us) service_pool.cc:224] Handling call
0927 13:50:09.937064 (+3469052us) ts_tablet_manager.cc:1151] Deleting tablet b0d6a3af321049b099e72dbfeb6b7a24
0927 13:50:09.937076 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.958480 (+ 21404us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.978412 (+ 19932us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.982890 (+ 4478us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3440612}
I20260927 13:50:09.984484 7111 ts_tablet_manager.cc:1929] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.984597 7111 log.cc:1199] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/3a07adcd33414d18ae9720e7a307548a
I20260927 13:50:09.984954 7111 ts_tablet_manager.cc:1950] T 3a07adcd33414d18ae9720e7a307548a P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:09.985276 7098 tablet_replica.cc:333] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:09.985776 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 160) took 3419 ms. Trace:
I20260927 13:50:09.985796 7098 raft_consensus.cc:2243] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:09.985865 7111 rpcz_store.cc:276] 0927 13:50:06.565976 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.566019 (+ 43us) service_pool.cc:224] Handling call
0927 13:50:09.937583 (+3371564us) ts_tablet_manager.cc:1151] Deleting tablet 3a07adcd33414d18ae9720e7a307548a
0927 13:50:09.937595 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.968049 (+ 30454us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.984424 (+ 16375us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:09.985737 (+ 1313us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3371390}
I20260927 13:50:09.986205 7111 tablet_replica.cc:333] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:09.986382 7111 raft_consensus.cc:2243] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:09.986697 7111 raft_consensus.cc:2272] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.987215 7111 ts_tablet_manager.cc:1916] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.990433 7190 ts_tablet_manager.cc:1929] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:09.990553 5628 tablet_bootstrap.cc:654] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:09.990602 7098 raft_consensus.cc:2272] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:09.991227 7098 ts_tablet_manager.cc:1916] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:09.994256 7305 raft_consensus.cc:493] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:09.994417 7305 raft_consensus.cc:515] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:09.995016 7305 leader_election.cc:290] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:09.997191 7190 log.cc:1199] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/e730a00ad2e646a4ba594ba9434c3b50
I20260927 13:50:09.997812 7190 ts_tablet_manager.cc:1950] T e730a00ad2e646a4ba594ba9434c3b50 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.001183 5628 tablet_bootstrap.cc:492] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.001413 5628 ts_tablet_manager.cc:1403] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.108s user 0.004s sys 0.001s
I20260927 13:50:10.002799 5628 raft_consensus.cc:359] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.002986 5626 tablet_bootstrap.cc:654] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.003242 5628 raft_consensus.cc:385] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.003417 5628 raft_consensus.cc:740] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.003747 7190 tablet_replica.cc:333] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.003722 5628 consensus_queue.cc:260] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.004276 5628 ts_tablet_manager.cc:1434] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 13:50:10.004575 5628 tablet_bootstrap.cc:492] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.004791 7190 raft_consensus.cc:2243] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.005064 7190 raft_consensus.cc:2272] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.006733 5628 tablet_bootstrap.cc:654] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.007077 7098 ts_tablet_manager.cc:1929] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:10.007817 7190 ts_tablet_manager.cc:1916] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.015772 7098 log.cc:1199] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/fbde77915c7d4665965bef2298c3491f
I20260927 13:50:10.016377 7098 ts_tablet_manager.cc:1950] T fbde77915c7d4665965bef2298c3491f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:10.017508 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 189) took 3548 ms. Trace:
I20260927 13:50:10.017827 7111 ts_tablet_manager.cc:1929] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.017952 7111 log.cc:1199] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/e730a00ad2e646a4ba594ba9434c3b50
I20260927 13:50:10.018292 7111 ts_tablet_manager.cc:1950] T e730a00ad2e646a4ba594ba9434c3b50 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:10.019021 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 161) took 3452 ms. Trace:
I20260927 13:50:10.019107 7111 rpcz_store.cc:276] 0927 13:50:06.566377 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.566417 (+ 40us) service_pool.cc:224] Handling call
0927 13:50:09.986162 (+3419745us) ts_tablet_manager.cc:1151] Deleting tablet e730a00ad2e646a4ba594ba9434c3b50
0927 13:50:09.986172 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.990369 (+ 4197us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.017767 (+ 27398us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.019002 (+ 1235us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3419614}
I20260927 13:50:10.019418 7111 tablet_replica.cc:333] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.022837 7305 raft_consensus.cc:493] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:10.022985 7305 raft_consensus.cc:515] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:10.023670 7305 leader_election.cc:290] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:10.024362 5100 raft_consensus.cc:1275] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 2 FOLLOWER]: Refusing update from remote peer 79c1646c9659434b9a659382d2eb1d8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260927 13:50:10.024890 7111 raft_consensus.cc:2243] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.024869 7203 consensus_queue.cc:1048] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.025059 7111 raft_consensus.cc:2272] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.025588 7111 ts_tablet_manager.cc:1916] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.025817 7305 raft_consensus.cc:493] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c1646c9659434b9a659382d2eb1d8a)
I20260927 13:50:10.025940 7305 raft_consensus.cc:515] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.026924 7305 leader_election.cc:290] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.032945 5157 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:10.037614 5628 tablet_bootstrap.cc:492] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.037761 5628 ts_tablet_manager.cc:1403] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.008s
I20260927 13:50:09.948693 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 3afb800e7ff44aadaed8f8d85aa9efe2 (table default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]) successfully deleted
I20260927 13:50:09.967804 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 03a1f13b31934baa8ce18fc499e94806 (table default.Table_cf1d80366a7743b3b4fea68ea5246139 [id=ded13e9c993046cd891db043b1ff6a95]) successfully deleted
W20260927 13:50:10.038360 6428 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 70500.5us
W20260927 13:50:10.038337 6429 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.67:40291, user_credentials={real_user=slave}} blocked reactor thread for 89610.6us
I20260927 13:50:10.038537 5628 raft_consensus.cc:359] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.038702 5628 raft_consensus.cc:385] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 13:50:10.038702 6429 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 4b13c629908a47368846770c697aebd8 because the tablet was not found. No further retry: Not found: Tablet not found: 4b13c629908a47368846770c697aebd8
I20260927 13:50:10.038663 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b0d6a3af321049b099e72dbfeb6b7a24 (table default.Table_ba83ebe4eac44519a9ebd65f9a503c58 [id=cc2470fce6b24aa786a91531357eecba]) successfully deleted
I20260927 13:50:10.038745 5628 raft_consensus.cc:740] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
W20260927 13:50:10.038950 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 51e1acd618fc44be9169fa1d56fa510a because the tablet was not found. No further retry: Not found: Tablet not found: 51e1acd618fc44be9169fa1d56fa510a
W20260927 13:50:10.039163 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet da75a470ec0c4ec9afa7c18a51cd7276 because the tablet was not found. No further retry: Not found: Tablet not found: da75a470ec0c4ec9afa7c18a51cd7276
I20260927 13:50:10.038944 5628 consensus_queue.cc:260] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.039355 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet e730a00ad2e646a4ba594ba9434c3b50 (table default.Table_ecc55f056cc941b8aa8dca7116d366bc [id=31cf8c2030814300a2b39d7ecccda6aa]) successfully deleted
I20260927 13:50:10.038926 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 3a07adcd33414d18ae9720e7a307548a (table default.Table_c470b14844004302969f3c3a0802ace8 [id=0a8e61eac14b4098a290333fcc01204e]) successfully deleted
W20260927 13:50:10.039546 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 52050d7e35dc4fbab3c7c079d07478e8 because the tablet was not found. No further retry: Not found: Tablet not found: 52050d7e35dc4fbab3c7c079d07478e8
I20260927 13:50:10.039623 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet e730a00ad2e646a4ba594ba9434c3b50 (table default.Table_ecc55f056cc941b8aa8dca7116d366bc [id=31cf8c2030814300a2b39d7ecccda6aa]) successfully deleted
I20260927 13:50:10.039726 7111 ts_tablet_manager.cc:1929] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.039757 5628 ts_tablet_manager.cc:1434] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260927 13:50:10.039754 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 3a07adcd33414d18ae9720e7a307548a because the tablet was not found. No further retry: Not found: Tablet not found: 3a07adcd33414d18ae9720e7a307548a
I20260927 13:50:10.039839 7111 log.cc:1199] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/f5b2b6f2ce1145a18c199bb37cc7e5b2
W20260927 13:50:10.039938 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet f46f45a0a13b4e05802a08880d7f6a01 because the tablet was not found. No further retry: Not found: Tablet not found: f46f45a0a13b4e05802a08880d7f6a01
I20260927 13:50:10.040067 5628 tablet_bootstrap.cc:492] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:50:10.040148 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 58d9274ad0934f19a7c36325eee3dd59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58d9274ad0934f19a7c36325eee3dd59 already in progress: creating tablet
I20260927 13:50:10.040177 7111 ts_tablet_manager.cc:1950] T f5b2b6f2ce1145a18c199bb37cc7e5b2 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:50:10.040403 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 614f1af61461466da975bea681162727 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 614f1af61461466da975bea681162727 already in progress: creating tablet
I20260927 13:50:10.040983 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 162) took 3474 ms. Trace:
I20260927 13:50:10.041072 7111 rpcz_store.cc:276] 0927 13:50:06.566740 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.566781 (+ 41us) service_pool.cc:224] Handling call
0927 13:50:10.019366 (+3452585us) ts_tablet_manager.cc:1151] Deleting tablet f5b2b6f2ce1145a18c199bb37cc7e5b2
0927 13:50:10.019376 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.036486 (+ 17110us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.039669 (+ 3183us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.040956 (+ 1287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5258,"tablet-delete.queue_time_us":3452453}
I20260927 13:50:10.041416 7111 tablet_replica.cc:333] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.041613 7111 raft_consensus.cc:2243] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.041780 5628 tablet_bootstrap.cc:654] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.041785 7111 raft_consensus.cc:2272] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.042728 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]). Expected version 5 got 0
I20260927 13:50:10.042851 5619 tablet_bootstrap.cc:492] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.042855 5626 tablet_bootstrap.cc:492] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:10.042989 5619 ts_tablet_manager.cc:1403] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.064s user 0.006s sys 0.014s
I20260927 13:50:10.042989 5626 ts_tablet_manager.cc:1403] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20260927 13:50:10.043165 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:50:10.043713 5626 raft_consensus.cc:359] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.043915 5626 raft_consensus.cc:385] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.043728 5619 raft_consensus.cc:359] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.043969 5626 raft_consensus.cc:740] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.043995 5619 raft_consensus.cc:385] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.044049 5619 raft_consensus.cc:740] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.044085 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:50:10.044186 5626 consensus_queue.cc:260] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.044214 5619 consensus_queue.cc:260] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.044529 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]). Expected version 2 got 0
I20260927 13:50:10.044910 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]). Expected version 1 got 0
I20260927 13:50:10.045154 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_954f47d3ef8846b8ade030d87002460e [id=750521adcb384c75841d7e1ff89af83d]). Expected version 2 got 0
I20260927 13:50:10.045603 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]). Expected version 1 got 0
I20260927 13:50:10.045720 5626 ts_tablet_manager.cc:1434] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:50:10.045866 5619 ts_tablet_manager.cc:1434] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:50:10.045961 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_6ac0611179c743808ff8a129f463dd61 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 3 got 0
I20260927 13:50:10.046587 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]). Expected version 3 got 0
I20260927 13:50:10.046787 5619 tablet_bootstrap.cc:492] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:10.046909 5626 tablet_bootstrap.cc:492] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:10.047482 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]). Expected version 1 got 0
I20260927 13:50:10.048410 5626 tablet_bootstrap.cc:654] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.048418 5619 tablet_bootstrap.cc:654] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.049458 7111 ts_tablet_manager.cc:1916] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.056566 5626 tablet_bootstrap.cc:492] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:10.056728 5626 ts_tablet_manager.cc:1403] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20260927 13:50:10.057451 5626 raft_consensus.cc:359] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:10.057629 5626 raft_consensus.cc:385] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.057678 5626 raft_consensus.cc:740] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.057879 5626 consensus_queue.cc:260] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:10.058437 5626 ts_tablet_manager.cc:1434] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:10.058732 5626 tablet_bootstrap.cc:492] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:10.060379 5626 tablet_bootstrap.cc:654] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.065284 5619 tablet_bootstrap.cc:492] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.065449 5619 ts_tablet_manager.cc:1403] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.003s
I20260927 13:50:10.065810 5385 raft_consensus.cc:1275] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Refusing update from remote peer 79c1646c9659434b9a659382d2eb1d8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260927 13:50:10.065907 5385 pending_rounds.cc:85] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735: Aborting all ops after (but not including) 0
I20260927 13:50:10.065960 5385 pending_rounds.cc:107] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260927 13:50:10.066054 5385 raft_consensus.cc:2889] T b5e8ae1a0ce2496cb2eed2066eb37a13 P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260927 13:50:10.066182 5619 raft_consensus.cc:359] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.066313 5619 raft_consensus.cc:385] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.066361 5619 raft_consensus.cc:740] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.066910 5619 consensus_queue.cc:260] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.067135 7361 consensus_queue.cc:1048] T b5e8ae1a0ce2496cb2eed2066eb37a13 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.067519 5619 ts_tablet_manager.cc:1434] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:10.068558 5619 tablet_bootstrap.cc:492] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:10.069969 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370553521753488ab81e40144f2536ae" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.070626 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614f1af61461466da975bea681162727" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.071151 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abb473dbb3d491c9d15a161541fe795" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.071861 7305 consensus_queue.cc:1048] T 76a397300cdd44eb899f2ef5b9fe8c09 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:10.072762 5319 leader_election.cc:343] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: a0e14fd01a9141cdb2df030ee0dd05db
I20260927 13:50:10.073230 5619 tablet_bootstrap.cc:654] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.074753 7111 ts_tablet_manager.cc:1929] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.074918 7111 log.cc:1199] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/7c2f814bb9ff41ebab19e8c16cf4affa
I20260927 13:50:10.075227 5628 tablet_bootstrap.cc:492] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.075366 7111 ts_tablet_manager.cc:1950] T 7c2f814bb9ff41ebab19e8c16cf4affa P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:10.076203 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 163) took 3509 ms. Trace:
I20260927 13:50:10.076685 5628 ts_tablet_manager.cc:1403] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.000s
I20260927 13:50:10.077996 7111 rpcz_store.cc:276] 0927 13:50:06.567040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.567080 (+ 40us) service_pool.cc:224] Handling call
0927 13:50:10.041361 (+3474281us) ts_tablet_manager.cc:1151] Deleting tablet 7c2f814bb9ff41ebab19e8c16cf4affa
0927 13:50:10.041371 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.052658 (+ 11287us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.074693 (+ 22035us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.076178 (+ 1485us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3474140}
I20260927 13:50:10.078603 7190 ts_tablet_manager.cc:1929] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.078805 7111 tablet_replica.cc:333] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.079391 7111 raft_consensus.cc:2243] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.018577 7098 rpcz_store.cc:276] 0927 13:50:06.469508 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.469559 (+ 51us) service_pool.cc:224] Handling call
0927 13:50:09.985178 (+3515619us) ts_tablet_manager.cc:1151] Deleting tablet fbde77915c7d4665965bef2298c3491f
0927 13:50:09.985191 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:09.999152 (+ 13961us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.006964 (+ 7812us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.017488 (+ 10524us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3488673}
I20260927 13:50:10.079519 7190 log.cc:1199] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b5a9f864e4274666a86baed43e1623cd
I20260927 13:50:10.079734 7098 tablet_replica.cc:333] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:10.079994 7098 raft_consensus.cc:2243] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.080135 7098 raft_consensus.cc:2272] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.080457 7190 ts_tablet_manager.cc:1950] T b5a9f864e4274666a86baed43e1623cd P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.080132 7111 raft_consensus.cc:2272] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.080976 7111 ts_tablet_manager.cc:1916] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.080968 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 210) took 1043 ms. Trace:
I20260927 13:50:10.080981 5628 raft_consensus.cc:359] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.081050 7190 rpcz_store.cc:276] 0927 13:50:09.037033 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.040414 (+ 3381us) service_pool.cc:224] Handling call
0927 13:50:10.003681 (+963267us) ts_tablet_manager.cc:1151] Deleting tablet b5a9f864e4274666a86baed43e1623cd
0927 13:50:10.003688 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.011658 (+ 7970us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.078543 (+ 66885us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.080953 (+ 2410us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":963136}
I20260927 13:50:10.082481 7190 tablet_replica.cc:333] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.082473 5628 raft_consensus.cc:385] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.082532 5628 raft_consensus.cc:740] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.082726 5628 consensus_queue.cc:260] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.083184 5628 ts_tablet_manager.cc:1434] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 13:50:10.083436 5628 tablet_bootstrap.cc:492] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.084860 5628 tablet_bootstrap.cc:654] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.081697 7098 ts_tablet_manager.cc:1916] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.087195 7190 raft_consensus.cc:2243] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.087428 7190 raft_consensus.cc:2272] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.088215 7190 ts_tablet_manager.cc:1916] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.094241 7481 raft_consensus.cc:493] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.094381 7481 raft_consensus.cc:515] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.094969 7481 leader_election.cc:290] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:10.095729 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0575418f5ea4d82b34112e1bc9ab8b4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:10.096321 5044 leader_election.cc:343] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.099418 7361 raft_consensus.cc:493] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.099566 7361 raft_consensus.cc:515] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.100090 7361 leader_election.cc:290] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.100849 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49384587bfa41d6aabfa8ee175d6abe" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.101173 5385 raft_consensus.cc:2468] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
W20260927 13:50:10.101368 5184 leader_election.cc:343] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f49384587bfa41d6aabfa8ee175d6abe
I20260927 13:50:10.101790 5185 leader_election.cc:304] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:10.102305 7361 raft_consensus.cc:2804] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.102391 7361 raft_consensus.cc:493] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.102461 7361 raft_consensus.cc:3060] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.103112 7111 ts_tablet_manager.cc:1929] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.105072 7111 log.cc:1199] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/f702b0a6380543a8ac539125d4334cd5
I20260927 13:50:10.105487 7098 ts_tablet_manager.cc:1929] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:10.105525 7361 raft_consensus.cc:515] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.105684 7111 ts_tablet_manager.cc:1950] T f702b0a6380543a8ac539125d4334cd5 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:10.106659 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49384587bfa41d6aabfa8ee175d6abe" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:10.106981 5383 raft_consensus.cc:3060] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.107869 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 164) took 3540 ms. Trace:
I20260927 13:50:10.108217 7190 ts_tablet_manager.cc:1929] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.109248 7111 rpcz_store.cc:276] 0927 13:50:06.567342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.567396 (+ 54us) service_pool.cc:224] Handling call
0927 13:50:10.078760 (+3511364us) ts_tablet_manager.cc:1151] Deleting tablet f702b0a6380543a8ac539125d4334cd5
0927 13:50:10.078769 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.089959 (+ 11190us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.103064 (+ 13105us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.107853 (+ 4789us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3511231}
I20260927 13:50:10.109581 7111 tablet_replica.cc:333] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.109776 7111 raft_consensus.cc:2243] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.109910 7111 raft_consensus.cc:2272] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.109808 7190 log.cc:1199] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/0361e3b244a1437b8e402dd8602528fe
I20260927 13:50:10.110435 7190 ts_tablet_manager.cc:1950] T 0361e3b244a1437b8e402dd8602528fe P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.111016 5383 raft_consensus.cc:2468] T f49384587bfa41d6aabfa8ee175d6abe P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:10.110770 7361 leader_election.cc:290] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.111384 5185 leader_election.cc:304] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.112370 7370 raft_consensus.cc:2804] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:10.112473 7370 raft_consensus.cc:697] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:10.113091 7111 ts_tablet_manager.cc:1916] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.113103 7370 consensus_queue.cc:237] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:10.114542 5184 leader_election.cc:343] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f49384587bfa41d6aabfa8ee175d6abe
I20260927 13:50:10.118860 5619 tablet_bootstrap.cc:492] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.118999 5619 ts_tablet_manager.cc:1403] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.051s user 0.012s sys 0.002s
I20260927 13:50:10.119688 5619 raft_consensus.cc:359] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.119874 5619 raft_consensus.cc:385] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.119988 5619 raft_consensus.cc:740] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.120185 5619 consensus_queue.cc:260] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.121958 5619 ts_tablet_manager.cc:1434] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 13:50:10.123456 5619 tablet_bootstrap.cc:492] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:50:10.126575 5319 leader_election.cc:343] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a0e14fd01a9141cdb2df030ee0dd05db
I20260927 13:50:10.126711 5319 leader_election.cc:304] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:10.126948 7551 raft_consensus.cc:2749] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:50:10.126997 5619 tablet_bootstrap.cc:654] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:10.123169 5045 leader_election.cc:343] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:10.127315 5319 leader_election.cc:343] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 3933c0a2fd6547f28528fae7d443a2c1
I20260927 13:50:10.127310 5045 leader_election.cc:304] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
W20260927 13:50:10.127470 5319 leader_election.cc:343] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: f75847513dcf4c84913a4073176f2507
W20260927 13:50:10.127763 5045 leader_election.cc:343] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.127866 5045 leader_election.cc:304] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.128254 7618 raft_consensus.cc:2749] T 370553521753488ab81e40144f2536ae P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:10.128330 5045 leader_election.cc:343] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.128412 5045 leader_election.cc:304] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.128418 7618 raft_consensus.cc:2749] T 614f1af61461466da975bea681162727 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.128629 7618 raft_consensus.cc:2749] T 9abb473dbb3d491c9d15a161541fe795 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.128929 7098 log.cc:1199] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/a90d9bb192cf4e26812abb9c2ecc3682
I20260927 13:50:10.129191 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0575418f5ea4d82b34112e1bc9ab8b4" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.082192 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b5a9f864e4274666a86baed43e1623cd (table default.Table_fc8409c9830e42a48adddfcc3ca09d5d [id=e50e492e10fd409ea4dd21f54d321bca]) successfully deleted
I20260927 13:50:10.118443 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet f5b2b6f2ce1145a18c199bb37cc7e5b2 (table default.Table_88984f1568c54b4398964528d6e45861 [id=661c2995cafa41669d92b0b4549f0cce]) successfully deleted
W20260927 13:50:10.129747 6428 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 47601.4us
I20260927 13:50:10.130017 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet fbde77915c7d4665965bef2298c3491f (table default.Table_694d68f5161840289b065bce1d592d4d [id=b7f691a3fc3d43ca8a3194a1b4174732]) successfully deleted
I20260927 13:50:10.131233 7111 ts_tablet_manager.cc:1929] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.134086 7111 log.cc:1199] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/2657276c4b2f43c1ad64a8c1fd58ada9
I20260927 13:50:10.134487 7098 ts_tablet_manager.cc:1950] T a90d9bb192cf4e26812abb9c2ecc3682 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:10.133082 5619 tablet_bootstrap.cc:492] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.134763 5619 ts_tablet_manager.cc:1403] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260927 13:50:10.135596 5619 raft_consensus.cc:359] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.135756 5619 raft_consensus.cc:385] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.135818 5619 raft_consensus.cc:740] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.136005 5619 consensus_queue.cc:260] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.136533 7111 ts_tablet_manager.cc:1950] T 2657276c4b2f43c1ad64a8c1fd58ada9 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:10.136540 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 190) took 3665 ms. Trace:
I20260927 13:50:10.138156 7098 rpcz_store.cc:276] 0927 13:50:06.470621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.470672 (+ 51us) service_pool.cc:224] Handling call
0927 13:50:10.079675 (+3609003us) ts_tablet_manager.cc:1151] Deleting tablet a90d9bb192cf4e26812abb9c2ecc3682
0927 13:50:10.079688 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.101967 (+ 22279us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.105433 (+ 3466us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.136522 (+ 31089us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":946,"tablet-delete.queue_time_us":3583130}
I20260927 13:50:10.138955 5619 ts_tablet_manager.cc:1434] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 13:50:10.139325 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet a90d9bb192cf4e26812abb9c2ecc3682 (table default.Table_5ca3c5799145419794585daecfa39d9b [id=38e2b12dc19a402ab27a29fed044186f]) successfully deleted
I20260927 13:50:10.139981 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 187) took 3672 ms. Trace:
I20260927 13:50:10.140156 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
I20260927 13:50:10.140225 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 165) took 3572 ms. Trace:
I20260927 13:50:10.140690 7111 rpcz_store.cc:276] 0927 13:50:06.567649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.567689 (+ 40us) service_pool.cc:224] Handling call
0927 13:50:10.109536 (+3541847us) ts_tablet_manager.cc:1151] Deleting tablet 2657276c4b2f43c1ad64a8c1fd58ada9
0927 13:50:10.109545 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.117107 (+ 7562us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.131177 (+ 14070us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.140208 (+ 9031us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":495,"tablet-delete.queue_time_us":3541716}
I20260927 13:50:10.141289 7111 tablet_replica.cc:333] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.141804 7111 raft_consensus.cc:2243] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.142218 7111 raft_consensus.cc:2272] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.142972 7111 ts_tablet_manager.cc:1916] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.143889 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 205) took 1107 ms. Trace:
I20260927 13:50:10.145181 7098 rpcz_store.cc:276] 0927 13:50:06.466202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.466585 (+ 383us) service_pool.cc:224] Handling call
0927 13:50:10.138911 (+3672326us) ts_tablet_manager.cc:1151] Deleting tablet b3fbf1e7f5e04122a65f6e192ffdae20
0927 13:50:10.138921 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.139002 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3642258}
I20260927 13:50:10.141443 5619 tablet_bootstrap.cc:492] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:10.145524 7190 rpcz_store.cc:276] 0927 13:50:09.036612 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.040804 (+ 4192us) service_pool.cc:224] Handling call
0927 13:50:10.082439 (+1041635us) ts_tablet_manager.cc:1151] Deleting tablet 0361e3b244a1437b8e402dd8602528fe
0927 13:50:10.082448 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.102946 (+ 20498us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.108173 (+ 5227us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.143865 (+ 35692us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4070,"tablet-delete.queue_time_us":1041503}
I20260927 13:50:10.146382 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 191) took 3674 ms. Trace:
I20260927 13:50:10.147161 5619 tablet_bootstrap.cc:654] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.147615 7098 rpcz_store.cc:276] 0927 13:50:06.471579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.471640 (+ 61us) service_pool.cc:224] Handling call
0927 13:50:10.146229 (+3674589us) ts_tablet_manager.cc:1151] Deleting tablet 39fa23553c554826ad811ebe2e978ef9
0927 13:50:10.146242 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.146361 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3649532}
I20260927 13:50:10.146656 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 0361e3b244a1437b8e402dd8602528fe (table default.Table_2aca6646f7534f72b84c2aba10508d48 [id=393d91e6e8194f008d5ef165bcfb6b82]) successfully deleted
I20260927 13:50:10.147989 7618 raft_consensus.cc:493] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.148783 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
W20260927 13:50:10.148814 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet b3fbf1e7f5e04122a65f6e192ffdae20 because the tablet was not found. No further retry: Not found: Tablet not found: b3fbf1e7f5e04122a65f6e192ffdae20
I20260927 13:50:10.148764 7618 raft_consensus.cc:515] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.149523 7618 leader_election.cc:290] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:10.150246 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6a4cf5ee2b43158d8db4c7cdd4a42e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:10.150451 7098 tablet_replica.cc:333] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
W20260927 13:50:10.150938 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 39fa23553c554826ad811ebe2e978ef9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39fa23553c554826ad811ebe2e978ef9 already in progress: creating tablet
W20260927 13:50:10.150969 5044 leader_election.cc:343] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.151034 7098 raft_consensus.cc:2243] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.151180 7098 raft_consensus.cc:2272] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.154840 7098 ts_tablet_manager.cc:1916] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.163460 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:10.163511 7111 ts_tablet_manager.cc:1929] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.163630 7111 log.cc:1199] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/bb25bb5ee153494d803130f1ad4f7c2e
I20260927 13:50:10.164515 7618 raft_consensus.cc:493] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.164674 7618 raft_consensus.cc:515] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.165428 7618 leader_election.cc:290] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:10.166290 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16743b4513fa4987aee48f03e28cd498" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:10.166800 7111 ts_tablet_manager.cc:1950] T bb25bb5ee153494d803130f1ad4f7c2e P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:50:10.166949 5044 leader_election.cc:343] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.167546 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 166) took 3599 ms. Trace:
I20260927 13:50:10.167630 7111 rpcz_store.cc:276] 0927 13:50:06.567936 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.567974 (+ 38us) service_pool.cc:224] Handling call
0927 13:50:10.141241 (+3573267us) ts_tablet_manager.cc:1151] Deleting tablet bb25bb5ee153494d803130f1ad4f7c2e
0927 13:50:10.141250 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.151884 (+ 10634us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.163443 (+ 11559us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.167525 (+ 4082us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3573137}
I20260927 13:50:10.167905 7111 tablet_replica.cc:333] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.168076 7111 raft_consensus.cc:2243] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.168208 7111 raft_consensus.cc:2272] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.168692 7111 ts_tablet_manager.cc:1916] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.174263 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:10.164453 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 7c2f814bb9ff41ebab19e8c16cf4affa (table default.Table_e02f217077414076ab9e4f74fdd61b36 [id=578e09c772874fefab419fe01b8672b5]) successfully deleted
I20260927 13:50:10.174865 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet f702b0a6380543a8ac539125d4334cd5 (table default.Table_f62fc7820ff54165afff30f8e47b56ab [id=779da161cdef4cec9d98cfa465f747d6]) successfully deleted
W20260927 13:50:10.176410 5045 leader_election.cc:343] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.176525 5045 leader_election.cc:304] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.176759 7618 raft_consensus.cc:2749] T a0575418f5ea4d82b34112e1bc9ab8b4 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:10.179278 5319 leader_election.cc:343] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: f75847513dcf4c84913a4073176f2507
I20260927 13:50:10.182585 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:10.182785 5626 tablet_bootstrap.cc:492] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:10.182924 5626 ts_tablet_manager.cc:1403] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.124s user 0.015s sys 0.019s
I20260927 13:50:10.183380 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
I20260927 13:50:10.183598 5626 raft_consensus.cc:359] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.183772 5626 raft_consensus.cc:385] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.183820 5626 raft_consensus.cc:740] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.184042 5626 consensus_queue.cc:260] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.184773 5626 ts_tablet_manager.cc:1434] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:10.186510 5319 leader_election.cc:304] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:10.191174 5628 tablet_bootstrap.cc:492] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.191417 5628 ts_tablet_manager.cc:1403] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.108s user 0.006s sys 0.005s
I20260927 13:50:10.192400 5628 raft_consensus.cc:359] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.192713 5628 raft_consensus.cc:385] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.192831 5628 raft_consensus.cc:740] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.193197 5628 consensus_queue.cc:260] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.200032 5628 ts_tablet_manager.cc:1434] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260927 13:50:10.200120 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 218) took 1129 ms. Trace:
I20260927 13:50:10.200287 5626 tablet_bootstrap.cc:492] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:10.200215 7190 rpcz_store.cc:276] 0927 13:50:09.070428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.070479 (+ 51us) service_pool.cc:224] Handling call
0927 13:50:10.146938 (+1076459us) ts_tablet_manager.cc:1151] Deleting tablet 4211f338c6a648c5b3e36c6df0b3c510
0927 13:50:10.199980 (+ 53042us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.200097 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1072008}
I20260927 13:50:10.200537 7190 tablet_replica.cc:333] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.200747 7190 raft_consensus.cc:2243] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:10.201061 7190 raft_consensus.cc:2272] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.201522 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]). Expected version 1 got 0
I20260927 13:50:10.201649 7190 ts_tablet_manager.cc:1916] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.201853 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]). Expected version 1 got 0
I20260927 13:50:10.201973 5626 tablet_bootstrap.cc:654] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.188777 7111 ts_tablet_manager.cc:1929] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.203361 7424 raft_consensus.cc:2749] T f75847513dcf4c84913a4073176f2507 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:50:10.203411 7111 log.cc:1199] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/0880140d99004eb1803d6b5dcf41af13
I20260927 13:50:10.203395 7098 ts_tablet_manager.cc:1929] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:10.203492 7098 log.cc:1199] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/284f6113fa4b443a869bce6d0c15f273
I20260927 13:50:10.203759 7098 ts_tablet_manager.cc:1950] T 284f6113fa4b443a869bce6d0c15f273 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:10.203759 7111 ts_tablet_manager.cc:1950] T 0880140d99004eb1803d6b5dcf41af13 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
W20260927 13:50:10.203812 5319 leader_election.cc:343] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: 3933c0a2fd6547f28528fae7d443a2c1
I20260927 13:50:10.203934 5319 leader_election.cc:304] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:10.208268 7361 raft_consensus.cc:493] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.208419 7361 raft_consensus.cc:515] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.209005 7361 leader_election.cc:290] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.209426 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aed7fe630f64213846ad37d904f6516" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.209638 5385 raft_consensus.cc:2468] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
W20260927 13:50:10.209831 5184 leader_election.cc:343] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 5aed7fe630f64213846ad37d904f6516
I20260927 13:50:10.210089 7190 ts_tablet_manager.cc:1929] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.210144 5185 leader_election.cc:304] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:10.210259 7190 log.cc:1199] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f702b0a6380543a8ac539125d4334cd5
I20260927 13:50:10.210376 7361 raft_consensus.cc:2804] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.210453 7361 raft_consensus.cc:493] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.210510 7361 raft_consensus.cc:3060] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.210645 7190 ts_tablet_manager.cc:1950] T f702b0a6380543a8ac539125d4334cd5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.211356 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 219) took 1121 ms. Trace:
I20260927 13:50:10.211426 7190 rpcz_store.cc:276] 0927 13:50:09.089907 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.089966 (+ 59us) service_pool.cc:224] Handling call
0927 13:50:10.200492 (+1110526us) ts_tablet_manager.cc:1151] Deleting tablet f702b0a6380543a8ac539125d4334cd5
0927 13:50:10.200500 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.205848 (+ 5348us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.208946 (+ 3098us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.211326 (+ 2380us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1110271}
I20260927 13:50:10.212045 7424 raft_consensus.cc:2749] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:50:10.212836 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 220) took 1114 ms. Trace:
I20260927 13:50:10.212904 7190 rpcz_store.cc:276] 0927 13:50:09.098730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.098789 (+ 59us) service_pool.cc:224] Handling call
0927 13:50:10.212750 (+1113961us) ts_tablet_manager.cc:1151] Deleting tablet 2657276c4b2f43c1ad64a8c1fd58ada9
0927 13:50:10.212760 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.212821 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1112913}
I20260927 13:50:10.213078 7361 raft_consensus.cc:515] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.213307 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 222) took 1103 ms. Trace:
I20260927 13:50:10.213379 7190 rpcz_store.cc:276] 0927 13:50:09.109865 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.109910 (+ 45us) service_pool.cc:224] Handling call
0927 13:50:10.213212 (+1103302us) ts_tablet_manager.cc:1151] Deleting tablet b57886cc11a2423983c2b7bac79150a0
0927 13:50:10.213220 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.213294 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1103109}
I20260927 13:50:10.213598 7361 leader_election.cc:290] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.213953 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aed7fe630f64213846ad37d904f6516" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:10.214154 5385 raft_consensus.cc:3060] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:10.214285 5184 leader_election.cc:343] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 5aed7fe630f64213846ad37d904f6516
I20260927 13:50:10.214578 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 221) took 1105 ms. Trace:
I20260927 13:50:10.214663 7190 rpcz_store.cc:276] 0927 13:50:09.109584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.109888 (+ 304us) service_pool.cc:224] Handling call
0927 13:50:10.214501 (+1104613us) ts_tablet_manager.cc:1151] Deleting tablet bb25bb5ee153494d803130f1ad4f7c2e
0927 13:50:10.214509 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.214564 (+ 55us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58,"tablet-delete.queue_time_us":1104397}
I20260927 13:50:10.215036 7190 tablet_replica.cc:333] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.215231 7190 raft_consensus.cc:2243] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.215390 7190 raft_consensus.cc:2272] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.216074 7190 ts_tablet_manager.cc:1916] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.216913 5385 raft_consensus.cc:2468] T 5aed7fe630f64213846ad37d904f6516 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:10.217780 5185 leader_election.cc:304] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:10.218017 7361 raft_consensus.cc:2804] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:10.218232 7361 raft_consensus.cc:697] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:10.218477 7361 consensus_queue.cc:237] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.220903 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 167) took 3652 ms. Trace:
I20260927 13:50:10.221031 7111 rpcz_store.cc:276] 0927 13:50:06.568214 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.568253 (+ 39us) service_pool.cc:224] Handling call
0927 13:50:10.167864 (+3599611us) ts_tablet_manager.cc:1151] Deleting tablet 0880140d99004eb1803d6b5dcf41af13
0927 13:50:10.167873 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.185460 (+ 17587us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.188714 (+ 3254us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.220881 (+ 32167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16260,"tablet-delete.queue_time_us":3599470}
I20260927 13:50:10.221484 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 169) took 3652 ms. Trace:
I20260927 13:50:10.221599 7111 rpcz_store.cc:276] 0927 13:50:06.568916 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.569653 (+ 737us) service_pool.cc:224] Handling call
0927 13:50:10.221382 (+3651729us) ts_tablet_manager.cc:1151] Deleting tablet 36181512a94c4702ae0a417665919faa
0927 13:50:10.221401 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.221471 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3651586}
I20260927 13:50:10.221915 7111 tablet_replica.cc:333] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.222182 7111 raft_consensus.cc:2243] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.225750 7716 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e421351a34d1463e9773dcebdeebae3c)
I20260927 13:50:10.226221 7190 ts_tablet_manager.cc:1929] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.226289 7716 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13a42ae8b95b495c9bcea85d6732cd77" member_type: VOTER last_known_addr { host: "127.4.163.126" port: 42985 } } peers { permanent_uuid: "e421351a34d1463e9773dcebdeebae3c" member_type: VOTER last_known_addr { host: "127.4.163.125" port: 42239 } } peers { permanent_uuid: "802b83f09d3445359cfac825cd87c9de" member_type: VOTER last_known_addr { host: "127.4.163.124" port: 37095 } }
I20260927 13:50:10.229076 7111 raft_consensus.cc:2272] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.229851 7111 ts_tablet_manager.cc:1916] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.202046 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
W20260927 13:50:10.204077 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 4211f338c6a648c5b3e36c6df0b3c510 because the tablet was not found. No further retry: Not found: Tablet not found: 4211f338c6a648c5b3e36c6df0b3c510
I20260927 13:50:10.232920 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f702b0a6380543a8ac539125d4334cd5 (table default.Table_f62fc7820ff54165afff30f8e47b56ab [id=779da161cdef4cec9d98cfa465f747d6]) successfully deleted
W20260927 13:50:10.233161 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2657276c4b2f43c1ad64a8c1fd58ada9 because the tablet was not found. No further retry: Not found: Tablet not found: 2657276c4b2f43c1ad64a8c1fd58ada9
W20260927 13:50:10.233354 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet b57886cc11a2423983c2b7bac79150a0 because the tablet was not found. No further retry: Not found: Tablet not found: b57886cc11a2423983c2b7bac79150a0
W20260927 13:50:10.233538 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet bb25bb5ee153494d803130f1ad4f7c2e because the tablet was not found. No further retry: Not found: Tablet not found: bb25bb5ee153494d803130f1ad4f7c2e
I20260927 13:50:10.233989 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]). Expected version 1 got 0
I20260927 13:50:10.238548 7722 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.163.124:37095 every 8 connection(s)
I20260927 13:50:10.238888 6991 rpc_server.cc:307] RPC server started. Bound to: 127.4.163.124:37095
I20260927 13:50:10.227778 6467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13a42ae8b95b495c9bcea85d6732cd77" candidate_term: 5 candidate_status { last_received { term: 4 index: 1093 } } ignore_live_leader: false dest_uuid: "e421351a34d1463e9773dcebdeebae3c" is_pre_election: true
W20260927 13:50:10.226032 6429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.124:37095, user_credentials={real_user=slave}} blocked reactor thread for 50886.8us
I20260927 13:50:10.240211 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 2657276c4b2f43c1ad64a8c1fd58ada9 (table default.Table_b12c6e4211af4ab7b866815072339fe6 [id=3e30b8610f4c4406a115aaeee8abebdf]) successfully deleted
I20260927 13:50:10.240562 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet bb25bb5ee153494d803130f1ad4f7c2e (table default.Table_cb8208423d374903b009adbf0c2cbe9d [id=7aabe4ef709d4722a07adc668a50b9de]) successfully deleted
I20260927 13:50:10.241323 6991 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/master-2/data/info.pb
I20260927 13:50:10.243961 7111 ts_tablet_manager.cc:1929] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.243806 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]). Expected version 1 got 0
I20260927 13:50:10.247551 4749 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8U_Rfw/build/asan/bin/kudu as pid 6991
I20260927 13:50:10.248212 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e77aba9467864ad7ac9c1931c2162eef (table default.Table_de28ad6c05ff40b99876d163d6273ffc [id=03a2b911229f4ca989e3c0a76374ddb8]). Expected version 1 got 0
I20260927 13:50:10.254298 5628 tablet_bootstrap.cc:492] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.256412 5628 tablet_bootstrap.cc:654] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.257759 7111 log.cc:1199] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/7dc140bba42a43758fa0c6540d728275
I20260927 13:50:10.257851 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 186) took 3793 ms. Trace:
I20260927 13:50:10.257947 7098 rpcz_store.cc:276] 0927 13:50:06.464710 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.464755 (+ 45us) service_pool.cc:224] Handling call
0927 13:50:10.150407 (+3685652us) ts_tablet_manager.cc:1151] Deleting tablet 284f6113fa4b443a869bce6d0c15f273
0927 13:50:10.150416 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.174793 (+ 24377us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.203335 (+ 28542us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.257829 (+ 54494us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":464,"tablet-delete.queue_time_us":3654165}
I20260927 13:50:10.258164 7111 ts_tablet_manager.cc:1950] T 7dc140bba42a43758fa0c6540d728275 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:10.258332 7098 tablet_replica.cc:333] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:10.258519 7098 raft_consensus.cc:2243] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.258647 7098 raft_consensus.cc:2272] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.258987 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 170) took 3689 ms. Trace:
I20260927 13:50:10.259135 7098 ts_tablet_manager.cc:1916] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.259061 7111 rpcz_store.cc:276] 0927 13:50:06.569952 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.570831 (+ 879us) service_pool.cc:224] Handling call
0927 13:50:10.221872 (+3651041us) ts_tablet_manager.cc:1151] Deleting tablet 7dc140bba42a43758fa0c6540d728275
0927 13:50:10.221880 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.240876 (+ 18996us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.243910 (+ 3034us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.258965 (+ 15055us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6664,"tablet-delete.queue_time_us":3650905}
I20260927 13:50:10.244315 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6a4cf5ee2b43158d8db4c7cdd4a42e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.244608 5619 tablet_bootstrap.cc:492] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.246057 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16743b4513fa4987aee48f03e28cd498" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.259768 5619 ts_tablet_manager.cc:1403] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.121s user 0.005s sys 0.022s
I20260927 13:50:10.260303 7716 leader_election.cc:290] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e421351a34d1463e9773dcebdeebae3c (127.4.163.125:42239), 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095)
I20260927 13:50:10.260449 5619 raft_consensus.cc:359] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.260601 5619 raft_consensus.cc:385] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.260644 5619 raft_consensus.cc:740] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.260810 5619 consensus_queue.cc:260] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.261708 5626 tablet_bootstrap.cc:492] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:10.261827 5626 ts_tablet_manager.cc:1403] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.008s
I20260927 13:50:10.261538 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 0880140d99004eb1803d6b5dcf41af13 (table default.Table_8c3b2a8ae18e4aa0a1e71601ac62ea43 [id=4a7f10ca480d42bca8cd7d0e7fe8bd00]) successfully deleted
W20260927 13:50:10.262342 6429 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 36181512a94c4702ae0a417665919faa because the tablet was not found. No further retry: Not found: Tablet not found: 36181512a94c4702ae0a417665919faa
I20260927 13:50:10.262779 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]). Expected version 2 got 0
I20260927 13:50:10.262750 5626 raft_consensus.cc:359] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.262904 5626 raft_consensus.cc:385] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.262952 5626 raft_consensus.cc:740] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.263159 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 78719428d7b34f28a99722b093f6ab54 (table default.Table_6d795d7a66ee42f3a7fb0cef447cddba [id=ed8d36823c5c43eaa1e8b0447c7f32e9]). Expected version 1 got 0
I20260927 13:50:10.263571 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet ead437e93bb14a73a820631b0be041aa (table default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]). Expected version 1 got 0
I20260927 13:50:10.263733 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 85debab98b0f42a5b50f1b0d132147d3 (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]). Expected version 1 got 0
I20260927 13:50:10.264393 5619 ts_tablet_manager.cc:1434] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 13:50:10.264405 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet a4099c41981f46758a8f478d7fdb4182 (table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]). Expected version 1 got 0
I20260927 13:50:10.264640 5619 tablet_bootstrap.cc:492] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:10.265623 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc (table default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]). Expected version 1 got 0
I20260927 13:50:10.265951 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 284f6113fa4b443a869bce6d0c15f273 (table default.Table_ccb6887bdbc847159519b36b4f89b414 [id=a926601129a34cc893754ccd04cd3d20]) successfully deleted
I20260927 13:50:10.266258 5619 tablet_bootstrap.cc:654] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:10.266556 5045 leader_election.cc:343] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.266705 5045 leader_election.cc:304] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.267162 7618 raft_consensus.cc:2749] T 16743b4513fa4987aee48f03e28cd498 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.267149 5626 consensus_queue.cc:260] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.269449 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 7dc140bba42a43758fa0c6540d728275 (table default.Table_d19f692aecb1401a8f49d2595a038ce8 [id=b16ea2e5189e45a3a195694fdcd8d218]) successfully deleted
W20260927 13:50:10.270030 5045 leader_election.cc:343] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.270195 5045 leader_election.cc:304] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.270720 7618 raft_consensus.cc:2749] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.271641 5626 ts_tablet_manager.cc:1434] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 13:50:10.271925 5626 tablet_bootstrap.cc:492] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:10.259534 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 171) took 3688 ms. Trace:
I20260927 13:50:10.272930 7111 rpcz_store.cc:276] 0927 13:50:06.571083 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.612320 (+ 41237us) service_pool.cc:224] Handling call
0927 13:50:10.259352 (+3647032us) ts_tablet_manager.cc:1151] Deleting tablet 329fa4c25cec48f9830a8eb19794ea72
0927 13:50:10.259362 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.259514 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3646834}
I20260927 13:50:10.273571 7111 tablet_replica.cc:333] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.277100 7618 raft_consensus.cc:493] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.277269 7618 raft_consensus.cc:515] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.278263 7618 leader_election.cc:290] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:10.278905 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbe5432474049b7b44aaeaa7393b696" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:10.279800 5044 leader_election.cc:343] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.278244 7098 ts_tablet_manager.cc:1929] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:10.280071 7098 log.cc:1199] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/cf1a58c67bf54493a3c62fb175acabb8
I20260927 13:50:10.280442 7098 ts_tablet_manager.cc:1950] T cf1a58c67bf54493a3c62fb175acabb8 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:10.281368 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 192) took 3766 ms. Trace:
I20260927 13:50:10.281517 7098 rpcz_store.cc:276] 0927 13:50:06.514682 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.515084 (+ 402us) service_pool.cc:224] Handling call
0927 13:50:10.258286 (+3743202us) ts_tablet_manager.cc:1151] Deleting tablet cf1a58c67bf54493a3c62fb175acabb8
0927 13:50:10.258296 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.267745 (+ 9449us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.278182 (+ 10437us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.281344 (+ 3162us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3742989}
I20260927 13:50:10.282153 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 193) took 3767 ms. Trace:
I20260927 13:50:10.282305 7098 rpcz_store.cc:276] 0927 13:50:06.514828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.515332 (+ 504us) service_pool.cc:224] Handling call
0927 13:50:10.281997 (+3766665us) ts_tablet_manager.cc:1151] Deleting tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7
0927 13:50:10.282010 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.282093 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3766498}
I20260927 13:50:10.282714 7098 tablet_replica.cc:333] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:10.282987 7098 raft_consensus.cc:2243] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.283080 5626 tablet_bootstrap.cc:654] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.283257 7098 raft_consensus.cc:2272] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.283546 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet cf1a58c67bf54493a3c62fb175acabb8 (table default.Table_5cb92fa2ddb94ae6a51d811089638d7a [id=78a2be37788c440981a4273a500bcb04]) successfully deleted
W20260927 13:50:10.283931 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 30bbc6c76a194e5dbd5e9ea08e95f4f7 because the tablet was not found. No further retry: Not found: Tablet not found: 30bbc6c76a194e5dbd5e9ea08e95f4f7
I20260927 13:50:10.284711 7098 ts_tablet_manager.cc:1916] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.290778 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbe5432474049b7b44aaeaa7393b696" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.290931 7111 raft_consensus.cc:2243] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.291114 7111 raft_consensus.cc:2272] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.291653 7111 ts_tablet_manager.cc:1916] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:10.295147 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 329fa4c25cec48f9830a8eb19794ea72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 329fa4c25cec48f9830a8eb19794ea72 already in progress: creating tablet
I20260927 13:50:10.304970 7111 ts_tablet_manager.cc:1929] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 13:50:10.294360 5045 leader_election.cc:343] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.306463 5045 leader_election.cc:304] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.296175 7618 raft_consensus.cc:493] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.306782 7618 raft_consensus.cc:515] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.307173 7481 raft_consensus.cc:2749] T 8bbe5432474049b7b44aaeaa7393b696 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.307597 7618 leader_election.cc:290] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:10.308372 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a737bef14b4874b61a109305ebb993" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:10.309024 5044 leader_election.cc:343] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.305069 5628 tablet_bootstrap.cc:492] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.309237 5628 ts_tablet_manager.cc:1403] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.055s user 0.006s sys 0.002s
I20260927 13:50:10.309985 5628 raft_consensus.cc:359] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.310199 5628 raft_consensus.cc:385] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.310282 5628 raft_consensus.cc:740] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.310503 5628 consensus_queue.cc:260] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.311187 5628 ts_tablet_manager.cc:1434] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:10.313699 5626 tablet_bootstrap.cc:492] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:10.313836 5626 ts_tablet_manager.cc:1403] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.004s
I20260927 13:50:10.314589 5626 raft_consensus.cc:359] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.314767 5626 raft_consensus.cc:385] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.314832 5626 raft_consensus.cc:740] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.315150 5628 tablet_bootstrap.cc:492] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.316694 5628 tablet_bootstrap.cc:654] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.315068 5626 consensus_queue.cc:260] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.328493 7361 consensus_queue.cc:1048] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.330017 7618 raft_consensus.cc:493] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.330183 7618 raft_consensus.cc:515] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.330314 5626 ts_tablet_manager.cc:1434] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260927 13:50:10.330814 7618 leader_election.cc:290] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:10.331262 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8de5211f7b4d3daa14b825ce17793a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:10.331874 5044 leader_election.cc:343] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.334627 5626 tablet_bootstrap.cc:492] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:10.324966 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]). Expected version 1 got 0
I20260927 13:50:10.335794 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6 (table default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]). Expected version 1 got 0
I20260927 13:50:10.307243 5619 tablet_bootstrap.cc:492] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.321041 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a737bef14b4874b61a109305ebb993" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.341953 5619 ts_tablet_manager.cc:1403] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.077s user 0.000s sys 0.006s
I20260927 13:50:10.341256 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8de5211f7b4d3daa14b825ce17793a" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.342890 7111 log.cc:1199] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/3933c0a2fd6547f28528fae7d443a2c1
W20260927 13:50:10.344282 5045 leader_election.cc:343] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.344409 5045 leader_election.cc:304] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.344689 7111 ts_tablet_manager.cc:1950] T 3933c0a2fd6547f28528fae7d443a2c1 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:10.345103 7618 raft_consensus.cc:2749] T d0a737bef14b4874b61a109305ebb993 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:10.345605 5045 leader_election.cc:343] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.345703 5045 leader_election.cc:304] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.346078 7618 raft_consensus.cc:2749] T cc8de5211f7b4d3daa14b825ce17793a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.344108 5619 raft_consensus.cc:359] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.346341 5619 raft_consensus.cc:385] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.346458 5619 raft_consensus.cc:740] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.346694 5619 consensus_queue.cc:260] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.347223 5619 ts_tablet_manager.cc:1434] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260927 13:50:10.347520 5619 tablet_bootstrap.cc:492] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:10.349825 5430 heartbeater.cc:344] Connected to a master server at 127.4.163.124:37095
I20260927 13:50:10.349994 7190 log.cc:1199] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/a9503dd46ccf472581d1a667eea300ed
I20260927 13:50:10.350548 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet b594c65e18d94d1dba45b34dc520823c (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]). Expected version 1 got 0
I20260927 13:50:10.351305 5628 tablet_bootstrap.cc:492] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.351513 5628 ts_tablet_manager.cc:1403] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.003s
I20260927 13:50:10.352273 5628 raft_consensus.cc:359] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.352631 5628 raft_consensus.cc:385] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.352731 5628 raft_consensus.cc:740] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.353046 5628 consensus_queue.cc:260] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.353855 5628 ts_tablet_manager.cc:1434] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:50:10.354211 5628 tablet_bootstrap.cc:492] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.355670 5628 tablet_bootstrap.cc:654] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.356411 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 07830b76d7e14ff0b6b1b1523dda21bc (table default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]). Expected version 2 got 0
I20260927 13:50:10.358639 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 3b26289ed050454d817c13159295ec37 (table default.Table_5b64a307e44a471598ef010e33a82fe3 [id=9c86bcdd37654832b7a92763aa42e6c4]). Expected version 1 got 0
I20260927 13:50:10.358845 5294 heartbeater.cc:344] Connected to a master server at 127.4.163.124:37095
I20260927 13:50:10.360571 7190 ts_tablet_manager.cc:1950] T a9503dd46ccf472581d1a667eea300ed P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.360894 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 223) took 1213 ms. Trace:
I20260927 13:50:10.360965 7190 rpcz_store.cc:276] 0927 13:50:09.147162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.147212 (+ 50us) service_pool.cc:224] Handling call
0927 13:50:10.214993 (+1067781us) ts_tablet_manager.cc:1151] Deleting tablet a9503dd46ccf472581d1a667eea300ed
0927 13:50:10.215001 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.219721 (+ 4720us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.226162 (+ 6441us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.360876 (+134714us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1067595}
I20260927 13:50:10.361838 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet a9503dd46ccf472581d1a667eea300ed (table default.Table_06ee1270c5734798871c56d5e91a8a1d [id=4837357d958c4b8c8669d79813ef1a2b]) successfully deleted
I20260927 13:50:10.362233 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 224) took 1214 ms. Trace:
I20260927 13:50:10.362310 7190 rpcz_store.cc:276] 0927 13:50:09.148135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.148179 (+ 44us) service_pool.cc:224] Handling call
0927 13:50:10.362133 (+1213954us) ts_tablet_manager.cc:1151] Deleting tablet 3afb800e7ff44aadaed8f8d85aa9efe2
0927 13:50:10.362144 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.362217 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1213750}
I20260927 13:50:10.362589 7190 tablet_replica.cc:333] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.362761 7190 raft_consensus.cc:2243] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.362895 7190 raft_consensus.cc:2272] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.363651 7190 ts_tablet_manager.cc:1916] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:10.363675 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 3afb800e7ff44aadaed8f8d85aa9efe2 because the tablet was not found. No further retry: Not found: Tablet not found: 3afb800e7ff44aadaed8f8d85aa9efe2
I20260927 13:50:10.366182 7265 consensus_queue.cc:1048] T b1a98e712fb3492f9e4ebccfd489c16f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.370930 7190 ts_tablet_manager.cc:1929] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:10.372514 7190 log.cc:1199] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/4b13c629908a47368846770c697aebd8
I20260927 13:50:10.372829 7190 ts_tablet_manager.cc:1950] T 4b13c629908a47368846770c697aebd8 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.373543 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 225) took 1224 ms. Trace:
I20260927 13:50:10.373656 7190 rpcz_store.cc:276] 0927 13:50:09.148804 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.148854 (+ 50us) service_pool.cc:224] Handling call
0927 13:50:10.362541 (+1213687us) ts_tablet_manager.cc:1151] Deleting tablet 4b13c629908a47368846770c697aebd8
0927 13:50:10.362549 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.367534 (+ 4985us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.370887 (+ 3353us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.373525 (+ 2638us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1213547}
I20260927 13:50:10.374059 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 226) took 1224 ms. Trace:
I20260927 13:50:10.374183 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 4b13c629908a47368846770c697aebd8 (table default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]) successfully deleted
I20260927 13:50:10.374187 7190 rpcz_store.cc:276] 0927 13:50:09.149461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.149514 (+ 53us) service_pool.cc:224] Handling call
0927 13:50:10.373972 (+1224458us) ts_tablet_manager.cc:1151] Deleting tablet 7c2f814bb9ff41ebab19e8c16cf4affa
0927 13:50:10.373982 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.374043 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1224310}
I20260927 13:50:10.374540 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 227) took 1204 ms. Trace:
W20260927 13:50:10.374689 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 7c2f814bb9ff41ebab19e8c16cf4affa because the tablet was not found. No further retry: Not found: Tablet not found: 7c2f814bb9ff41ebab19e8c16cf4affa
I20260927 13:50:10.374639 7190 rpcz_store.cc:276] 0927 13:50:09.170497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.170552 (+ 55us) service_pool.cc:224] Handling call
0927 13:50:10.374462 (+1203910us) ts_tablet_manager.cc:1151] Deleting tablet 0880140d99004eb1803d6b5dcf41af13
0927 13:50:10.374472 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.374526 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1203729}
I20260927 13:50:10.374974 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 228) took 1193 ms. Trace:
W20260927 13:50:10.375129 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 0880140d99004eb1803d6b5dcf41af13 because the tablet was not found. No further retry: Not found: Tablet not found: 0880140d99004eb1803d6b5dcf41af13
I20260927 13:50:10.375068 7190 rpcz_store.cc:276] 0927 13:50:09.182003 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.182053 (+ 50us) service_pool.cc:224] Handling call
0927 13:50:10.374899 (+1192846us) ts_tablet_manager.cc:1151] Deleting tablet 3933c0a2fd6547f28528fae7d443a2c1
0927 13:50:10.374908 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.374960 (+ 52us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1192622}
I20260927 13:50:10.375397 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 229) took 1177 ms. Trace:
W20260927 13:50:10.375563 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 3933c0a2fd6547f28528fae7d443a2c1 because the tablet was not found. No further retry: Not found: Tablet not found: 3933c0a2fd6547f28528fae7d443a2c1
I20260927 13:50:10.375490 7190 rpcz_store.cc:276] 0927 13:50:09.198102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.198224 (+ 122us) service_pool.cc:224] Handling call
0927 13:50:10.375309 (+1177085us) ts_tablet_manager.cc:1151] Deleting tablet 36181512a94c4702ae0a417665919faa
0927 13:50:10.375318 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.375383 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1176879}
I20260927 13:50:10.375818 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 230) took 1170 ms. Trace:
I20260927 13:50:10.375912 7190 rpcz_store.cc:276] 0927 13:50:09.205172 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.205233 (+ 61us) service_pool.cc:224] Handling call
0927 13:50:10.375745 (+1170512us) ts_tablet_manager.cc:1151] Deleting tablet 7dc140bba42a43758fa0c6540d728275
0927 13:50:10.375755 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.375805 (+ 50us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1170292}
W20260927 13:50:10.375984 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 36181512a94c4702ae0a417665919faa because the tablet was not found. No further retry: Not found: Tablet not found: 36181512a94c4702ae0a417665919faa
I20260927 13:50:10.376253 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 231) took 1170 ms. Trace:
W20260927 13:50:10.376415 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 7dc140bba42a43758fa0c6540d728275 because the tablet was not found. No further retry: Not found: Tablet not found: 7dc140bba42a43758fa0c6540d728275
I20260927 13:50:10.376358 7190 rpcz_store.cc:276] 0927 13:50:09.206292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.206354 (+ 62us) service_pool.cc:224] Handling call
0927 13:50:10.376156 (+1169802us) ts_tablet_manager.cc:1151] Deleting tablet 329fa4c25cec48f9830a8eb19794ea72
0927 13:50:10.376163 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.376239 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1169596}
I20260927 13:50:10.376703 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 233) took 1155 ms. Trace:
W20260927 13:50:10.376819 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 329fa4c25cec48f9830a8eb19794ea72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 329fa4c25cec48f9830a8eb19794ea72 already in progress: creating tablet
I20260927 13:50:10.376799 7190 rpcz_store.cc:276] 0927 13:50:09.221614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.221682 (+ 68us) service_pool.cc:224] Handling call
0927 13:50:10.376634 (+1154952us) ts_tablet_manager.cc:1151] Deleting tablet a813939920244be781d546311fe8a33e
0927 13:50:10.376643 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.376690 (+ 47us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1154789}
I20260927 13:50:10.377100 7190 tablet_replica.cc:333] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
W20260927 13:50:10.377303 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a813939920244be781d546311fe8a33e because the tablet was not found. No further retry: Not found: Tablet not found: a813939920244be781d546311fe8a33e
I20260927 13:50:10.377315 7190 raft_consensus.cc:2243] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:10.377573 7190 pending_rounds.cc:70] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:50:10.377647 7190 pending_rounds.cc:77] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957671250583552 op_type: NO_OP noop_request { }
I20260927 13:50:10.377749 7190 raft_consensus.cc:2889] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:10.377843 7190 raft_consensus.cc:2272] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.356467 5155 heartbeater.cc:344] Connected to a master server at 127.4.163.124:37095
I20260927 13:50:10.378700 7190 ts_tablet_manager.cc:1916] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.385610 7190 ts_tablet_manager.cc:1929] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.385754 7190 log.cc:1199] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/ec130d31f6274fd9b730c2bb8bba817e
I20260927 13:50:10.386090 7190 ts_tablet_manager.cc:1950] T ec130d31f6274fd9b730c2bb8bba817e P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.386503 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 172) took 3773 ms. Trace:
I20260927 13:50:10.386610 7111 rpcz_store.cc:276] 0927 13:50:06.612677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.612718 (+ 41us) service_pool.cc:224] Handling call
0927 13:50:10.273521 (+3660803us) ts_tablet_manager.cc:1151] Deleting tablet 3933c0a2fd6547f28528fae7d443a2c1
0927 13:50:10.273532 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.301823 (+ 28291us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.304910 (+ 3087us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.386480 (+ 81570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9502,"tablet-delete.queue_time_us":3660673}
I20260927 13:50:10.386970 7111 tablet_replica.cc:333] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.387109 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 232) took 1165 ms. Trace:
I20260927 13:50:10.387197 7111 raft_consensus.cc:2243] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.387367 7111 raft_consensus.cc:2272] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.387297 7190 rpcz_store.cc:276] 0927 13:50:09.221519 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.223704 (+ 2185us) service_pool.cc:224] Handling call
0927 13:50:10.377056 (+1153352us) ts_tablet_manager.cc:1151] Deleting tablet ec130d31f6274fd9b730c2bb8bba817e
0927 13:50:10.377064 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.382032 (+ 4968us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.385561 (+ 3529us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.387091 (+ 1530us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1153151}
I20260927 13:50:10.387729 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 235) took 1163 ms. Trace:
I20260927 13:50:10.387869 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet ec130d31f6274fd9b730c2bb8bba817e (table default.Table_6ca18492261b4eac898eb7838d59e717 [id=aea372366a9b4cb19097683fc81c1793]) successfully deleted
I20260927 13:50:10.387832 7190 rpcz_store.cc:276] 0927 13:50:09.224347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.224403 (+ 56us) service_pool.cc:224] Handling call
0927 13:50:10.387645 (+1163242us) ts_tablet_manager.cc:1151] Deleting tablet f75847513dcf4c84913a4073176f2507
0927 13:50:10.387656 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.387715 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1163063}
I20260927 13:50:10.387975 7111 ts_tablet_manager.cc:1916] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.388161 7190 tablet_replica.cc:333] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.388378 7190 raft_consensus.cc:2243] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
W20260927 13:50:10.388427 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet f75847513dcf4c84913a4073176f2507 because the tablet was not found. No further retry: Not found: Tablet not found: f75847513dcf4c84913a4073176f2507
I20260927 13:50:10.388727 7190 raft_consensus.cc:2272] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.389313 7190 ts_tablet_manager.cc:1916] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.389906 7361 raft_consensus.cc:493] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.390013 7361 raft_consensus.cc:515] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:10.390619 7361 leader_election.cc:290] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:10.391157 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d48db9b20a41419d5be703190fadd8" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.391541 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d48db9b20a41419d5be703190fadd8" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:10.391729 5107 raft_consensus.cc:2393] T 11d48db9b20a41419d5be703190fadd8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:10.392617 5184 leader_election.cc:304] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.393124 7203 raft_consensus.cc:3060] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.394373 5619 tablet_bootstrap.cc:654] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.395692 7203 raft_consensus.cc:2749] T 11d48db9b20a41419d5be703190fadd8 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.395864 5626 tablet_bootstrap.cc:654] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.397718 7723 sys_catalog.cc:263] Verifying existing consensus state
I20260927 13:50:10.398674 5628 tablet_bootstrap.cc:492] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.398921 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 3933c0a2fd6547f28528fae7d443a2c1 (table default.Table_d895a1f615604afdb91fa57dc9ef7d10 [id=98f8721927434ca090ec12e6028046e2]) successfully deleted
I20260927 13:50:10.399269 5628 ts_tablet_manager.cc:1403] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260927 13:50:10.402710 5628 raft_consensus.cc:359] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.403167 7723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 802b83f09d3445359cfac825cd87c9de: Bootstrap starting.
I20260927 13:50:10.403374 5628 raft_consensus.cc:385] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.403590 7190 ts_tablet_manager.cc:1929] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.403739 7190 log.cc:1199] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/3bbeeadecf3b40c28d0e4f63a22eb4f0
I20260927 13:50:10.403743 5628 raft_consensus.cc:740] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.404255 7190 ts_tablet_manager.cc:1950] T 3bbeeadecf3b40c28d0e4f63a22eb4f0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.404592 5628 consensus_queue.cc:260] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.405046 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 234) took 1180 ms. Trace:
I20260927 13:50:10.405179 7190 rpcz_store.cc:276] 0927 13:50:09.224192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.224833 (+ 641us) service_pool.cc:224] Handling call
0927 13:50:10.388118 (+1163285us) ts_tablet_manager.cc:1151] Deleting tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0
0927 13:50:10.388128 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.394948 (+ 6820us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.403536 (+ 8588us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.405029 (+ 1493us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1163119}
I20260927 13:50:10.405753 7190 tablet_replica.cc:333] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.406009 7190 raft_consensus.cc:2243] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.406149 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 3bbeeadecf3b40c28d0e4f63a22eb4f0 (table default.Table_3403808c5c374ea394fee64ad76c8d73 [id=ee0789e9d1f34c3791d35794473e2246]) successfully deleted
I20260927 13:50:10.406322 7190 raft_consensus.cc:2272] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.406889 7190 ts_tablet_manager.cc:1916] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.407133 7361 raft_consensus.cc:493] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.407243 7361 raft_consensus.cc:515] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.407810 7361 leader_election.cc:290] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.408105 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3b98290dc74d88856e13f003a1e4c7" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.408293 5383 raft_consensus.cc:2468] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:10.408736 5185 leader_election.cc:304] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
W20260927 13:50:10.408910 5184 leader_election.cc:343] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7e3b98290dc74d88856e13f003a1e4c7
I20260927 13:50:10.409289 7361 raft_consensus.cc:2804] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.409365 7361 raft_consensus.cc:493] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.409361 7618 raft_consensus.cc:493] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.409420 7361 raft_consensus.cc:3060] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.409474 7618 raft_consensus.cc:515] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.410022 7618 leader_election.cc:290] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:10.412345 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40f69bb7d842889be30c4629d6786f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:10.412791 7361 raft_consensus.cc:515] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.413784 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3b98290dc74d88856e13f003a1e4c7" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:10.413949 5383 raft_consensus.cc:3060] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.414619 7190 ts_tablet_manager.cc:1929] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.414708 7190 log.cc:1199] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/794da0992403462dbbce644134b8aab3
I20260927 13:50:10.415016 7190 ts_tablet_manager.cc:1950] T 794da0992403462dbbce644134b8aab3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.415668 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 236) took 1176 ms. Trace:
I20260927 13:50:10.415738 7190 rpcz_store.cc:276] 0927 13:50:09.238909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.238954 (+ 45us) service_pool.cc:224] Handling call
0927 13:50:10.405707 (+1166753us) ts_tablet_manager.cc:1151] Deleting tablet 794da0992403462dbbce644134b8aab3
0927 13:50:10.405717 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.411600 (+ 5883us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.414565 (+ 2965us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.415648 (+ 1083us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1166590}
I20260927 13:50:10.416014 7190 tablet_replica.cc:333] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.416177 7190 raft_consensus.cc:2243] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.416283 7190 raft_consensus.cc:2272] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 13:50:10.416584 5044 leader_election.cc:343] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.416620 5383 raft_consensus.cc:2468] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:10.416756 7190 ts_tablet_manager.cc:1916] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.417135 5185 leader_election.cc:304] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.417508 7265 raft_consensus.cc:2804] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:10.417609 7265 raft_consensus.cc:697] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:10.417837 7265 consensus_queue.cc:237] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.419304 7618 raft_consensus.cc:493] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.419435 7618 raft_consensus.cc:515] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.419816 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 794da0992403462dbbce644134b8aab3 (table default.Table_e11854abc7164d67b4195185f22c8295 [id=49a148957d6b4260ab46333b2bc3ef5e]) successfully deleted
I20260927 13:50:10.419997 7618 leader_election.cc:290] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:10.420622 5628 ts_tablet_manager.cc:1434] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260927 13:50:10.420668 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a45a33fe0ca43099924266f704d8c19" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:10.421111 5044 leader_election.cc:343] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.422547 7190 ts_tablet_manager.cc:1929] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:10.422719 7190 log.cc:1199] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b3fbf1e7f5e04122a65f6e192ffdae20
I20260927 13:50:10.422983 7361 leader_election.cc:290] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.423128 7190 ts_tablet_manager.cc:1950] T b3fbf1e7f5e04122a65f6e192ffdae20 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
W20260927 13:50:10.423957 5184 leader_election.cc:343] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 7e3b98290dc74d88856e13f003a1e4c7
I20260927 13:50:10.423934 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 237) took 1184 ms. Trace:
I20260927 13:50:10.424170 7190 rpcz_store.cc:276] 0927 13:50:09.239318 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.239357 (+ 39us) service_pool.cc:224] Handling call
0927 13:50:10.415976 (+1176619us) ts_tablet_manager.cc:1151] Deleting tablet b3fbf1e7f5e04122a65f6e192ffdae20
0927 13:50:10.415984 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.419646 (+ 3662us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.422496 (+ 2850us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.423917 (+ 1421us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1176484}
I20260927 13:50:10.424760 7190 tablet_replica.cc:333] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.424721 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b3fbf1e7f5e04122a65f6e192ffdae20 (table default.Table_3614a1889eea43b39d1d94a3211a5473 [id=28c69a82f6db4ae5a5a5f6a608f0c899]) successfully deleted
I20260927 13:50:10.425047 7190 raft_consensus.cc:2243] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:10.425468 7190 raft_consensus.cc:2272] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.426170 7190 ts_tablet_manager.cc:1916] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.431703 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cddf1b48a78e4ff789e0bb0bf75e307b (table default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e]). Expected version 1 got 0
I20260927 13:50:10.434434 5628 tablet_bootstrap.cc:492] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.436200 7098 ts_tablet_manager.cc:1929] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:10.436472 7098 log.cc:1199] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/14f5479761f94ee0b339e125d06a808c
I20260927 13:50:10.439314 7190 ts_tablet_manager.cc:1929] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.439718 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40f69bb7d842889be30c4629d6786f" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.441690 5628 tablet_bootstrap.cc:654] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.442183 7111 ts_tablet_manager.cc:1929] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:10.442292 7111 log.cc:1199] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/ec130d31f6274fd9b730c2bb8bba817e
I20260927 13:50:10.443288 7190 log.cc:1199] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/2e30216e0487496f8efdb8a3b06deb5a
I20260927 13:50:10.443836 7190 ts_tablet_manager.cc:1950] T 2e30216e0487496f8efdb8a3b06deb5a P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.444226 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]). Expected version 2 got 0
I20260927 13:50:10.444595 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]). Expected version 1 got 0
I20260927 13:50:10.445045 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 238) took 1205 ms. Trace:
I20260927 13:50:10.445683 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]). Expected version 1 got 0
I20260927 13:50:10.446267 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet c655651f9cb24310a5aa2e5b84c2a455 (table default.Table_5c96e3711de04429a590499eb47d5784 [id=db63359dda9d4b729446d6ddf78c30b8]). Expected version 1 got 0
I20260927 13:50:10.446377 7190 rpcz_store.cc:276] 0927 13:50:09.239630 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.239674 (+ 44us) service_pool.cc:224] Handling call
0927 13:50:10.424717 (+1185043us) ts_tablet_manager.cc:1151] Deleting tablet 2e30216e0487496f8efdb8a3b06deb5a
0927 13:50:10.424726 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.436400 (+ 11674us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.439265 (+ 2865us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.445028 (+ 5763us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1184911}
I20260927 13:50:10.446890 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 0fe47041b75d492bbce62c95d90de021 (table default.Table_eabbc608c09045b095cdfe05e9660ac7 [id=a6d3f0f894904a738cc54fe5d8631f06]). Expected version 1 got 0
I20260927 13:50:10.447202 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 2e30216e0487496f8efdb8a3b06deb5a (table default.Table_81d446c6cfde4dd8b7cba22c219df25c [id=4997d0b27b0240959549e68dda2f9958]) successfully deleted
I20260927 13:50:10.447469 7190 tablet_replica.cc:333] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.447808 7190 raft_consensus.cc:2243] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:10.448364 7190 pending_rounds.cc:70] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: Trying to abort 1 pending ops.
I20260927 13:50:10.448127 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]). Expected version 2 got 0
I20260927 13:50:10.448318 7265 raft_consensus.cc:493] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.448751 7265 raft_consensus.cc:515] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.449651 7265 leader_election.cc:290] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.449922 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d29459405b4cdd921fb43bf5a2ae81" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:10.450147 5107 raft_consensus.cc:2468] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:10.449910 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d29459405b4cdd921fb43bf5a2ae81" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.450518 5184 leader_election.cc:304] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:10.450519 5383 raft_consensus.cc:2468] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:10.450829 7265 raft_consensus.cc:2804] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.450948 7265 raft_consensus.cc:493] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.451067 7265 raft_consensus.cc:3060] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.453794 7265 raft_consensus.cc:515] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:10.454159 5045 leader_election.cc:343] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.454273 5045 leader_election.cc:304] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.454667 7265 leader_election.cc:290] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.454731 7618 raft_consensus.cc:2749] T 7a40f69bb7d842889be30c4629d6786f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.454831 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d29459405b4cdd921fb43bf5a2ae81" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:10.454898 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d29459405b4cdd921fb43bf5a2ae81" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:10.454980 5385 raft_consensus.cc:3060] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.455041 5107 raft_consensus.cc:3060] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.457876 5385 raft_consensus.cc:2468] T 44d29459405b4cdd921fb43bf5a2ae81 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:10.458015 5107 raft_consensus.cc:2468] T 44d29459405b4cdd921fb43bf5a2ae81 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:10.458429 5184 leader_election.cc:304] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:10.458801 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a45a33fe0ca43099924266f704d8c19" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.458882 7265 raft_consensus.cc:2804] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:10.459364 7265 raft_consensus.cc:697] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:10.459839 7265 consensus_queue.cc:237] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.460364 5628 tablet_bootstrap.cc:492] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.460547 5628 ts_tablet_manager.cc:1403] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.000s
I20260927 13:50:10.460983 7111 ts_tablet_manager.cc:1950] T ec130d31f6274fd9b730c2bb8bba817e P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:10.461364 5628 raft_consensus.cc:359] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.461596 5628 raft_consensus.cc:385] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.461694 5628 raft_consensus.cc:740] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.462059 5628 consensus_queue.cc:260] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.462822 5628 ts_tablet_manager.cc:1434] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:10.465186 7481 raft_consensus.cc:493] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.465310 7481 raft_consensus.cc:515] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.465868 7481 leader_election.cc:290] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:10.466706 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 173) took 3853 ms. Trace:
I20260927 13:50:10.466727 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb980bca9f16480ba050971b58aa46f3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:10.467218 5044 leader_election.cc:343] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.466930 7111 rpcz_store.cc:276] 0927 13:50:06.612968 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.613007 (+ 39us) service_pool.cc:224] Handling call
0927 13:50:10.386921 (+3773914us) ts_tablet_manager.cc:1151] Deleting tablet ec130d31f6274fd9b730c2bb8bba817e
0927 13:50:10.386933 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.416305 (+ 29372us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.442126 (+ 25821us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.466684 (+ 24558us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3773798}
I20260927 13:50:10.469748 7481 raft_consensus.cc:493] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.469869 7481 raft_consensus.cc:515] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.470438 7481 leader_election.cc:290] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:10.470986 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet ec130d31f6274fd9b730c2bb8bba817e (table default.Table_6ca18492261b4eac898eb7838d59e717 [id=aea372366a9b4cb19097683fc81c1793]) successfully deleted
W20260927 13:50:10.471079 5045 leader_election.cc:343] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.470595 7098 ts_tablet_manager.cc:1950] T 14f5479761f94ee0b339e125d06a808c P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:10.471179 5045 leader_election.cc:304] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.471395 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28da0fdf9b4740d7ac461308de572306" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:10.471838 5044 leader_election.cc:343] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.472070 7481 raft_consensus.cc:2749] T 9a45a33fe0ca43099924266f704d8c19 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.472234 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 174) took 3859 ms. Trace:
I20260927 13:50:10.474155 7190 pending_rounds.cc:77] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957671293923328 op_type: NO_OP noop_request { }
I20260927 13:50:10.474336 7190 raft_consensus.cc:2889] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:10.474490 7190 raft_consensus.cc:2272] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.475370 5626 tablet_bootstrap.cc:492] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:10.476079 5628 tablet_bootstrap.cc:492] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.476365 5626 ts_tablet_manager.cc:1403] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.142s user 0.002s sys 0.009s
I20260927 13:50:10.476217 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb980bca9f16480ba050971b58aa46f3" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.476862 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28da0fdf9b4740d7ac461308de572306" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.477214 7551 consensus_queue.cc:1048] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.477468 5628 tablet_bootstrap.cc:654] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.477500 7190 ts_tablet_manager.cc:1916] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.478964 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 194) took 3964 ms. Trace:
I20260927 13:50:10.479166 7098 rpcz_store.cc:276] 0927 13:50:06.514925 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.515520 (+ 595us) service_pool.cc:224] Handling call
0927 13:50:10.282658 (+3767138us) ts_tablet_manager.cc:1151] Deleting tablet 14f5479761f94ee0b339e125d06a808c
0927 13:50:10.282670 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.348503 (+ 65833us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.436099 (+ 87596us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.478943 (+ 42844us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3766971}
I20260927 13:50:10.477221 7111 rpcz_store.cc:276] 0927 13:50:06.613226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.613261 (+ 35us) service_pool.cc:224] Handling call
0927 13:50:10.467492 (+3854231us) ts_tablet_manager.cc:1151] Deleting tablet a813939920244be781d546311fe8a33e
0927 13:50:10.467502 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.472216 (+ 4714us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3854105}
I20260927 13:50:10.480273 7111 tablet_replica.cc:333] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.480535 7111 raft_consensus.cc:2243] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:10.480894 7111 raft_consensus.cc:2272] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.480825 7098 tablet_replica.cc:333] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:10.482162 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 14f5479761f94ee0b339e125d06a808c (table default.Table_73693476f4564e2e8e0f60b0f7e3d474 [id=90f057f5064842a19916355825eb7129]) successfully deleted
I20260927 13:50:10.481786 5619 tablet_bootstrap.cc:492] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
W20260927 13:50:10.482266 5045 leader_election.cc:343] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.482384 5045 leader_election.cc:304] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.482470 5619 ts_tablet_manager.cc:1403] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.135s user 0.003s sys 0.007s
W20260927 13:50:10.482776 5045 leader_election.cc:343] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.482862 5045 leader_election.cc:304] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.482981 7098 raft_consensus.cc:2243] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.483139 5619 raft_consensus.cc:359] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.483319 5619 raft_consensus.cc:385] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.483372 5619 raft_consensus.cc:740] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.483558 5619 consensus_queue.cc:260] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.483659 7481 raft_consensus.cc:2749] T bb980bca9f16480ba050971b58aa46f3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:10.483776 6429 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a813939920244be781d546311fe8a33e because the tablet was not found. No further retry: Not found: Tablet not found: a813939920244be781d546311fe8a33e
I20260927 13:50:10.483807 7481 raft_consensus.cc:2749] T 28da0fdf9b4740d7ac461308de572306 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.484310 5619 ts_tablet_manager.cc:1434] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:10.484594 5619 tablet_bootstrap.cc:492] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:10.483506 5626 raft_consensus.cc:359] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.484308 7098 raft_consensus.cc:2272] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.484848 5626 raft_consensus.cc:385] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.485801 5626 raft_consensus.cc:740] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.486667 7551 consensus_queue.cc:1048] T 11d48db9b20a41419d5be703190fadd8 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.486951 7111 ts_tablet_manager.cc:1916] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.487566 5626 consensus_queue.cc:260] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.489019 7098 ts_tablet_manager.cc:1916] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.492969 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]). Expected version 1 got 0
I20260927 13:50:10.493170 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 2cc7301d09b245328a851a0734669965 (table default.Table_7a5a607e5463433eb93aedb9f76696db [id=1f268483d3c7447abfe7a024dd0aec58]). Expected version 1 got 0
I20260927 13:50:10.493376 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:10.493566 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]). Expected version 2 got 0
I20260927 13:50:10.494165 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]). Expected version 1 got 0
I20260927 13:50:10.494338 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]). Expected version 1 got 0
I20260927 13:50:10.495888 7370 raft_consensus.cc:493] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.496047 7370 raft_consensus.cc:515] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:10.496752 7370 leader_election.cc:290] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:10.497677 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0d3e3f86440448a88404f0ac06e0c0c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.497907 5385 raft_consensus.cc:2468] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:10.499243 5185 leader_election.cc:304] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.499773 7203 raft_consensus.cc:2804] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.499863 7203 raft_consensus.cc:493] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.499939 7203 raft_consensus.cc:3060] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.502895 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0d3e3f86440448a88404f0ac06e0c0c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:10.503122 5096 raft_consensus.cc:2468] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:10.504864 7203 raft_consensus.cc:515] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:10.486761 5619 tablet_bootstrap.cc:654] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.505879 7111 ts_tablet_manager.cc:1929] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.506755 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0d3e3f86440448a88404f0ac06e0c0c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:10.506937 5096 raft_consensus.cc:3060] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.494637 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]). Expected version 1 got 0
I20260927 13:50:10.509553 5628 tablet_bootstrap.cc:492] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.509683 5628 ts_tablet_manager.cc:1403] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.000s
I20260927 13:50:10.509871 5096 raft_consensus.cc:2468] T c0d3e3f86440448a88404f0ac06e0c0c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:10.510339 5628 raft_consensus.cc:359] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.510617 5628 raft_consensus.cc:385] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.510663 5184 leader_election.cc:304] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:10.510712 5628 raft_consensus.cc:740] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.511013 7361 raft_consensus.cc:2804] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:10.510955 5628 consensus_queue.cc:260] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.511132 7361 raft_consensus.cc:697] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:10.511375 7361 consensus_queue.cc:237] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:10.511529 5628 ts_tablet_manager.cc:1434] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 13:50:10.511783 5628 tablet_bootstrap.cc:492] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.512238 7618 raft_consensus.cc:493] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.512356 7618 raft_consensus.cc:515] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.512846 7618 leader_election.cc:290] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:10.513345 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8ebcb238c846729e2c27e4449bfb47" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:10.513789 5044 leader_election.cc:343] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.514761 5628 tablet_bootstrap.cc:654] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.509812 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet e6b1e7169cdd4f6b8dced0a807bc17e8 (table default.Table_c74dcd01d43b41babf48734ca8244f9f [id=d45c549bb1fe42f48f0aff415f91c29b]). Expected version 2 got 0
I20260927 13:50:10.517449 7203 leader_election.cc:290] T c0d3e3f86440448a88404f0ac06e0c0c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:10.517793 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]). Expected version 1 got 0
I20260927 13:50:10.521581 6447 catalog_manager.cc:5938] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061) does not have the latest schema for tablet 9e808336f5b746d486d375695536c052 (table default.Table_36609f3408124349b504ae9eb3275d87 [id=d088563f44224b01a3eba63ce70e5681]). Expected version 1 got 0
I20260927 13:50:10.515663 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8ebcb238c846729e2c27e4449bfb47" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.517596 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0d3e3f86440448a88404f0ac06e0c0c" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:10.528753 5383 raft_consensus.cc:3060] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:10.529125 5045 leader_election.cc:343] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.529275 5045 leader_election.cc:304] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.529734 7618 raft_consensus.cc:2749] T df8ebcb238c846729e2c27e4449bfb47 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:10.541568 6429 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 95726f690a71433ca63f95da4ee750e5 (table default.Table_2b111148dbd84b309ccd57fb0b2d1835 [id=95a6abdb5a6549af8eefae7eb121672e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 95726f690a71433ca63f95da4ee750e5 consensus state has no leader
I20260927 13:50:10.549445 7190 ts_tablet_manager.cc:1929] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.550558 7190 log.cc:1199] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/98e2e305b92a4492a0df14a506c768f3
I20260927 13:50:10.554158 7111 log.cc:1199] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/06c810fde988439c97a8445fc88626b3
I20260927 13:50:10.554778 7111 ts_tablet_manager.cc:1950] T 06c810fde988439c97a8445fc88626b3 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:10.555648 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 175) took 3942 ms. Trace:
I20260927 13:50:10.554551 7190 ts_tablet_manager.cc:1950] T 98e2e305b92a4492a0df14a506c768f3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.555784 5628 tablet_bootstrap.cc:492] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.555789 7111 rpcz_store.cc:276] 0927 13:50:06.613491 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.613527 (+ 36us) service_pool.cc:224] Handling call
0927 13:50:10.480229 (+3866702us) ts_tablet_manager.cc:1151] Deleting tablet 06c810fde988439c97a8445fc88626b3
0927 13:50:10.480238 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.502753 (+ 22515us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.505828 (+ 3075us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.555626 (+ 49798us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3866576}
I20260927 13:50:10.556067 5628 ts_tablet_manager.cc:1403] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20260927 13:50:10.556285 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 06c810fde988439c97a8445fc88626b3 (table default.Table_2bf1c8729308443bba92997d06f84e9e [id=861ae0d96dd54f1dac15e3cce0ed657a]) successfully deleted
I20260927 13:50:10.556778 5628 raft_consensus.cc:359] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.557027 5628 raft_consensus.cc:385] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.557114 5628 raft_consensus.cc:740] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.557377 5628 consensus_queue.cc:260] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.557924 5628 ts_tablet_manager.cc:1434] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:10.558233 5628 tablet_bootstrap.cc:492] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.559906 5628 tablet_bootstrap.cc:654] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.566823 7755 tablet.cc:1751] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 79c1646c9659434b9a659382d2eb1d8a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:10.565099 5626 ts_tablet_manager.cc:1434] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.088s user 0.003s sys 0.000s
I20260927 13:50:10.574921 5619 tablet_bootstrap.cc:492] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.575075 5619 ts_tablet_manager.cc:1403] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.091s user 0.003s sys 0.002s
I20260927 13:50:10.575631 7111 tablet_replica.cc:333] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.575908 7111 raft_consensus.cc:2243] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:10.576306 7111 raft_consensus.cc:2272] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.576938 7111 ts_tablet_manager.cc:1916] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.577045 7203 raft_consensus.cc:493] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.577169 7203 raft_consensus.cc:515] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.576860 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 240) took 1336 ms. Trace:
I20260927 13:50:10.577342 7190 rpcz_store.cc:276] 0927 13:50:09.240222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.240273 (+ 51us) service_pool.cc:224] Handling call
0927 13:50:10.447421 (+1207148us) ts_tablet_manager.cc:1151] Deleting tablet 98e2e305b92a4492a0df14a506c768f3
0927 13:50:10.447432 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.519019 (+ 71587us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.548856 (+ 29837us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.576829 (+ 27973us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920,"tablet-delete.queue_time_us":1206869}
I20260927 13:50:10.577654 7756 tablet.cc:1751] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P 34fc5fe0a32d42ab83f4aa6d07341409: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:10.577962 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 98e2e305b92a4492a0df14a506c768f3 (table default.Table_97f900bc6c8b4b829da15d428de9e4ed [id=6790f313d1d64f38a77d52eebd7ca586]) successfully deleted
W20260927 13:50:10.578454 5185 leader_election.cc:343] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 1ae6b1e46bdc4c28a2d0a2633d40f92a
I20260927 13:50:10.578851 5619 raft_consensus.cc:359] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.579001 5619 raft_consensus.cc:385] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.579056 5619 raft_consensus.cc:740] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.579255 5619 consensus_queue.cc:260] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.579684 7203 leader_election.cc:290] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.579948 5628 tablet_bootstrap.cc:492] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
W20260927 13:50:10.580071 5184 leader_election.cc:343] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 1ae6b1e46bdc4c28a2d0a2633d40f92a
I20260927 13:50:10.580124 5628 ts_tablet_manager.cc:1403] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260927 13:50:10.580183 5184 leader_election.cc:304] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.580940 5628 raft_consensus.cc:359] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.581125 7203 raft_consensus.cc:2749] T 1ae6b1e46bdc4c28a2d0a2633d40f92a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 13:50:10.581166 5628 raft_consensus.cc:385] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.581218 5628 raft_consensus.cc:740] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.581548 5628 consensus_queue.cc:260] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.582273 5628 ts_tablet_manager.cc:1434] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:10.583500 5628 tablet_bootstrap.cc:492] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.585325 5628 tablet_bootstrap.cc:654] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.588445 7190 tablet_replica.cc:333] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.588784 7190 raft_consensus.cc:2243] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.589097 7190 raft_consensus.cc:2272] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.589437 7203 raft_consensus.cc:493] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.589617 7203 raft_consensus.cc:515] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.590221 7190 ts_tablet_manager.cc:1916] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.590626 5619 ts_tablet_manager.cc:1434] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260927 13:50:10.590655 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e7e50142e447158f90770322609a2f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.590811 5380 raft_consensus.cc:2468] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:10.590921 5619 tablet_bootstrap.cc:492] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:10.591171 5185 leader_election.cc:304] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.591681 7370 raft_consensus.cc:2804] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.591745 7370 raft_consensus.cc:493] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.591799 7370 raft_consensus.cc:3060] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.592288 5619 tablet_bootstrap.cc:654] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.595120 7370 raft_consensus.cc:515] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.595872 7370 leader_election.cc:290] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.596602 5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e7e50142e447158f90770322609a2f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:10.596764 5378 raft_consensus.cc:3060] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.599614 5378 raft_consensus.cc:2468] T a1e7e50142e447158f90770322609a2f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:10.600131 5185 leader_election.cc:304] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.600756 7370 raft_consensus.cc:2804] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
W20260927 13:50:10.601168 5184 leader_election.cc:343] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a1e7e50142e447158f90770322609a2f
I20260927 13:50:10.601601 7370 raft_consensus.cc:697] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:10.601969 7370 consensus_queue.cc:237] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:10.607936 5184 leader_election.cc:343] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: a1e7e50142e447158f90770322609a2f
I20260927 13:50:10.608279 7203 leader_election.cc:290] T a1e7e50142e447158f90770322609a2f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
W20260927 13:50:10.613265 5184 consensus_peers.cc:597] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb7b3a35b2e94bbea6be4b4a8f158593. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:10.620770 5626 tablet_bootstrap.cc:492] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:10.621001 7551 raft_consensus.cc:493] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.621342 7551 raft_consensus.cc:515] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.621953 7551 leader_election.cc:290] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.620738 5619 tablet_bootstrap.cc:492] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.622217 5619 ts_tablet_manager.cc:1403] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.001s
I20260927 13:50:10.622855 5619 raft_consensus.cc:359] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.623009 5619 raft_consensus.cc:385] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.623057 5619 raft_consensus.cc:740] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.622928 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9872d637765b4d719e2de63ae1eb3196" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:10.623239 5619 consensus_queue.cc:260] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.623303 5107 raft_consensus.cc:2468] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:10.623814 5619 ts_tablet_manager.cc:1434] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:50:10.623823 5319 leader_election.cc:304] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.624074 5619 tablet_bootstrap.cc:492] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:10.624145 7551 raft_consensus.cc:2804] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.624207 7551 raft_consensus.cc:493] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.624266 7551 raft_consensus.cc:3060] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.625433 5619 tablet_bootstrap.cc:654] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.626415 7758 tablet.cc:1751] T 67b4f8a3b92e44cba7ea9e2b48aa70bb P bb28c54312c94d7dafb1c2abf7870735: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 13:50:10.627445 7551 raft_consensus.cc:515] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.622471 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9872d637765b4d719e2de63ae1eb3196" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:10.628697 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9872d637765b4d719e2de63ae1eb3196" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:50:10.629225 5319 leader_election.cc:343] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
W20260927 13:50:10.629528 5319 leader_election.cc:343] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.630103 5628 tablet_bootstrap.cc:492] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.630177 7551 leader_election.cc:290] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.630255 5628 ts_tablet_manager.cc:1403] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.048s user 0.006s sys 0.000s
I20260927 13:50:10.630344 7551 raft_consensus.cc:493] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.630436 7551 raft_consensus.cc:515] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.631012 5628 raft_consensus.cc:359] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.631166 5628 raft_consensus.cc:385] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.631214 5628 raft_consensus.cc:740] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.631196 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6a4cf5ee2b43158d8db4c7cdd4a42e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:10.631421 5628 consensus_queue.cc:260] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:10.631639 5319 leader_election.cc:343] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.631948 5628 ts_tablet_manager.cc:1434] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:10.632045 7551 leader_election.cc:290] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.632218 5628 tablet_bootstrap.cc:492] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.632427 5101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9872d637765b4d719e2de63ae1eb3196" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:10.632578 5101 raft_consensus.cc:3060] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.634040 5628 tablet_bootstrap.cc:654] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.621166 5383 raft_consensus.cc:2468] T c0d3e3f86440448a88404f0ac06e0c0c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:10.637051 7190 ts_tablet_manager.cc:1929] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.638198 7424 raft_consensus.cc:493] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.638335 7424 raft_consensus.cc:515] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.638880 7424 leader_election.cc:290] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.640143 7424 raft_consensus.cc:493] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.640254 7424 raft_consensus.cc:515] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.640787 7424 leader_election.cc:290] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.644025 5101 raft_consensus.cc:2468] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:10.644840 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54a83664397460399960a0f73966fef" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:10.645026 5096 raft_consensus.cc:2468] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:10.645094 5319 leader_election.cc:304] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:10.645483 5101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6a4cf5ee2b43158d8db4c7cdd4a42e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:10.645571 7424 raft_consensus.cc:2804] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:10.645650 5101 raft_consensus.cc:2468] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:10.645697 7424 raft_consensus.cc:697] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:10.645929 7424 consensus_queue.cc:237] T 9872d637765b4d719e2de63ae1eb3196 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.646670 5319 leader_election.cc:304] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.646883 7359 raft_consensus.cc:2804] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.646970 7359 raft_consensus.cc:493] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.646950 5319 leader_election.cc:304] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:10.647068 7359 raft_consensus.cc:3060] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.647326 7305 raft_consensus.cc:2804] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.647403 7305 raft_consensus.cc:493] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.647462 7305 raft_consensus.cc:3060] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.649802 7618 raft_consensus.cc:493] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.649927 7618 raft_consensus.cc:515] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.649974 7359 raft_consensus.cc:515] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.650533 7618 leader_election.cc:290] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:10.650658 7618 raft_consensus.cc:493] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.650091 7305 raft_consensus.cc:515] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.650753 7618 raft_consensus.cc:515] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.651300 7305 leader_election.cc:290] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.651340 7618 leader_election.cc:290] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:10.652626 7359 leader_election.cc:290] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.653764 5101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6a4cf5ee2b43158d8db4c7cdd4a42e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:10.653918 5101 raft_consensus.cc:3060] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.656838 5101 raft_consensus.cc:2468] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:10.657415 5319 leader_election.cc:304] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.657842 7305 raft_consensus.cc:2804] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:10.657984 7305 raft_consensus.cc:697] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:10.658248 7305 consensus_queue.cc:237] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.659329 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85130d7ea68545518ca3c255e28a20d3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:10.659524 5107 raft_consensus.cc:2468] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:10.659956 5319 leader_election.cc:304] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.660223 7551 raft_consensus.cc:2804] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.660321 7551 raft_consensus.cc:493] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.660420 7551 raft_consensus.cc:3060] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.662949 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54a83664397460399960a0f73966fef" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:10.663105 5100 raft_consensus.cc:3060] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.663955 7551 raft_consensus.cc:515] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.665482 5107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85130d7ea68545518ca3c255e28a20d3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:10.665673 5107 raft_consensus.cc:3060] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.669076 7359 raft_consensus.cc:493] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.669271 7359 raft_consensus.cc:515] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.669842 7359 leader_election.cc:290] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.614087 7111 ts_tablet_manager.cc:1929] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.670763 7111 log.cc:1199] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/794da0992403462dbbce644134b8aab3
I20260927 13:50:10.671172 7111 ts_tablet_manager.cc:1950] T 794da0992403462dbbce644134b8aab3 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:10.671641 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38aa46c6ab34ece89397d3940d847db" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:10.671718 5319 leader_election.cc:343] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bb6073174dbb4ca1933685b7bd3a22e1
W20260927 13:50:10.672082 5045 leader_election.cc:343] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.672094 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd84d3cf740040739d81de2460296d2c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.672159 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 176) took 4058 ms. Trace:
I20260927 13:50:10.672315 5100 raft_consensus.cc:2468] T e54a83664397460399960a0f73966fef P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:50:10.672518 5045 leader_election.cc:343] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.672983 5319 leader_election.cc:304] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.673660 7359 raft_consensus.cc:2804] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:10.673833 7359 raft_consensus.cc:697] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:10.674190 7359 consensus_queue.cc:237] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.669062 7551 leader_election.cc:290] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.672238 7111 rpcz_store.cc:276] 0927 13:50:06.613767 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.613808 (+ 41us) service_pool.cc:224] Handling call
0927 13:50:10.575583 (+3961775us) ts_tablet_manager.cc:1151] Deleting tablet 794da0992403462dbbce644134b8aab3
0927 13:50:10.575591 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.595676 (+ 20085us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.614032 (+ 18356us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.672138 (+ 58106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3961651}
I20260927 13:50:10.693595 7111 tablet_replica.cc:333] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.693840 7111 raft_consensus.cc:2243] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:10.694080 7111 pending_rounds.cc:70] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:50:10.694152 7111 pending_rounds.cc:77] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957672232075264 op_type: NO_OP noop_request { }
I20260927 13:50:10.694260 7111 raft_consensus.cc:2889] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:10.694344 7111 raft_consensus.cc:2272] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.639322 5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85130d7ea68545518ca3c255e28a20d3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:10.695222 7111 ts_tablet_manager.cc:1916] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.641559 5238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54a83664397460399960a0f73966fef" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:10.642606 5626 tablet_bootstrap.cc:654] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.695395 5238 raft_consensus.cc:2468] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:10.652091 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6a4cf5ee2b43158d8db4c7cdd4a42e" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:10.653141 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54a83664397460399960a0f73966fef" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:10.696151 5234 raft_consensus.cc:3060] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.697432 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a82284e3fd1f4a2f95c7e47320abb30c (table default.Table_f2893fa7f9724a009e6991e50c4152f9 [id=c25e04914c284d7593821643decbbbe2]). Expected version 2 got 0
I20260927 13:50:10.698904 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b5e8ae1a0ce2496cb2eed2066eb37a13 (table default.Table_cfdab7814ecc495089389612e0a7e4fe [id=ae170bbebc4e460fb58beb7f95f013a2]). Expected version 2 got 0
I20260927 13:50:10.699411 5234 raft_consensus.cc:2468] T e54a83664397460399960a0f73966fef P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:10.662494 5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38aa46c6ab34ece89397d3940d847db" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:10.662582 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd84d3cf740040739d81de2460296d2c" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:10.664858 5235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85130d7ea68545518ca3c255e28a20d3" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:10.669130 7370 consensus_queue.cc:1048] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.670552 5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6073174dbb4ca1933685b7bd3a22e1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:10.700093 5044 leader_election.cc:343] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.700204 5240 raft_consensus.cc:2468] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:10.700223 5044 leader_election.cc:304] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.700554 7618 raft_consensus.cc:2749] T e38aa46c6ab34ece89397d3940d847db P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:10.700754 5044 leader_election.cc:343] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.700851 5044 leader_election.cc:304] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.699747 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 3ee18063dc634385b9e61fae3b3ece99 (table default.Table_f2be6272899a44aea0960403abfd2474 [id=51e5eb6e824a402a8eaecca7f2516a71]). Expected version 2 got 0
I20260927 13:50:10.701506 7618 raft_consensus.cc:2749] T bd84d3cf740040739d81de2460296d2c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.702419 7190 log.cc:1199] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/06c810fde988439c97a8445fc88626b3
I20260927 13:50:10.702940 7190 ts_tablet_manager.cc:1950] T 06c810fde988439c97a8445fc88626b3 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.703374 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 239) took 1463 ms. Trace:
I20260927 13:50:10.703526 7190 rpcz_store.cc:276] 0927 13:50:09.240127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.240464 (+ 337us) service_pool.cc:224] Handling call
0927 13:50:10.578408 (+1337944us) ts_tablet_manager.cc:1151] Deleting tablet 06c810fde988439c97a8445fc88626b3
0927 13:50:10.588371 (+ 9963us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.606415 (+ 18044us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.636989 (+ 30574us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.703354 (+ 66365us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1337786}
I20260927 13:50:10.703562 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 67b4f8a3b92e44cba7ea9e2b48aa70bb (table default.Table_0f9befd26e8c4c1d90e5fb2fcbf7702f [id=6ab6358c2ecd4fa2a31e5b591639d1c3]). Expected version 1 got 0
I20260927 13:50:10.704142 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 06c810fde988439c97a8445fc88626b3 (table default.Table_2bf1c8729308443bba92997d06f84e9e [id=861ae0d96dd54f1dac15e3cce0ed657a]) successfully deleted
I20260927 13:50:10.704758 7190 tablet_replica.cc:333] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.705026 7190 raft_consensus.cc:2243] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.705231 7190 raft_consensus.cc:2272] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.705538 5626 tablet_bootstrap.cc:492] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:10.705842 5626 ts_tablet_manager.cc:1403] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.085s user 0.003s sys 0.002s
I20260927 13:50:10.706365 7098 ts_tablet_manager.cc:1929] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:10.706578 7098 log.cc:1199] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/d3149f6bbaf043f08970e19fd66c4e2a
I20260927 13:50:10.707185 7098 ts_tablet_manager.cc:1950] T d3149f6bbaf043f08970e19fd66c4e2a P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
W20260927 13:50:10.707432 5184 consensus_peers.cc:597] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8aeb0c2c2be04a598e011a9d99c5492a. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:10.707715 5107 raft_consensus.cc:2468] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:10.707582 5626 raft_consensus.cc:359] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.707994 5626 raft_consensus.cc:385] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.708144 5626 raft_consensus.cc:740] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.708619 5626 consensus_queue.cc:260] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.710224 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 36314f4c93434b1f8d462aa9d838da78 (table default.Table_954f47d3ef8846b8ade030d87002460e [id=750521adcb384c75841d7e1ff89af83d]). Expected version 2 got 0
I20260927 13:50:10.710496 5626 ts_tablet_manager.cc:1434] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:50:10.711432 5628 tablet_bootstrap.cc:492] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.711565 5628 ts_tablet_manager.cc:1403] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.079s user 0.009s sys 0.000s
I20260927 13:50:10.711920 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 195) took 4196 ms. Trace:
I20260927 13:50:10.712664 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 5230aab9688e45b79bd0064716378152 (table default.Table_898704d6564c46279e001e1834d3fcbd [id=2e422cde8dc4446b9ece8cbbb12b275d]). Expected version 1 got 0
I20260927 13:50:10.712946 7370 consensus_queue.cc:1048] T 8aeb0c2c2be04a598e011a9d99c5492a P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.712670 7098 rpcz_store.cc:276] 0927 13:50:06.515034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.515715 (+ 681us) service_pool.cc:224] Handling call
0927 13:50:10.480466 (+3964751us) ts_tablet_manager.cc:1151] Deleting tablet d3149f6bbaf043f08970e19fd66c4e2a
0927 13:50:10.480477 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.631240 (+150763us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.706278 (+ 75038us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.711870 (+ 5592us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3964377}
I20260927 13:50:10.713312 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b6985779674646f4abe18cdf7c063c90 (table default.Table_8e14804c24074e6fb0535144048886aa [id=c8fc51d181554744b841aa4829281293]). Expected version 1 got 0
I20260927 13:50:10.713762 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet d3149f6bbaf043f08970e19fd66c4e2a (table default.Table_fe3174f3ee074adf9193e1f8228cdcce [id=ab3279095ebc4b26bc3f83fc7c8ef050]) successfully deleted
I20260927 13:50:10.715713 5619 tablet_bootstrap.cc:492] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.715862 5619 ts_tablet_manager.cc:1403] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.092s user 0.000s sys 0.004s
I20260927 13:50:10.715624 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a81b44fb2f644dff899d6d4aa435ccee (table default.Table_a9c7908f36d44d36af173f11ac4f1036 [id=9add8d65c6ee4e2fbdba0385c7c781f0]). Expected version 1 got 0
I20260927 13:50:10.716519 5619 raft_consensus.cc:359] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.716689 5619 raft_consensus.cc:385] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.716754 5619 raft_consensus.cc:740] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.716964 5619 consensus_queue.cc:260] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.717489 5619 ts_tablet_manager.cc:1434] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:50:10.717797 5619 tablet_bootstrap.cc:492] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
W20260927 13:50:10.718782 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.65:41061, user_credentials={real_user=slave}} blocked reactor thread for 45821.9us
I20260927 13:50:10.719748 5107 raft_consensus.cc:1275] T 5a3f40a2da8649e0898c0e09b6e14a61 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 2 FOLLOWER]: Refusing update from remote peer bb28c54312c94d7dafb1c2abf7870735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260927 13:50:10.720918 5626 tablet_bootstrap.cc:492] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:10.720944 7098 tablet_replica.cc:333] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:10.721452 7098 raft_consensus.cc:2243] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.721915 7098 raft_consensus.cc:2272] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.712327 5628 raft_consensus.cc:359] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.722882 5628 raft_consensus.cc:385] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.723237 5628 raft_consensus.cc:740] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.723512 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 794da0992403462dbbce644134b8aab3 (table default.Table_e11854abc7164d67b4195185f22c8295 [id=49a148957d6b4260ab46333b2bc3ef5e]) successfully deleted
I20260927 13:50:10.705852 7190 ts_tablet_manager.cc:1916] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.724148 5619 tablet_bootstrap.cc:654] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.723856 7098 ts_tablet_manager.cc:1916] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.724818 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 86ee31d13d1a4c3c99b9accb4e4f5cb6 (table default.Table_6ac0611179c743808ff8a129f463dd61 [id=fe64adff124845c0b35692c8e48f8759]). Expected version 3 got 0
W20260927 13:50:10.728639 5319 leader_election.cc:343] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.728716 5626 tablet_bootstrap.cc:654] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.729297 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 730cd78c7b1a49d892a5ecb46fae0812 (table default.Table_913f04b3fb9d4853bf4336a083b8db90 [id=09f1e26cdb9d43caa342b7838a48769b]). Expected version 1 got 0
I20260927 13:50:10.731622 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 78c4bbb0512c4411916eb4c48731f32f (table default.Table_a8400e9d55a443c8be9578d5fffea620 [id=a3255ff7dbd84d16ad7c0c0b9de742eb]). Expected version 3 got 0
I20260927 13:50:10.734856 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d237de6ef27c49c4a330c07cb75c103d (table default.Table_c13ee5ddbad749ccb5ae5deb842c4715 [id=738dc980eaa54501a3c8f944bb5882f1]). Expected version 1 got 0
W20260927 13:50:10.735657 5319 leader_election.cc:343] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.724714 5628 consensus_queue.cc:260] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.736446 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cbacda63c0d3427aabf3332b278576c5 (table default.Table_96ac3db0376145b99e6793ebf9ec550d [id=935f2e2df32c46e58760dba62709c181]). Expected version 5 got 0
W20260927 13:50:10.738513 5319 leader_election.cc:343] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.742272 5319 leader_election.cc:304] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:10.742695 7551 raft_consensus.cc:2804] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.742779 7551 raft_consensus.cc:493] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.742842 7551 raft_consensus.cc:3060] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.744668 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 85130d7ea68545518ca3c255e28a20d3 (table default.Table_6625bcf79aa945c9ac7ee8d1da4f8cd1 [id=de8b7ce50f8c4bb4a105d25f701d4d82]). Expected version 2 got 0
I20260927 13:50:10.745555 7551 raft_consensus.cc:515] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.746995 7551 leader_election.cc:290] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.747761 5319 leader_election.cc:304] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:10.748275 7305 raft_consensus.cc:2804] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:10.748463 7305 raft_consensus.cc:697] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:10.748775 7305 consensus_queue.cc:237] T 85130d7ea68545518ca3c255e28a20d3 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.749756 7359 consensus_queue.cc:1048] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.751173 7370 consensus_queue.cc:1048] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.751274 7359 consensus_queue.cc:1048] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.753731 5628 ts_tablet_manager.cc:1434] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.042s user 0.003s sys 0.000s
I20260927 13:50:10.760613 5619 tablet_bootstrap.cc:492] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.760794 5619 ts_tablet_manager.cc:1403] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.002s
I20260927 13:50:10.761127 5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6073174dbb4ca1933685b7bd3a22e1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:10.761318 5240 raft_consensus.cc:3060] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.762611 7203 consensus_queue.cc:1048] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 13:50:10.764168 5184 consensus_peers.cc:597] T da5d9bda857f467da6930a6c64266f3a P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da5d9bda857f467da6930a6c64266f3a. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:10.764665 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 16743b4513fa4987aee48f03e28cd498 (table default.Table_8daba74a17de4de1ad4cb175abfb5ef1 [id=158c69f5ddf54ccbb892c4c8fc8127bf]). Expected version 1 got 0
I20260927 13:50:10.765093 7370 raft_consensus.cc:493] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.767093 7370 raft_consensus.cc:515] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.769590 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9872d637765b4d719e2de63ae1eb3196" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:10.769826 5096 raft_consensus.cc:2393] T 9872d637765b4d719e2de63ae1eb3196 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:10.769752 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 20766b5a757e4a7e954c198f8c9ca41f (table default.Table_1fbf1fb833ce44d686292862a8964c3a [id=e60348438be94e88be62039a5ac173b5]). Expected version 3 got 0
I20260927 13:50:10.770576 5240 raft_consensus.cc:2468] T bb6073174dbb4ca1933685b7bd3a22e1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:10.770710 7370 leader_election.cc:290] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.776805 5628 tablet_bootstrap.cc:492] T 97b46497d8254a248df8d421d0b09d8d P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.779153 7481 raft_consensus.cc:493] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.779341 7481 raft_consensus.cc:515] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.780081 7481 leader_election.cc:290] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:10.780587 5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a3568681214fb1943b2c7e903288ea" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:10.781293 5044 leader_election.cc:343] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.781896 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9872d637765b4d719e2de63ae1eb3196" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:10.782476 5185 leader_election.cc:304] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.783038 7265 raft_consensus.cc:3060] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.785907 7265 raft_consensus.cc:2749] T 9872d637765b4d719e2de63ae1eb3196 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.784221 6454 catalog_manager.cc:5838] T b54cf8c485324f798d59edf65d52d7b5 P bb28c54312c94d7dafb1c2abf7870735 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67). New cstate: current_term: 1 leader_uuid: "bb28c54312c94d7dafb1c2abf7870735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260927 13:50:10.788435 7190 ts_tablet_manager.cc:1929] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:10.788375 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b54cf8c485324f798d59edf65d52d7b5 (table default.Table_6e2914ee899a441f927bce219231e7ab [id=8afc172cdb804d42b8bd6b15d829da61]). Expected version 1 got 0
I20260927 13:50:10.789161 7190 log.cc:1199] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/2cec272546cb4373bf69e3ab344c46e1
I20260927 13:50:10.790534 7359 raft_consensus.cc:493] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.790684 7359 raft_consensus.cc:515] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.791282 7359 leader_election.cc:290] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.791792 7190 ts_tablet_manager.cc:1950] T 2cec272546cb4373bf69e3ab344c46e1 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.792604 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e917382b6f3d4e009fa159ed38c342d8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:10.792773 5239 raft_consensus.cc:2468] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:10.792125 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet e3765fe06c664e60a11acf76c825bc42 (table default.Table_43903bb03edc4073b902613a00b900f6 [id=91f1f84c40514e0ba6d0ee865f6d9aee]). Expected version 1 got 0
I20260927 13:50:10.793114 5096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e917382b6f3d4e009fa159ed38c342d8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:10.793346 5096 raft_consensus.cc:2468] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:10.793421 5619 raft_consensus.cc:359] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.793594 5619 raft_consensus.cc:385] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.793654 5619 raft_consensus.cc:740] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.793860 5619 consensus_queue.cc:260] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.794539 5619 ts_tablet_manager.cc:1434] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20260927 13:50:10.794842 5619 tablet_bootstrap.cc:492] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:10.794687 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 241) took 1553 ms. Trace:
I20260927 13:50:10.796388 5619 tablet_bootstrap.cc:654] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.797499 7111 ts_tablet_manager.cc:1929] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.797598 7111 log.cc:1199] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/b3fbf1e7f5e04122a65f6e192ffdae20
I20260927 13:50:10.797930 7111 ts_tablet_manager.cc:1950] T b3fbf1e7f5e04122a65f6e192ffdae20 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:10.798722 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 177) took 4184 ms. Trace:
I20260927 13:50:10.798863 7111 rpcz_store.cc:276] 0927 13:50:06.614032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.614067 (+ 35us) service_pool.cc:224] Handling call
0927 13:50:10.693538 (+4079471us) ts_tablet_manager.cc:1151] Deleting tablet b3fbf1e7f5e04122a65f6e192ffdae20
0927 13:50:10.693549 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.732908 (+ 39359us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.797436 (+ 64528us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.798702 (+ 1266us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4079292}
I20260927 13:50:10.799296 7111 tablet_replica.cc:333] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.799593 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a3568681214fb1943b2c7e903288ea" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:10.800024 5319 consensus_peers.cc:597] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 496cffc2a8774185a0e0f63208bed8a5. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:50:10.800237 5319 leader_election.cc:343] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: bb6073174dbb4ca1933685b7bd3a22e1
I20260927 13:50:10.800453 5319 leader_election.cc:304] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.800719 7305 raft_consensus.cc:2804] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:10.800851 7305 raft_consensus.cc:493] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:10.800962 7305 raft_consensus.cc:3060] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.803818 7305 raft_consensus.cc:515] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.804317 5628 tablet_bootstrap.cc:654] T 97b46497d8254a248df8d421d0b09d8d P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.804944 7305 leader_election.cc:290] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.805598 5626 tablet_bootstrap.cc:492] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:10.806013 7359 consensus_queue.cc:1048] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.806161 5626 ts_tablet_manager.cc:1403] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.085s user 0.006s sys 0.005s
I20260927 13:50:10.806574 5155 heartbeater.cc:344] Connected to a master server at 127.4.163.124:37095
I20260927 13:50:10.806981 7359 consensus_queue.cc:1048] T 6fdacca4b5bd4afb95c83f6c72091b2f P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.808429 7361 consensus_queue.cc:1048] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.809432 5626 raft_consensus.cc:359] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.810724 5626 raft_consensus.cc:385] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.811112 5319 leader_election.cc:304] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:10.811056 5626 raft_consensus.cc:740] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.811456 7111 raft_consensus.cc:2243] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.811967 7359 raft_consensus.cc:2804] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:10.795877 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a5feae3a28cd44ff9392a1574a444db3 (table default.Table_b06f5c4b54b642a8b25acb1c186d9aa9 [id=13d176473e094cb1b8215bc984f49c96]). Expected version 1 got 0
I20260927 13:50:10.812073 7359 raft_consensus.cc:697] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:10.812292 7359 consensus_queue.cc:237] T bb6073174dbb4ca1933685b7bd3a22e1 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.795710 7190 rpcz_store.cc:276] 0927 13:50:09.240707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.240740 (+ 33us) service_pool.cc:224] Handling call
0927 13:50:10.704702 (+1463962us) ts_tablet_manager.cc:1151] Deleting tablet 2cec272546cb4373bf69e3ab344c46e1
0927 13:50:10.704715 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.752740 (+ 48025us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.788029 (+ 35289us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.794500 (+ 6471us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1463657}
I20260927 13:50:10.817948 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 2cec272546cb4373bf69e3ab344c46e1 (table default.Table_f5e45d5a82894bd3a24dc602992d9aba [id=26afd076a9f840c6b390ffade5256307]) successfully deleted
I20260927 13:50:10.818912 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 242) took 1577 ms. Trace:
I20260927 13:50:10.819180 7190 rpcz_store.cc:276] 0927 13:50:09.240943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.240974 (+ 31us) service_pool.cc:224] Handling call
0927 13:50:10.818533 (+1577559us) ts_tablet_manager.cc:1151] Deleting tablet 14f5479761f94ee0b339e125d06a808c
0927 13:50:10.818577 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.818861 (+ 284us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1577436}
W20260927 13:50:10.820303 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 14f5479761f94ee0b339e125d06a808c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14f5479761f94ee0b339e125d06a808c already in progress: creating tablet
I20260927 13:50:10.820506 7305 consensus_queue.cc:1048] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.820785 7190 tablet_replica.cc:333] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.821141 7111 raft_consensus.cc:2272] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.821171 7190 raft_consensus.cc:2243] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.821458 7190 raft_consensus.cc:2272] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.822141 7111 ts_tablet_manager.cc:1916] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.822377 7190 ts_tablet_manager.cc:1916] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.811944 5626 consensus_queue.cc:260] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.824272 5626 ts_tablet_manager.cc:1434] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260927 13:50:10.825634 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 03917a40b5884401a6bc09c7925fd1ae (table default.Table_5bade20242f84b61b8c6a9639fe4d9a6 [id=a160103a454d421c8be6a88afa7c1419]). Expected version 2 got 0
W20260927 13:50:10.827623 5045 leader_election.cc:343] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.827639 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet b3fbf1e7f5e04122a65f6e192ffdae20 (table default.Table_3614a1889eea43b39d1d94a3211a5473 [id=28c69a82f6db4ae5a5a5f6a608f0c899]) successfully deleted
I20260927 13:50:10.827754 5045 leader_election.cc:304] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.829277 7481 raft_consensus.cc:2749] T 76a3568681214fb1943b2c7e903288ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:10.830762 5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e917382b6f3d4e009fa159ed38c342d8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:10.830962 5240 raft_consensus.cc:3060] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.833945 5240 raft_consensus.cc:2468] T e917382b6f3d4e009fa159ed38c342d8 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:10.835162 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
I20260927 13:50:10.835451 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:10.836246 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:10.836964 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:10.837007 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e917382b6f3d4e009fa159ed38c342d8" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:10.837306 5100 raft_consensus.cc:3060] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:10.837342 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 2cc7301d09b245328a851a0734669965 (table default.Table_7a5a607e5463433eb93aedb9f76696db [id=1f268483d3c7447abfe7a024dd0aec58]). Expected version 1 got 0
I20260927 13:50:10.838442 5626 tablet_bootstrap.cc:492] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:10.844368 5100 raft_consensus.cc:2468] T e917382b6f3d4e009fa159ed38c342d8 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
W20260927 13:50:10.860883 5184 consensus_peers.cc:597] T 30bbc6c76a194e5dbd5e9ea08e95f4f7 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30bbc6c76a194e5dbd5e9ea08e95f4f7. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:10.863843 5619 tablet_bootstrap.cc:492] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.864151 5619 ts_tablet_manager.cc:1403] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.069s user 0.002s sys 0.002s
I20260927 13:50:10.837908 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 352e564866a747798ad44218133844ba (table default.Table_3d333d5b90954af4a67360576d58d113 [id=ac8977fb4dd34fa48e02d04b2053a1d3]). Expected version 1 got 0
I20260927 13:50:10.870224 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 0fe47041b75d492bbce62c95d90de021 (table default.Table_eabbc608c09045b095cdfe05e9660ac7 [id=a6d3f0f894904a738cc54fe5d8631f06]). Expected version 1 got 0
I20260927 13:50:10.870597 5319 leader_election.cc:304] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:10.871037 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 27131f0e8c9e4f1ea290989155ddcd0b (table default.Table_4c3a11147b0c4ecbac699f3e43945347 [id=a07764428ec9495187341fea03ae6349]). Expected version 1 got 0
I20260927 13:50:10.871543 7765 raft_consensus.cc:2804] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:10.871675 7765 raft_consensus.cc:697] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:10.871927 7765 consensus_queue.cc:237] T e917382b6f3d4e009fa159ed38c342d8 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.872418 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 6fdacca4b5bd4afb95c83f6c72091b2f (table default.Table_b68a6b76e8684ab9ab1e52fbfaad3740 [id=b7649e0adc2e4b6c82afa8d846d54aa1]). Expected version 2 got 0
I20260927 13:50:10.873787 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet bad30e7310c842e6818471272f5d669e (table default.Table_b9c7f24da5d7468ba87025ae9e22a80c [id=77f35cbefeec4875839aadb06d0d0238]). Expected version 2 got 0
I20260927 13:50:10.875008 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 78719428d7b34f28a99722b093f6ab54 (table default.Table_6d795d7a66ee42f3a7fb0cef447cddba [id=ed8d36823c5c43eaa1e8b0447c7f32e9]). Expected version 1 got 0
I20260927 13:50:10.875728 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:50:10.865489 5619 raft_consensus.cc:359] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.877761 5619 raft_consensus.cc:385] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.878201 5619 raft_consensus.cc:740] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.878786 5619 consensus_queue.cc:260] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.879683 5626 tablet_bootstrap.cc:654] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.880175 5619 ts_tablet_manager.cc:1434] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260927 13:50:10.880662 5619 tablet_bootstrap.cc:492] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:10.880604 7370 consensus_queue.cc:1048] T 23e3bb24afad4d789041b6a557512618 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.888311 7370 consensus_queue.cc:1048] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:10.899580 5626 tablet_bootstrap.cc:492] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:10.900962 5626 ts_tablet_manager.cc:1403] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.001s
I20260927 13:50:10.911044 5626 raft_consensus.cc:359] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.914237 5626 raft_consensus.cc:385] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.914686 5626 raft_consensus.cc:740] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.915835 7370 raft_consensus.cc:493] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.915509 5626 consensus_queue.cc:260] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.916334 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:10.916268 7370 raft_consensus.cc:515] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:10.916874 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet ead437e93bb14a73a820631b0be041aa (table default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]). Expected version 1 got 0
I20260927 13:50:10.917375 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 85debab98b0f42a5b50f1b0d132147d3 (table default.Table_c4ef5bb456044de098673a074f5f615a [id=a923173934944f4592852e7779d0bb56]). Expected version 1 got 0
I20260927 13:50:10.918269 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 07830b76d7e14ff0b6b1b1523dda21bc (table default.Table_3abb801c19b540b7b65b1d75791fdff7 [id=5c18a5a9f69148d7824d38061b9afd07]). Expected version 2 got 0
W20260927 13:50:10.918525 5184 leader_election.cc:343] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 46537e1b33f24d50b705d53f6978da3c
I20260927 13:50:10.918526 5626 ts_tablet_manager.cc:1434] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260927 13:50:10.919028 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet f3e3ebd06dd1429fa5ec20396e4bb5b6 (table default.Table_34ee215f816d43d0a898670a8a9ed63a [id=51ce4847d92b4f308863d1e4ffe6dbf4]). Expected version 1 got 0
I20260927 13:50:10.919831 7370 leader_election.cc:290] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:10.919823 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b594c65e18d94d1dba45b34dc520823c (table default.Table_e969ed1c04384e2cbafb90d72cbdef52 [id=544e192ba7d148e5b94011fd326fdb0a]). Expected version 1 got 0
I20260927 13:50:10.920372 5626 tablet_bootstrap.cc:492] T 5848740410d74e749ad6c44591ab0d24 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:10.921375 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet dec7c4c6b46d4b5791d9b7af1a8e55cc (table default.Table_1731298f7d9c4e41bfe89acaa4624028 [id=b6aa56ef149348aaa266a4ea12e61c26]). Expected version 1 got 0
W20260927 13:50:10.922247 5185 leader_election.cc:343] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Not found: Tablet not found: 46537e1b33f24d50b705d53f6978da3c
I20260927 13:50:10.922360 5185 leader_election.cc:304] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:10.922729 5619 tablet_bootstrap.cc:654] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.922834 7370 raft_consensus.cc:2749] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:10.927107 5184 consensus_peers.cc:597] T f49384587bfa41d6aabfa8ee175d6abe P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f49384587bfa41d6aabfa8ee175d6abe. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:10.930095 7111 ts_tablet_manager.cc:1929] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.930444 7111 log.cc:1199] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/2e30216e0487496f8efdb8a3b06deb5a
I20260927 13:50:10.931237 7111 ts_tablet_manager.cc:1950] T 2e30216e0487496f8efdb8a3b06deb5a P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:10.882733 5628 tablet_bootstrap.cc:492] T 97b46497d8254a248df8d421d0b09d8d P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.931828 5628 ts_tablet_manager.cc:1403] T 97b46497d8254a248df8d421d0b09d8d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.155s user 0.004s sys 0.004s
I20260927 13:50:10.931900 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 178) took 4317 ms. Trace:
I20260927 13:50:10.932026 7111 rpcz_store.cc:276] 0927 13:50:06.614369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.614406 (+ 37us) service_pool.cc:224] Handling call
0927 13:50:10.799252 (+4184846us) ts_tablet_manager.cc:1151] Deleting tablet 2e30216e0487496f8efdb8a3b06deb5a
0927 13:50:10.799261 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.858091 (+ 58830us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.929983 (+ 71892us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.931853 (+ 1870us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21023,"tablet-delete.queue_time_us":4184715}
I20260927 13:50:10.932654 7111 tablet_replica.cc:333] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:10.932653 5628 raft_consensus.cc:359] T 97b46497d8254a248df8d421d0b09d8d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.932881 5628 raft_consensus.cc:385] T 97b46497d8254a248df8d421d0b09d8d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.932937 5628 raft_consensus.cc:740] T 97b46497d8254a248df8d421d0b09d8d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.883641 7481 raft_consensus.cc:493] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.933125 7111 raft_consensus.cc:2243] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.933136 7481 raft_consensus.cc:515] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.933374 7111 raft_consensus.cc:2272] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.933751 7481 leader_election.cc:290] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:10.934415 5628 consensus_queue.cc:260] T 97b46497d8254a248df8d421d0b09d8d P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.935434 5628 ts_tablet_manager.cc:1434] T 97b46497d8254a248df8d421d0b09d8d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:50:10.935966 5628 tablet_bootstrap.cc:492] T a5feae3a28cd44ff9392a1574a444db3 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:10.936111 5626 tablet_bootstrap.cc:654] T 5848740410d74e749ad6c44591ab0d24 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.938151 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5848740410d74e749ad6c44591ab0d24" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:10.940740 5044 leader_election.cc:343] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:10.944074 5628 tablet_bootstrap.cc:654] T a5feae3a28cd44ff9392a1574a444db3 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.917310 7098 ts_tablet_manager.cc:1929] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:10.945446 7098 log.cc:1199] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/b0827a26334c42728545a9eaa006fae0
I20260927 13:50:10.945806 7098 ts_tablet_manager.cc:1950] T b0827a26334c42728545a9eaa006fae0 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:10.948228 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 196) took 4431 ms. Trace:
I20260927 13:50:10.948326 7098 rpcz_store.cc:276] 0927 13:50:06.516646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.517023 (+ 377us) service_pool.cc:224] Handling call
0927 13:50:10.720836 (+4203813us) ts_tablet_manager.cc:1151] Deleting tablet b0827a26334c42728545a9eaa006fae0
0927 13:50:10.720873 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.841133 (+120260us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.916906 (+ 75773us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.948206 (+ 31300us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4203619}
I20260927 13:50:10.948685 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 198) took 4431 ms. Trace:
I20260927 13:50:10.948748 7098 rpcz_store.cc:276] 0927 13:50:06.516870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.517245 (+ 375us) service_pool.cc:224] Handling call
0927 13:50:10.948597 (+4431352us) ts_tablet_manager.cc:1151] Deleting tablet 60de1c28618f4e478aae68ad07fbcf98
0927 13:50:10.948607 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.948674 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4431228}
I20260927 13:50:10.948861 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet b0827a26334c42728545a9eaa006fae0 (table default.Table_cb2cdf43d4eb4fc1b302363907f746a2 [id=a2e5f425d1494b40a9b253e6b2d4c86d]) successfully deleted
W20260927 13:50:10.949519 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 60de1c28618f4e478aae68ad07fbcf98 because the tablet was not found. No further retry: Not found: Tablet not found: 60de1c28618f4e478aae68ad07fbcf98
I20260927 13:50:10.956525 7190 ts_tablet_manager.cc:1929] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:10.956784 7190 log.cc:1199] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/f3e0e8d6bc744d69a9f41d45459d3b2b
I20260927 13:50:10.957196 7190 ts_tablet_manager.cc:1950] T f3e0e8d6bc744d69a9f41d45459d3b2b P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:10.958815 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 243) took 1717 ms. Trace:
W20260927 13:50:10.958981 5711 leader_election.cc:336] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 802b83f09d3445359cfac825cd87c9de (127.4.163.124:37095): Timed out: RequestConsensusVote RPC to 127.4.163.124:37095 timed out after 0.616s (SENT)
I20260927 13:50:10.959142 5711 leader_election.cc:304] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13a42ae8b95b495c9bcea85d6732cd77; no voters: 802b83f09d3445359cfac825cd87c9de, e421351a34d1463e9773dcebdeebae3c
I20260927 13:50:10.959024 7190 rpcz_store.cc:276] 0927 13:50:09.241683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.241720 (+ 37us) service_pool.cc:224] Handling call
0927 13:50:10.820709 (+1578989us) ts_tablet_manager.cc:1151] Deleting tablet f3e0e8d6bc744d69a9f41d45459d3b2b
0927 13:50:10.820720 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.911449 (+ 90729us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.956429 (+ 44980us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:10.958766 (+ 2337us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1578830}
I20260927 13:50:10.960067 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet f3e0e8d6bc744d69a9f41d45459d3b2b (table default.Table_d294f0cb024e426592bf4bf7f261f4be [id=56da4ca311574a50af8ec358752e07a4]) successfully deleted
I20260927 13:50:10.961582 7796 raft_consensus.cc:493] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:10.961864 7796 raft_consensus.cc:515] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.963492 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet eed08fbd918b4b78b6ab8f4099506e29 (table default.Table_d79204140f8b4582bc15badf8200790b [id=8cc067f3baa348e99f8104f519ee88d9]). Expected version 1 got 0
I20260927 13:50:10.964056 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 3b26289ed050454d817c13159295ec37 (table default.Table_5b64a307e44a471598ef010e33a82fe3 [id=9c86bcdd37654832b7a92763aa42e6c4]). Expected version 1 got 0
I20260927 13:50:10.964805 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet e77aba9467864ad7ac9c1931c2162eef (table default.Table_de28ad6c05ff40b99876d163d6273ffc [id=03a2b911229f4ca989e3c0a76374ddb8]). Expected version 1 got 0
I20260927 13:50:10.964949 7098 tablet_replica.cc:333] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:10.965191 7098 raft_consensus.cc:2243] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:10.965368 7098 raft_consensus.cc:2272] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.965857 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet c655651f9cb24310a5aa2e5b84c2a455 (table default.Table_5c96e3711de04429a590499eb47d5784 [id=db63359dda9d4b729446d6ddf78c30b8]). Expected version 1 got 0
I20260927 13:50:10.965966 7098 ts_tablet_manager.cc:1916] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.969740 5626 tablet_bootstrap.cc:492] T 5848740410d74e749ad6c44591ab0d24 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:10.969906 5626 ts_tablet_manager.cc:1403] T 5848740410d74e749ad6c44591ab0d24 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.002s
I20260927 13:50:10.969954 5628 tablet_bootstrap.cc:492] T a5feae3a28cd44ff9392a1574a444db3 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:10.970091 5628 ts_tablet_manager.cc:1403] T a5feae3a28cd44ff9392a1574a444db3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.003s
I20260927 13:50:10.970831 5626 raft_consensus.cc:359] T 5848740410d74e749ad6c44591ab0d24 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:10.970932 5319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.163.66:39007, user_credentials={real_user=slave}} blocked reactor thread for 57643.9us
I20260927 13:50:10.971042 5626 raft_consensus.cc:385] T 5848740410d74e749ad6c44591ab0d24 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.971112 5626 raft_consensus.cc:740] T 5848740410d74e749ad6c44591ab0d24 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.971320 5626 consensus_queue.cc:260] T 5848740410d74e749ad6c44591ab0d24 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.971778 5619 tablet_bootstrap.cc:492] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:10.971899 5619 ts_tablet_manager.cc:1403] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.091s user 0.003s sys 0.001s
I20260927 13:50:10.972007 5626 ts_tablet_manager.cc:1434] T 5848740410d74e749ad6c44591ab0d24 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 13:50:10.972278 5626 tablet_bootstrap.cc:492] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:10.972702 5619 raft_consensus.cc:359] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.972879 5619 raft_consensus.cc:385] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.972939 5619 raft_consensus.cc:740] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.973134 5619 consensus_queue.cc:260] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.973672 5619 ts_tablet_manager.cc:1434] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 13:50:10.973982 5619 tablet_bootstrap.cc:492] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:10.974025 5626 tablet_bootstrap.cc:654] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.975065 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 2e30216e0487496f8efdb8a3b06deb5a (table default.Table_81d446c6cfde4dd8b7cba22c219df25c [id=4997d0b27b0240959549e68dda2f9958]) successfully deleted
I20260927 13:50:10.974754 7796 leader_election.cc:290] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:10.977630 5619 tablet_bootstrap.cc:654] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:10.977731 5239 raft_consensus.cc:1275] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Refusing update from remote peer bb28c54312c94d7dafb1c2abf7870735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260927 13:50:10.979111 7111 ts_tablet_manager.cc:1916] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.986318 7190 tablet_replica.cc:333] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:10.986634 7190 raft_consensus.cc:2243] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:10.987046 7190 raft_consensus.cc:2272] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:10.987720 7190 ts_tablet_manager.cc:1916] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:10.989007 5628 raft_consensus.cc:359] T a5feae3a28cd44ff9392a1574a444db3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.990060 5628 raft_consensus.cc:385] T a5feae3a28cd44ff9392a1574a444db3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:10.990440 5628 raft_consensus.cc:740] T a5feae3a28cd44ff9392a1574a444db3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:10.991469 5628 consensus_queue.cc:260] T a5feae3a28cd44ff9392a1574a444db3 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:10.995625 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 01b549d0d21d421cba1c830d8e0bd04d (table default.Table_384ae9c2c24745999157e1023e76d208 [id=018ce9cba14c46bd8c25ca99237d7335]). Expected version 1 got 0
I20260927 13:50:10.996188 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet a4099c41981f46758a8f478d7fdb4182 (table default.Table_c59836cd19cf4bbaad679c62e79a19f8 [id=0233299f43344cb0b577c4c5e25c3020]). Expected version 1 got 0
I20260927 13:50:10.996940 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 2a2ee02044b64e3eaff8136ac43f02e4 (table default.Table_eedb59651f834988beda0cf22feb1a18 [id=d10b0e841c1a4216bb5520929ee59e62]). Expected version 2 got 0
I20260927 13:50:10.997849 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet bd84d3cf740040739d81de2460296d2c (table default.Table_9511933508164b64b6d5e6442acc8f95 [id=1b5922291fe24c11b954d9959ae1f979]). Expected version 1 got 0
I20260927 13:50:10.998427 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 69606adaa96d431791ed5c8455a7c548 (table default.Table_adbaa26694924194a1f32f00d83a8f3d [id=cc68d7aed0a1451f9b1e55a1f01ac7e0]). Expected version 1 got 0
I20260927 13:50:11.001544 7801 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 13a42ae8b95b495c9bcea85d6732cd77 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260927 13:50:11.004479 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08798185a7c641f98d7dc6a6b1b72e0a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:11.004683 5239 raft_consensus.cc:2468] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:11.008101 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5848740410d74e749ad6c44591ab0d24" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.008556 5380 raft_consensus.cc:2468] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 0.
W20260927 13:50:11.009287 5319 consensus_peers.cc:597] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0191cfad4e7a4b088b2ecdc246bfa58a. This is attempt 1: this message will repeat every 5th retry.
W20260927 13:50:11.010336 5711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.163.124:37095, user_credentials={real_user=slave}} blocked reactor thread for 51372.7us
I20260927 13:50:11.013150 5626 tablet_bootstrap.cc:492] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:11.013309 5626 ts_tablet_manager.cc:1403] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.001s
I20260927 13:50:11.013501 7795 raft_consensus.cc:493] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.013674 7795 raft_consensus.cc:515] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.014456 7795 leader_election.cc:290] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.014454 5626 raft_consensus.cc:359] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.014645 5626 raft_consensus.cc:385] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.014708 5626 raft_consensus.cc:740] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.014922 5626 consensus_queue.cc:260] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.002265 7481 raft_consensus.cc:493] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.015223 7481 raft_consensus.cc:515] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.015434 5626 ts_tablet_manager.cc:1434] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:11.015877 7481 leader_election.cc:290] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:11.015977 5626 tablet_bootstrap.cc:492] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:11.016369 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff6a19af8ae4c84af4a8095eca4115e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:11.016842 5044 leader_election.cc:343] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.017802 5626 tablet_bootstrap.cc:654] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.019165 5628 ts_tablet_manager.cc:1434] T a5feae3a28cd44ff9392a1574a444db3 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.049s user 0.000s sys 0.002s
I20260927 13:50:11.027159 5628 tablet_bootstrap.cc:492] T 2e768c83fae54619ac849dfedd5ec654 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:11.029067 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 502fe193f2034e37a53b245bbf049ae8 (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]). Expected version 2 got 0
I20260927 13:50:11.029739 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet cc8de5211f7b4d3daa14b825ce17793a (table default.Table_ae3b867d65d84e43bb112030a613db25 [id=a7317f1ad2b24ce3be56df44e087bfa0]). Expected version 1 got 0
I20260927 13:50:11.030027 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1436bcea966646969789e6e09f91c557 (table default.Table_62bb0683032a40b88aaba89d944f831a [id=bc5f4effd6604f7aba8706b9bb04bda4]). Expected version 1 got 0
I20260927 13:50:11.030331 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet eef853d6e6ce4848927c9de884d39ac2 (table default.Table_41545a521e094a5aaf008a68487f0e03 [id=ec046cb1c7db4739bf79469063f2f287]). Expected version 1 got 0
I20260927 13:50:11.030661 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 58acd8932a2647a0a20679614cc2b68a (table default.Table_05c30257326a4d0d91afbf8182d33a3d [id=5cd11f4b179449438728efcb6e9c82c1]). Expected version 1 got 0
I20260927 13:50:11.031193 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet e6b1e7169cdd4f6b8dced0a807bc17e8 (table default.Table_c74dcd01d43b41babf48734ca8244f9f [id=d45c549bb1fe42f48f0aff415f91c29b]). Expected version 2 got 0
I20260927 13:50:11.031360 5319 leader_election.cc:304] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:11.031615 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 5678703b72c8471583147786f49122a5 (table default.Table_f3c5680fa304438d9df88d573453cd6f [id=0d85f9f0d28e43debda43f83a3e59637]). Expected version 2 got 0
I20260927 13:50:11.031337 7799 consensus_queue.cc:1048] T 5a3f40a2da8649e0898c0e09b6e14a61 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:11.031975 7551 raft_consensus.cc:2804] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:11.032130 7551 raft_consensus.cc:493] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:11.032184 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 9e808336f5b746d486d375695536c052 (table default.Table_36609f3408124349b504ae9eb3275d87 [id=d088563f44224b01a3eba63ce70e5681]). Expected version 1 got 0
I20260927 13:50:11.032265 7551 raft_consensus.cc:3060] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.033057 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet d897f986d26a44f4894e147a74a90949 (table default.Table_f25d83d382d244f5996d649ed03b248c [id=ae585ff9a7fa497bb3ba2980b551d37f]). Expected version 1 got 0
I20260927 13:50:11.033397 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 7e3f7ded9d644d749532e0700844bd62 (table default.Table_16182f7e0f9048b885dc03d5a0f95f13 [id=bd48f9df5dc34ec48d5742d8ec30feda]). Expected version 2 got 0
I20260927 13:50:11.035398 7799 raft_consensus.cc:493] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.035539 7799 raft_consensus.cc:515] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.036231 7799 leader_election.cc:290] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.028682 5628 tablet_bootstrap.cc:654] T 2e768c83fae54619ac849dfedd5ec654 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.041752 7551 raft_consensus.cc:515] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.043306 7424 consensus_queue.cc:1048] T 0191cfad4e7a4b088b2ecdc246bfa58a P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:11.044317 7551 leader_election.cc:290] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.045020 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709e969569b43a7aace8d7cfe4e64c5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:11.045212 5239 raft_consensus.cc:2468] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:11.046033 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709e969569b43a7aace8d7cfe4e64c5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:11.046295 5100 raft_consensus.cc:2468] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:11.021725 7098 ts_tablet_manager.cc:1929] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:11.025381 5045 leader_election.cc:304] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters: 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:11.046936 7481 raft_consensus.cc:2804] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:11.047015 7481 raft_consensus.cc:493] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:11.047076 7481 raft_consensus.cc:3060] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.050976 7481 raft_consensus.cc:515] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.052194 7481 leader_election.cc:290] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:11.052327 5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5848740410d74e749ad6c44591ab0d24" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:11.052506 5240 raft_consensus.cc:3060] T 5848740410d74e749ad6c44591ab0d24 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.055426 5240 raft_consensus.cc:2468] T 5848740410d74e749ad6c44591ab0d24 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:50:11.033733 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 4709e969569b43a7aace8d7cfe4e64c5 (table default.Table_927f4195b251436bbe7ecee8e22ac35b [id=11b7ccc28a104e57a243695c47b55a65]). Expected version 1 got 0
I20260927 13:50:11.056684 7098 log.cc:1199] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/d3b38f40431f47a0acf1e11092d7717b
I20260927 13:50:11.057228 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 23e3bb24afad4d789041b6a557512618 (table default.Table_a9dac2f42b2c4641b1d1235ec0f377f2 [id=59df0a1ee3ea43e8ac991b38717c1549]). Expected version 6 got 0
I20260927 13:50:11.057569 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:11.057778 6454 catalog_manager.cc:5938] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291) does not have the latest schema for tablet b1a98e712fb3492f9e4ebccfd489c16f (table default.Table_a2b69d98d4ed4c4f89ec628da9a2bd3f [id=e050655a2d464b36bff5cd05c1ec4228]). Expected version 1 got 0
I20260927 13:50:11.058298 5044 leader_election.cc:304] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:11.058588 7481 raft_consensus.cc:2804] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:11.058923 7481 raft_consensus.cc:697] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 LEADER]: Becoming Leader. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Running, Role: LEADER
I20260927 13:50:11.059293 7481 consensus_queue.cc:237] T 5848740410d74e749ad6c44591ab0d24 P 34fc5fe0a32d42ab83f4aa6d07341409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.061731 7098 ts_tablet_manager.cc:1950] T d3b38f40431f47a0acf1e11092d7717b P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:11.065124 5626 tablet_bootstrap.cc:492] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:11.065335 5626 ts_tablet_manager.cc:1403] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.000s
I20260927 13:50:11.050979 5619 tablet_bootstrap.cc:492] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:11.065932 7618 raft_consensus.cc:493] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.066035 5619 ts_tablet_manager.cc:1403] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.092s user 0.005s sys 0.000s
I20260927 13:50:11.066061 7618 raft_consensus.cc:515] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.066902 7618 leader_election.cc:290] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:11.067425 7111 ts_tablet_manager.cc:1929] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:11.067634 7111 log.cc:1199] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/98e2e305b92a4492a0df14a506c768f3
I20260927 13:50:11.068189 7111 ts_tablet_manager.cc:1950] T 98e2e305b92a4492a0df14a506c768f3 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:11.068475 5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f0b64c0564670842aa582c998c2de" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:11.069435 5619 raft_consensus.cc:359] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.069691 5628 tablet_bootstrap.cc:492] T 2e768c83fae54619ac849dfedd5ec654 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:11.069674 5619 raft_consensus.cc:385] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.069751 5619 raft_consensus.cc:740] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.069898 5628 ts_tablet_manager.cc:1403] T 2e768c83fae54619ac849dfedd5ec654 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260927 13:50:11.069998 5619 consensus_queue.cc:260] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.070575 5619 ts_tablet_manager.cc:1434] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 13:50:11.070961 5619 tablet_bootstrap.cc:492] T 7e3f7ded9d644d749532e0700844bd62 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:11.071318 5626 raft_consensus.cc:359] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:11.071384 5044 leader_election.cc:343] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.071573 5626 raft_consensus.cc:385] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.071749 5626 raft_consensus.cc:740] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.072494 5628 raft_consensus.cc:359] T 2e768c83fae54619ac849dfedd5ec654 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.072710 5628 raft_consensus.cc:385] T 2e768c83fae54619ac849dfedd5ec654 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.072744 5619 tablet_bootstrap.cc:654] T 7e3f7ded9d644d749532e0700844bd62 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.072798 5628 raft_consensus.cc:740] T 2e768c83fae54619ac849dfedd5ec654 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.073066 5628 consensus_queue.cc:260] T 2e768c83fae54619ac849dfedd5ec654 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.073578 5628 ts_tablet_manager.cc:1434] T 2e768c83fae54619ac849dfedd5ec654 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 13:50:11.073858 5628 tablet_bootstrap.cc:492] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:11.075443 5628 tablet_bootstrap.cc:654] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:11.075350 5319 leader_election.cc:343] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 08798185a7c641f98d7dc6a6b1b72e0a
W20260927 13:50:11.077837 5319 consensus_peers.cc:597] T 12dd91ddaeff4f2a9d7a0761c08fc192 P bb28c54312c94d7dafb1c2abf7870735 -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12dd91ddaeff4f2a9d7a0761c08fc192. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:11.078063 5319 leader_election.cc:304] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:11.077737 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 197) took 4560 ms. Trace:
W20260927 13:50:11.078408 5319 leader_election.cc:343] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: e25f5898369f46fba32b7df27b334b28
I20260927 13:50:11.078661 7424 raft_consensus.cc:2804] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:11.078750 7424 raft_consensus.cc:493] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:11.078810 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff6a19af8ae4c84af4a8095eca4115e" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.078827 7424 raft_consensus.cc:3060] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.079645 7618 raft_consensus.cc:493] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.079751 7618 raft_consensus.cc:515] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.080302 7618 leader_election.cc:290] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:11.080504 7190 ts_tablet_manager.cc:1929] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:11.080644 7190 log.cc:1199] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/bbb4f42522e84964aeb19358ee02dfc2
I20260927 13:50:11.081157 7190 ts_tablet_manager.cc:1950] T bbb4f42522e84964aeb19358ee02dfc2 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:11.078619 7098 rpcz_store.cc:276] 0927 13:50:06.516782 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.517393 (+ 611us) service_pool.cc:224] Handling call
0927 13:50:10.964880 (+4447487us) ts_tablet_manager.cc:1151] Deleting tablet d3b38f40431f47a0acf1e11092d7717b
0927 13:50:10.964904 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:10.969534 (+ 4630us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.021654 (+ 52120us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.077235 (+ 55581us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4431436}
I20260927 13:50:11.081920 7424 raft_consensus.cc:515] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.082316 5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a8aca52f8c4566b274d13e6bb13ce5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:11.082465 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 244) took 1778 ms. Trace:
W20260927 13:50:11.082856 5044 leader_election.cc:343] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.083045 7424 leader_election.cc:290] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.083601 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5848740410d74e749ad6c44591ab0d24" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:11.083840 5380 raft_consensus.cc:3060] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.083941 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet d3b38f40431f47a0acf1e11092d7717b (table default.Table_f0c950212bbf448eb0f057c01e482ecf [id=5710bb079d1b4ae69be09bac66ca9dbd]) successfully deleted
I20260927 13:50:11.085496 7098 tablet_replica.cc:333] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:11.087476 7098 raft_consensus.cc:2243] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:11.089474 7098 raft_consensus.cc:2272] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.085613 5626 consensus_queue.cc:260] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.090893 5626 ts_tablet_manager.cc:1434] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260927 13:50:11.091464 5626 tablet_bootstrap.cc:492] T 7e3f7ded9d644d749532e0700844bd62 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:11.092190 5380 raft_consensus.cc:2468] T 5848740410d74e749ad6c44591ab0d24 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34fc5fe0a32d42ab83f4aa6d07341409 in term 1.
I20260927 13:50:11.092877 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f0b64c0564670842aa582c998c2de" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.093226 5626 tablet_bootstrap.cc:654] T 7e3f7ded9d644d749532e0700844bd62 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.094259 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a8aca52f8c4566b274d13e6bb13ce5" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.094801 5294 heartbeater.cc:344] Connected to a master server at 127.4.163.124:37095
I20260927 13:50:11.096554 5235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08798185a7c641f98d7dc6a6b1b72e0a" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:11.096730 5235 raft_consensus.cc:3060] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.090361 7190 rpcz_store.cc:276] 0927 13:50:09.304244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.305207 (+ 963us) service_pool.cc:224] Handling call
0927 13:50:10.986247 (+1681040us) ts_tablet_manager.cc:1151] Deleting tablet bbb4f42522e84964aeb19358ee02dfc2
0927 13:50:10.986259 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.026054 (+ 39795us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.080423 (+ 54369us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.082420 (+ 1997us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1680862}
I20260927 13:50:11.097736 7098 ts_tablet_manager.cc:1916] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.098440 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet bbb4f42522e84964aeb19358ee02dfc2 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]) successfully deleted
I20260927 13:50:11.099000 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 245) took 1787 ms. Trace:
I20260927 13:50:11.099283 7190 rpcz_store.cc:276] 0927 13:50:09.311455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.311501 (+ 46us) service_pool.cc:224] Handling call
0927 13:50:11.098804 (+1787303us) ts_tablet_manager.cc:1151] Deleting tablet 26a8aca52f8c4566b274d13e6bb13ce5
0927 13:50:11.098814 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.098984 (+ 170us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1787134}
W20260927 13:50:11.100304 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 26a8aca52f8c4566b274d13e6bb13ce5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26a8aca52f8c4566b274d13e6bb13ce5 already in progress: creating tablet
I20260927 13:50:11.101456 5628 tablet_bootstrap.cc:492] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:11.101663 5628 ts_tablet_manager.cc:1403] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260927 13:50:11.102372 5628 raft_consensus.cc:359] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.102583 5628 raft_consensus.cc:385] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.102665 5628 raft_consensus.cc:740] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.102941 5628 consensus_queue.cc:260] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.103574 5628 ts_tablet_manager.cc:1434] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:11.103679 5235 raft_consensus.cc:2468] T 08798185a7c641f98d7dc6a6b1b72e0a P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:11.103919 5628 tablet_bootstrap.cc:492] T d237de6ef27c49c4a330c07cb75c103d P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:11.104007 7618 raft_consensus.cc:493] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.104130 7618 raft_consensus.cc:515] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.104738 7618 leader_election.cc:290] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007)
I20260927 13:50:11.105268 5628 tablet_bootstrap.cc:654] T d237de6ef27c49c4a330c07cb75c103d P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.110340 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 179) took 4495 ms. Trace:
W20260927 13:50:11.112443 5045 leader_election.cc:343] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.112562 5045 leader_election.cc:304] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:11.112802 7481 raft_consensus.cc:2749] T 8ff6a19af8ae4c84af4a8095eca4115e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:11.111007 5619 tablet_bootstrap.cc:492] T 7e3f7ded9d644d749532e0700844bd62 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:11.113467 5619 ts_tablet_manager.cc:1403] T 7e3f7ded9d644d749532e0700844bd62 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260927 13:50:11.114620 5619 raft_consensus.cc:359] T 7e3f7ded9d644d749532e0700844bd62 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.115898 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709e969569b43a7aace8d7cfe4e64c5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:11.116060 5100 raft_consensus.cc:3060] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:11.116564 5045 leader_election.cc:343] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.116662 5045 leader_election.cc:304] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:11.116979 7481 raft_consensus.cc:2749] T 445f0b64c0564670842aa582c998c2de P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:11.117653 5045 leader_election.cc:343] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.117758 5045 leader_election.cc:304] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:11.118086 7481 raft_consensus.cc:2749] T 26a8aca52f8c4566b274d13e6bb13ce5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:11.118417 7361 raft_consensus.cc:493] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.118536 7361 raft_consensus.cc:515] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.118738 7190 tablet_replica.cc:333] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:11.118957 7190 raft_consensus.cc:2243] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:11.119110 7361 leader_election.cc:290] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.119136 5100 raft_consensus.cc:2468] T 4709e969569b43a7aace8d7cfe4e64c5 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:11.119261 5235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860598d598dd4373b44075a932c7df52" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:11.119681 7190 raft_consensus.cc:2272] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.119997 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709e969569b43a7aace8d7cfe4e64c5" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
I20260927 13:50:11.119990 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d85213c05c465abda78cc49c70d36f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:11.120128 5243 raft_consensus.cc:3060] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
W20260927 13:50:11.120481 5184 leader_election.cc:343] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: Tablet not RUNNING: STOPPED
W20260927 13:50:11.122735 5044 leader_election.cc:343] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.123729 5628 tablet_bootstrap.cc:492] T d237de6ef27c49c4a330c07cb75c103d P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:11.123996 5628 ts_tablet_manager.cc:1403] T d237de6ef27c49c4a330c07cb75c103d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260927 13:50:11.124765 5243 raft_consensus.cc:2468] T 4709e969569b43a7aace8d7cfe4e64c5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:11.125203 5628 raft_consensus.cc:359] T d237de6ef27c49c4a330c07cb75c103d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.125586 5628 raft_consensus.cc:385] T d237de6ef27c49c4a330c07cb75c103d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.125771 5628 raft_consensus.cc:740] T d237de6ef27c49c4a330c07cb75c103d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.126248 5628 consensus_queue.cc:260] T d237de6ef27c49c4a330c07cb75c103d P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.129400 7190 ts_tablet_manager.cc:1916] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.113051 7111 rpcz_store.cc:276] 0927 13:50:06.614642 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.614684 (+ 42us) service_pool.cc:224] Handling call
0927 13:50:10.932583 (+4317899us) ts_tablet_manager.cc:1151] Deleting tablet 98e2e305b92a4492a0df14a506c768f3
0927 13:50:10.932593 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.021678 (+ 89085us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.067362 (+ 45684us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.110315 (+ 42953us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39457,"tablet-delete.queue_time_us":4317741}
I20260927 13:50:11.123708 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d85213c05c465abda78cc49c70d36f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.130353 5385 raft_consensus.cc:2468] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:11.130841 5185 leader_election.cc:304] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:11.131767 7361 raft_consensus.cc:2804] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:11.131846 7361 raft_consensus.cc:493] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:11.131906 7361 raft_consensus.cc:3060] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.135449 7361 raft_consensus.cc:515] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.136420 5626 tablet_bootstrap.cc:492] T 7e3f7ded9d644d749532e0700844bd62 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:11.136549 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d85213c05c465abda78cc49c70d36f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:11.136667 5626 ts_tablet_manager.cc:1403] T 7e3f7ded9d644d749532e0700844bd62 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.001s
I20260927 13:50:11.136734 5385 raft_consensus.cc:3060] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.137988 5626 raft_consensus.cc:359] T 7e3f7ded9d644d749532e0700844bd62 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.138298 5626 raft_consensus.cc:385] T 7e3f7ded9d644d749532e0700844bd62 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.138377 5626 raft_consensus.cc:740] T 7e3f7ded9d644d749532e0700844bd62 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.138707 5626 consensus_queue.cc:260] T 7e3f7ded9d644d749532e0700844bd62 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.139564 5385 raft_consensus.cc:2468] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:11.140332 5185 leader_election.cc:304] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:11.140555 7265 raft_consensus.cc:2804] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:11.140671 7265 raft_consensus.cc:697] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:11.140892 7265 consensus_queue.cc:237] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.141600 7361 leader_election.cc:290] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.141634 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d85213c05c465abda78cc49c70d36f" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
W20260927 13:50:11.142897 5184 leader_election.cc:343] T 44d85213c05c465abda78cc49c70d36f P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Illegal state: Tablet not RUNNING: STOPPED
I20260927 13:50:11.128566 5628 ts_tablet_manager.cc:1434] T d237de6ef27c49c4a330c07cb75c103d P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 13:50:11.145756 5628 tablet_bootstrap.cc:492] T c99bf2abdfc64f169a3937f3e4499f75 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:11.146698 5626 ts_tablet_manager.cc:1434] T 7e3f7ded9d644d749532e0700844bd62 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20260927 13:50:11.148259 7618 raft_consensus.cc:493] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.148414 7618 raft_consensus.cc:515] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.149029 7618 leader_election.cc:290] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:11.149470 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352e564866a747798ad44218133844ba" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:11.149406 5626 tablet_bootstrap.cc:492] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
W20260927 13:50:11.150071 5044 leader_election.cc:343] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.150707 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 180) took 4535 ms. Trace:
I20260927 13:50:11.150872 7111 rpcz_store.cc:276] 0927 13:50:06.614950 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.614990 (+ 40us) service_pool.cc:224] Handling call
0927 13:50:11.150512 (+4535522us) ts_tablet_manager.cc:1151] Deleting tablet 14f5479761f94ee0b339e125d06a808c
0927 13:50:11.150524 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.150682 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4535368}
I20260927 13:50:11.153546 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 181) took 4538 ms. Trace:
I20260927 13:50:11.153983 7111 rpcz_store.cc:276] 0927 13:50:06.615255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.615296 (+ 41us) service_pool.cc:224] Handling call
0927 13:50:11.153400 (+4538104us) ts_tablet_manager.cc:1151] Deleting tablet 0076228c3f224d1f9d76ccf2dd7064ae
0927 13:50:11.153410 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.153525 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4537939}
I20260927 13:50:11.154502 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 182) took 4538 ms. Trace:
I20260927 13:50:11.154640 7111 rpcz_store.cc:276] 0927 13:50:06.615575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.615616 (+ 41us) service_pool.cc:224] Handling call
0927 13:50:11.154389 (+4538773us) ts_tablet_manager.cc:1151] Deleting tablet 26a8aca52f8c4566b274d13e6bb13ce5
0927 13:50:11.154399 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.154484 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4538631}
I20260927 13:50:11.155025 7111 tablet_replica.cc:333] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:11.155304 7111 raft_consensus.cc:2243] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:11.155545 7111 raft_consensus.cc:2272] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.153878 5619 raft_consensus.cc:385] T 7e3f7ded9d644d749532e0700844bd62 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.155840 5619 raft_consensus.cc:740] T 7e3f7ded9d644d749532e0700844bd62 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.156142 5619 consensus_queue.cc:260] T 7e3f7ded9d644d749532e0700844bd62 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.161270 5628 tablet_bootstrap.cc:654] T c99bf2abdfc64f169a3937f3e4499f75 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.163286 7111 ts_tablet_manager.cc:1916] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.166294 5619 ts_tablet_manager.cc:1434] T 7e3f7ded9d644d749532e0700844bd62 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.052s user 0.002s sys 0.000s
I20260927 13:50:11.166631 5619 tablet_bootstrap.cc:492] T d897f986d26a44f4894e147a74a90949 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:11.169569 5626 tablet_bootstrap.cc:654] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
W20260927 13:50:11.129985 5319 leader_election.cc:343] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Not found: Tablet not found: e25f5898369f46fba32b7df27b334b28
I20260927 13:50:11.170189 5319 leader_election.cc:304] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a
I20260927 13:50:11.170574 7424 raft_consensus.cc:2749] T e25f5898369f46fba32b7df27b334b28 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:11.170900 5319 leader_election.cc:304] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:11.171202 7424 raft_consensus.cc:2804] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:11.171331 7424 raft_consensus.cc:697] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:11.171593 7424 consensus_queue.cc:237] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.172259 7190 ts_tablet_manager.cc:1929] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260927 13:50:11.172997 5319 leader_election.cc:304] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters:
I20260927 13:50:11.173182 7190 log.cc:1199] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/5a3f40a2da8649e0898c0e09b6e14a61
I20260927 13:50:11.174279 7765 raft_consensus.cc:2804] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:11.174419 7765 raft_consensus.cc:697] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:11.174661 7765 consensus_queue.cc:237] T 4709e969569b43a7aace8d7cfe4e64c5 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.175805 7618 raft_consensus.cc:493] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.175942 7618 raft_consensus.cc:515] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.175741 7190 ts_tablet_manager.cc:1950] T 5a3f40a2da8649e0898c0e09b6e14a61 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:11.176559 7618 leader_election.cc:290] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:11.177306 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57b60cbc1ca462789fd8e7a235f7119" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:11.177911 5044 leader_election.cc:343] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.178633 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 247) took 1866 ms. Trace:
I20260927 13:50:11.179373 7190 rpcz_store.cc:276] 0927 13:50:09.312187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.312247 (+ 60us) service_pool.cc:224] Handling call
0927 13:50:11.100673 (+1788426us) ts_tablet_manager.cc:1151] Deleting tablet 5a3f40a2da8649e0898c0e09b6e14a61
0927 13:50:11.118607 (+ 17934us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.132863 (+ 14256us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.171757 (+ 38894us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.178441 (+ 6684us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1788279}
I20260927 13:50:11.181375 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 5a3f40a2da8649e0898c0e09b6e14a61 (table default.Table_e5be80b901124d33921a36b696b7fc26 [id=cf68b449acf14948a708664840631845]) successfully deleted
I20260927 13:50:11.183382 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 249) took 1869 ms. Trace:
I20260927 13:50:11.184128 7190 rpcz_store.cc:276] 0927 13:50:09.313754 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.313824 (+ 70us) service_pool.cc:224] Handling call
0927 13:50:11.182768 (+1868944us) ts_tablet_manager.cc:1151] Deleting tablet 081f18e00af74e5c811f774d29422351
0927 13:50:11.182784 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.183362 (+ 578us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1868638}
I20260927 13:50:11.199643 7098 ts_tablet_manager.cc:1929] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:11.199883 7098 log.cc:1199] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/44d85213c05c465abda78cc49c70d36f
I20260927 13:50:11.200363 7098 ts_tablet_manager.cc:1950] T 44d85213c05c465abda78cc49c70d36f P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:11.201182 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 199) took 4684 ms. Trace:
I20260927 13:50:11.202457 7098 rpcz_store.cc:276] 0927 13:50:06.516974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.517542 (+ 568us) service_pool.cc:224] Handling call
0927 13:50:11.084993 (+4567451us) ts_tablet_manager.cc:1151] Deleting tablet 44d85213c05c465abda78cc49c70d36f
0927 13:50:11.085005 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.160488 (+ 75483us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.199560 (+ 39072us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.201160 (+ 1600us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4567107}
I20260927 13:50:11.202078 5628 tablet_bootstrap.cc:492] T c99bf2abdfc64f169a3937f3e4499f75 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:11.203316 5628 ts_tablet_manager.cc:1403] T c99bf2abdfc64f169a3937f3e4499f75 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.058s user 0.005s sys 0.001s
W20260927 13:50:11.203585 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 081f18e00af74e5c811f774d29422351 because the tablet was not found. No further retry: Not found: Tablet not found: 081f18e00af74e5c811f774d29422351
I20260927 13:50:11.203874 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 44d85213c05c465abda78cc49c70d36f (table default.Table_4155d438fc7c4d6cbe87e16451c6bbba [id=2d2e2254587f4832b7ad918724eeea64]) successfully deleted
I20260927 13:50:11.204464 7190 tablet_replica.cc:333] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:11.204419 5628 raft_consensus.cc:359] T c99bf2abdfc64f169a3937f3e4499f75 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.204721 5628 raft_consensus.cc:385] T c99bf2abdfc64f169a3937f3e4499f75 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.204813 5628 raft_consensus.cc:740] T c99bf2abdfc64f169a3937f3e4499f75 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.205071 7190 raft_consensus.cc:2243] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:11.205072 5628 consensus_queue.cc:260] T c99bf2abdfc64f169a3937f3e4499f75 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.205754 7190 raft_consensus.cc:2272] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.205780 5628 ts_tablet_manager.cc:1434] T c99bf2abdfc64f169a3937f3e4499f75 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 13:50:11.206188 5628 tablet_bootstrap.cc:492] T 9cb1d6091729498698924e6857ebfd6c P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:11.207276 7190 ts_tablet_manager.cc:1916] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.208312 5628 tablet_bootstrap.cc:654] T 9cb1d6091729498698924e6857ebfd6c P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.215018 7098 tablet_replica.cc:333] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:11.214994 7111 ts_tablet_manager.cc:1929] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:11.215593 7098 raft_consensus.cc:2243] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:11.215554 7111 log.cc:1199] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/44d85213c05c465abda78cc49c70d36f
I20260927 13:50:11.216396 7098 raft_consensus.cc:2272] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.217344 7098 ts_tablet_manager.cc:1916] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.219895 7111 ts_tablet_manager.cc:1950] T 44d85213c05c465abda78cc49c70d36f P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:11.220899 5626 tablet_bootstrap.cc:492] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:11.221108 5626 ts_tablet_manager.cc:1403] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.072s user 0.000s sys 0.009s
I20260927 13:50:11.221980 5626 raft_consensus.cc:359] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.229111 5626 raft_consensus.cc:385] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.229339 5626 raft_consensus.cc:740] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.229831 5626 consensus_queue.cc:260] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.230734 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 98e2e305b92a4492a0df14a506c768f3 (table default.Table_97f900bc6c8b4b829da15d428de9e4ed [id=6790f313d1d64f38a77d52eebd7ca586]) successfully deleted
I20260927 13:50:11.230976 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 183) took 4615 ms. Trace:
I20260927 13:50:11.231091 7111 rpcz_store.cc:276] 0927 13:50:06.615873 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.615912 (+ 39us) service_pool.cc:224] Handling call
0927 13:50:11.154976 (+4539064us) ts_tablet_manager.cc:1151] Deleting tablet 44d85213c05c465abda78cc49c70d36f
0927 13:50:11.154988 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.172935 (+ 17947us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.214703 (+ 41768us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.230947 (+ 16244us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4538924}
W20260927 13:50:11.231364 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 14f5479761f94ee0b339e125d06a808c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14f5479761f94ee0b339e125d06a808c already in progress: creating tablet
I20260927 13:50:11.231475 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 184) took 4615 ms. Trace:
I20260927 13:50:11.231545 7111 rpcz_store.cc:276] 0927 13:50:06.616159 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.616200 (+ 41us) service_pool.cc:224] Handling call
0927 13:50:11.231380 (+4615180us) ts_tablet_manager.cc:1151] Deleting tablet 60de1c28618f4e478aae68ad07fbcf98
0927 13:50:11.231391 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.231459 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4615025}
W20260927 13:50:11.231971 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 0076228c3f224d1f9d76ccf2dd7064ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0076228c3f224d1f9d76ccf2dd7064ae already in progress: creating tablet
I20260927 13:50:11.232336 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 185) took 4615 ms. Trace:
I20260927 13:50:11.232419 7111 rpcz_store.cc:276] 0927 13:50:06.616634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.616681 (+ 47us) service_pool.cc:224] Handling call
0927 13:50:11.231750 (+4615069us) ts_tablet_manager.cc:1151] Deleting tablet cf1a58c67bf54493a3c62fb175acabb8
0927 13:50:11.231758 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.232317 (+ 559us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4614901}
W20260927 13:50:11.232774 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 26a8aca52f8c4566b274d13e6bb13ce5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26a8aca52f8c4566b274d13e6bb13ce5 already in progress: creating tablet
I20260927 13:50:11.234364 5626 ts_tablet_manager.cc:1434] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260927 13:50:11.234681 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 186) took 4617 ms. Trace:
I20260927 13:50:11.234755 7111 rpcz_store.cc:276] 0927 13:50:06.616986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.617029 (+ 43us) service_pool.cc:224] Handling call
0927 13:50:11.232615 (+4615586us) ts_tablet_manager.cc:1151] Deleting tablet d9cb99ad45d1445cb2e2854319a3d73d
0927 13:50:11.232763 (+ 148us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.234665 (+ 1902us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4615420}
I20260927 13:50:11.235091 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 187) took 4608 ms. Trace:
I20260927 13:50:11.235155 7111 rpcz_store.cc:276] 0927 13:50:06.626994 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.627037 (+ 43us) service_pool.cc:224] Handling call
0927 13:50:11.234960 (+4607923us) ts_tablet_manager.cc:1151] Deleting tablet a003afa0fbb74d548cfaba51ea6cef58
0927 13:50:11.234976 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.235076 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4607770}
W20260927 13:50:11.237774 5319 leader_election.cc:343] T 08798185a7c641f98d7dc6a6b1b72e0a P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 08798185a7c641f98d7dc6a6b1b72e0a
I20260927 13:50:11.238318 5626 tablet_bootstrap.cc:492] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:11.240165 7265 raft_consensus.cc:493] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.240337 7265 raft_consensus.cc:515] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.240967 5626 tablet_bootstrap.cc:654] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.240953 5432 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:11.241077 7265 leader_election.cc:290] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.242084 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:11.242326 5100 raft_consensus.cc:2468] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:11.242709 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 188) took 4615 ms. Trace:
I20260927 13:50:11.242837 5184 leader_election.cc:304] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:11.242795 7111 rpcz_store.cc:276] 0927 13:50:06.627372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.627416 (+ 44us) service_pool.cc:224] Handling call
0927 13:50:11.235340 (+4607924us) ts_tablet_manager.cc:1151] Deleting tablet c99bf2abdfc64f169a3937f3e4499f75
0927 13:50:11.235347 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.242690 (+ 7343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4607778}
I20260927 13:50:11.243294 7265 raft_consensus.cc:2804] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260927 13:50:11.243394 7265 raft_consensus.cc:493] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:11.243471 7265 raft_consensus.cc:3060] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:50:11.237946 7190 ts_tablet_manager.cc:1929] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:11.246433 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 189) took 4618 ms. Trace:
I20260927 13:50:11.246577 7190 log.cc:1199] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/b0827a26334c42728545a9eaa006fae0
I20260927 13:50:11.246529 7111 rpcz_store.cc:276] 0927 13:50:06.628479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.628524 (+ 45us) service_pool.cc:224] Handling call
0927 13:50:11.243545 (+4615021us) ts_tablet_manager.cc:1151] Deleting tablet f04b3a942c404f3894fbbd6ece24a727
0927 13:50:11.243558 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.246412 (+ 2854us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4614361}
I20260927 13:50:11.246978 7265 raft_consensus.cc:515] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.247038 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.247192 5380 raft_consensus.cc:2468] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:11.247249 7190 ts_tablet_manager.cc:1950] T b0827a26334c42728545a9eaa006fae0 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:11.248134 7265 leader_election.cc:290] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.248440 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 190) took 4619 ms. Trace:
I20260927 13:50:11.248425 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:11.248510 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3add644bb1f544e1b3c91fecfd6a541b" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:11.248649 5380 raft_consensus.cc:3060] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:50:11.248641 7111 rpcz_store.cc:276] 0927 13:50:06.628989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.629034 (+ 45us) service_pool.cc:224] Handling call
0927 13:50:11.246775 (+4617741us) ts_tablet_manager.cc:1151] Deleting tablet 39fa23553c554826ad811ebe2e978ef9
0927 13:50:11.246785 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.248424 (+ 1639us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4617545}
I20260927 13:50:11.248780 5100 raft_consensus.cc:3060] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Advancing to term 2
I20260927 13:50:11.253111 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 191) took 4623 ms. Trace:
I20260927 13:50:11.253206 7111 rpcz_store.cc:276] 0927 13:50:06.629661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.629706 (+ 45us) service_pool.cc:224] Handling call
0927 13:50:11.248909 (+4619203us) ts_tablet_manager.cc:1151] Deleting tablet 45096e907a9c44b7ace81357cdd575d4
0927 13:50:11.248919 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.253093 (+ 4174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4618985}
I20260927 13:50:11.253526 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 192) took 4619 ms. Trace:
I20260927 13:50:11.253593 7111 rpcz_store.cc:276] 0927 13:50:06.634050 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.634099 (+ 49us) service_pool.cc:224] Handling call
0927 13:50:11.253434 (+4619335us) ts_tablet_manager.cc:1151] Deleting tablet b0d6a3af321049b099e72dbfeb6b7a24
0927 13:50:11.253443 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.253514 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4619090}
I20260927 13:50:11.253858 7111 tablet_replica.cc:333] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:11.253826 5100 raft_consensus.cc:2468] T 3add644bb1f544e1b3c91fecfd6a541b P 34fc5fe0a32d42ab83f4aa6d07341409 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 2.
I20260927 13:50:11.253983 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 248) took 1940 ms. Trace:
I20260927 13:50:11.254036 7111 raft_consensus.cc:2243] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:11.254086 7190 rpcz_store.cc:276] 0927 13:50:09.313643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.314098 (+ 455us) service_pool.cc:224] Handling call
0927 13:50:11.204408 (+1890310us) ts_tablet_manager.cc:1151] Deleting tablet b0827a26334c42728545a9eaa006fae0
0927 13:50:11.204420 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.218500 (+ 14080us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.237863 (+ 19363us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.253930 (+ 16067us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1890153}
I20260927 13:50:11.254227 7111 raft_consensus.cc:2272] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.254295 5184 leader_election.cc:304] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:11.254556 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 250) took 1854 ms. Trace:
I20260927 13:50:11.254813 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet b0827a26334c42728545a9eaa006fae0 (table default.Table_cb2cdf43d4eb4fc1b302363907f746a2 [id=a2e5f425d1494b40a9b253e6b2d4c86d]) successfully deleted
I20260927 13:50:11.255661 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860598d598dd4373b44075a932c7df52" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.256102 5380 raft_consensus.cc:2468] T 3add644bb1f544e1b3c91fecfd6a541b P bb28c54312c94d7dafb1c2abf7870735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 2.
I20260927 13:50:11.256744 7111 ts_tablet_manager.cc:1916] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.255143 7370 raft_consensus.cc:2804] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 2 FOLLOWER]: Leader election won for term 2
I20260927 13:50:11.261539 7370 raft_consensus.cc:697] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [term 2 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:11.261865 7370 consensus_queue.cc:237] T 3add644bb1f544e1b3c91fecfd6a541b P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.257810 7265 raft_consensus.cc:493] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.263487 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352e564866a747798ad44218133844ba" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.263636 7265 raft_consensus.cc:515] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.264241 7265 leader_election.cc:290] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.266412 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85130d7ea68545518ca3c255e28a20d3" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:11.266654 5100 raft_consensus.cc:2393] T 85130d7ea68545518ca3c255e28a20d3 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:11.266883 5628 tablet_bootstrap.cc:492] T 9cb1d6091729498698924e6857ebfd6c P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:11.267019 5628 ts_tablet_manager.cc:1403] T 9cb1d6091729498698924e6857ebfd6c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.000s
I20260927 13:50:11.267657 5628 raft_consensus.cc:359] T 9cb1d6091729498698924e6857ebfd6c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.267802 5619 tablet_bootstrap.cc:654] T d897f986d26a44f4894e147a74a90949 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.267864 5628 raft_consensus.cc:385] T 9cb1d6091729498698924e6857ebfd6c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.267915 5628 raft_consensus.cc:740] T 9cb1d6091729498698924e6857ebfd6c P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.268110 5628 consensus_queue.cc:260] T 9cb1d6091729498698924e6857ebfd6c P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.268754 5628 ts_tablet_manager.cc:1434] T 9cb1d6091729498698924e6857ebfd6c P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:11.269098 5628 tablet_bootstrap.cc:492] T ab12ebc5fdcb44948ec5f53f26c18f20 P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
I20260927 13:50:11.271608 7190 rpcz_store.cc:276] 0927 13:50:09.399836 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.399897 (+ 61us) service_pool.cc:224] Handling call
0927 13:50:11.254363 (+1854466us) ts_tablet_manager.cc:1151] Deleting tablet d3149f6bbaf043f08970e19fd66c4e2a
0927 13:50:11.254374 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.254517 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1854296}
I20260927 13:50:11.272221 5626 tablet_bootstrap.cc:492] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
W20260927 13:50:11.272469 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet d3149f6bbaf043f08970e19fd66c4e2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3149f6bbaf043f08970e19fd66c4e2a already in progress: creating tablet
I20260927 13:50:11.272565 5626 ts_tablet_manager.cc:1403] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.001s
I20260927 13:50:11.274734 7361 consensus_queue.cc:1048] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:11.274709 5626 raft_consensus.cc:359] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.275054 5626 raft_consensus.cc:385] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.275238 5626 raft_consensus.cc:740] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.275677 5626 consensus_queue.cc:260] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.276243 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85130d7ea68545518ca3c255e28a20d3" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.276785 5185 leader_election.cc:304] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:11.277204 7361 raft_consensus.cc:3060] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.280037 7361 raft_consensus.cc:2749] T 85130d7ea68545518ca3c255e28a20d3 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:11.284701 7190 tablet_replica.cc:333] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:11.284998 7190 raft_consensus.cc:2243] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:11.285210 7190 raft_consensus.cc:2272] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.286893 7190 ts_tablet_manager.cc:1916] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.292641 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 44d85213c05c465abda78cc49c70d36f (table default.Table_4155d438fc7c4d6cbe87e16451c6bbba [id=2d2e2254587f4832b7ad918724eeea64]) successfully deleted
W20260927 13:50:11.292980 6429 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 60de1c28618f4e478aae68ad07fbcf98 because the tablet was not found. No further retry: Not found: Tablet not found: 60de1c28618f4e478aae68ad07fbcf98
W20260927 13:50:11.293233 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet cf1a58c67bf54493a3c62fb175acabb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf1a58c67bf54493a3c62fb175acabb8 already in progress: creating tablet
W20260927 13:50:11.293536 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a003afa0fbb74d548cfaba51ea6cef58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a003afa0fbb74d548cfaba51ea6cef58 already in progress: creating tablet
W20260927 13:50:11.294167 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet c99bf2abdfc64f169a3937f3e4499f75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c99bf2abdfc64f169a3937f3e4499f75 already in progress: creating tablet
W20260927 13:50:11.294418 6429 catalog_manager.cc:5030] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet f04b3a942c404f3894fbbd6ece24a727 because the tablet was not found. No further retry: Not found: Tablet not found: f04b3a942c404f3894fbbd6ece24a727
W20260927 13:50:11.294636 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 39fa23553c554826ad811ebe2e978ef9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39fa23553c554826ad811ebe2e978ef9 already in progress: creating tablet
W20260927 13:50:11.294849 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 45096e907a9c44b7ace81357cdd575d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45096e907a9c44b7ace81357cdd575d4 already in progress: creating tablet
W20260927 13:50:11.295060 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b0d6a3af321049b099e72dbfeb6b7a24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0d6a3af321049b099e72dbfeb6b7a24 already in progress: creating tablet
I20260927 13:50:11.296674 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57b60cbc1ca462789fd8e7a235f7119" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.299736 5628 tablet_bootstrap.cc:654] T ab12ebc5fdcb44948ec5f53f26c18f20 P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.299961 7111 ts_tablet_manager.cc:1929] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:11.300071 7111 log.cc:1199] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/a0e14fd01a9141cdb2df030ee0dd05db
I20260927 13:50:11.283749 7098 ts_tablet_manager.cc:1929] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 13:50:11.294950 5045 leader_election.cc:343] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.300577 5045 leader_election.cc:304] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:11.301002 7618 raft_consensus.cc:2749] T 860598d598dd4373b44075a932c7df52 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 13:50:11.301090 5045 leader_election.cc:343] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.301188 5045 leader_election.cc:304] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:11.301366 7481 raft_consensus.cc:2749] T 352e564866a747798ad44218133844ba P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:11.301644 7098 log.cc:1199] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/8ed33e78ee5448bcae633cc874c3e171
I20260927 13:50:11.301936 7098 ts_tablet_manager.cc:1950] T 8ed33e78ee5448bcae633cc874c3e171 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:11.302628 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 200) took 4752 ms. Trace:
I20260927 13:50:11.302850 7098 rpcz_store.cc:276] 0927 13:50:06.549882 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.550206 (+ 324us) service_pool.cc:224] Handling call
0927 13:50:11.207245 (+4657039us) ts_tablet_manager.cc:1151] Deleting tablet 8ed33e78ee5448bcae633cc874c3e171
0927 13:50:11.214971 (+ 7726us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.242477 (+ 27506us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.283677 (+ 41200us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.302611 (+ 18934us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4656865}
I20260927 13:50:11.303457 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 201) took 4744 ms. Trace:
I20260927 13:50:11.303521 7098 rpcz_store.cc:276] 0927 13:50:06.559105 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.559154 (+ 49us) service_pool.cc:224] Handling call
0927 13:50:11.303353 (+4744199us) ts_tablet_manager.cc:1151] Deleting tablet e1e574bc8b544039b440a845966eb1d4
0927 13:50:11.303363 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.303444 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4744020}
I20260927 13:50:11.303905 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 202) took 4740 ms. Trace:
I20260927 13:50:11.303974 7098 rpcz_store.cc:276] 0927 13:50:06.563023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.563074 (+ 51us) service_pool.cc:224] Handling call
0927 13:50:11.303837 (+4740763us) ts_tablet_manager.cc:1151] Deleting tablet 9f467925221b4cfdafeaa459b5c5adc0
0927 13:50:11.303845 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.303892 (+ 47us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4740605}
I20260927 13:50:11.304369 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 209) took 4704 ms. Trace:
I20260927 13:50:11.304435 7098 rpcz_store.cc:276] 0927 13:50:06.600394 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.606180 (+ 5786us) service_pool.cc:224] Handling call
0927 13:50:11.304279 (+4698099us) ts_tablet_manager.cc:1151] Deleting tablet d51c3fa3624340059f6508ced1a2220e
0927 13:50:11.304288 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.304354 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4697895}
I20260927 13:50:11.304803 7098 tablet_replica.cc:333] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409: stopping tablet replica
I20260927 13:50:11.304994 7098 raft_consensus.cc:2243] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:11.305145 7098 raft_consensus.cc:2272] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.305658 7098 ts_tablet_manager.cc:1916] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 13:50:11.307960 5045 leader_election.cc:343] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.308070 5045 leader_election.cc:304] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:11.308284 7481 raft_consensus.cc:2749] T c57b60cbc1ca462789fd8e7a235f7119 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:11.309062 7111 ts_tablet_manager.cc:1950] T a0e14fd01a9141cdb2df030ee0dd05db P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:11.310338 6428 catalog_manager.cc:5063] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): tablet 8ed33e78ee5448bcae633cc874c3e171 (table default.Table_f8cf2e1f9d84401897db63d0a884c6b1 [id=1828e2f519ae4cbc810509b126d740e7]) successfully deleted
W20260927 13:50:11.310657 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet e1e574bc8b544039b440a845966eb1d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1e574bc8b544039b440a845966eb1d4 already in progress: creating tablet
W20260927 13:50:11.310894 6428 catalog_manager.cc:5030] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet 9f467925221b4cfdafeaa459b5c5adc0 because the tablet was not found. No further retry: Not found: Tablet not found: 9f467925221b4cfdafeaa459b5c5adc0
W20260927 13:50:11.311095 6428 catalog_manager.cc:5043] TS 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): delete failed for tablet d51c3fa3624340059f6508ced1a2220e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d51c3fa3624340059f6508ced1a2220e already in progress: creating tablet
I20260927 13:50:11.313910 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 193) took 4679 ms. Trace:
I20260927 13:50:11.316278 5157 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:11.322875 7111 rpcz_store.cc:276] 0927 13:50:06.634478 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.634516 (+ 38us) service_pool.cc:224] Handling call
0927 13:50:11.253817 (+4619301us) ts_tablet_manager.cc:1151] Deleting tablet a0e14fd01a9141cdb2df030ee0dd05db
0927 13:50:11.253825 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.265109 (+ 11284us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.299899 (+ 34790us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.313884 (+ 13985us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4619114}
I20260927 13:50:11.323848 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet a0e14fd01a9141cdb2df030ee0dd05db (table default.Table_8442b904c41d4d39a56497c27763e7f4 [id=6bf215680ef94518ae98737c9e63301d]) successfully deleted
I20260927 13:50:11.331041 5619 tablet_bootstrap.cc:492] T d897f986d26a44f4894e147a74a90949 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:11.331300 5619 ts_tablet_manager.cc:1403] T d897f986d26a44f4894e147a74a90949 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.165s user 0.007s sys 0.000s
I20260927 13:50:11.332315 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 195) took 4695 ms. Trace:
I20260927 13:50:11.332477 7111 rpcz_store.cc:276] 0927 13:50:06.636738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.636787 (+ 49us) service_pool.cc:224] Handling call
0927 13:50:11.323596 (+4686809us) ts_tablet_manager.cc:1151] Deleting tablet 284f6113fa4b443a869bce6d0c15f273
0927 13:50:11.332061 (+ 8465us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.332180 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4679481}
I20260927 13:50:11.332984 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 196) took 4695 ms. Trace:
I20260927 13:50:11.333319 7111 rpcz_store.cc:276] 0927 13:50:06.637032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.637078 (+ 46us) service_pool.cc:224] Handling call
0927 13:50:11.332829 (+4695751us) ts_tablet_manager.cc:1151] Deleting tablet 370553521753488ab81e40144f2536ae
0927 13:50:11.332838 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.332934 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4688651}
W20260927 13:50:11.333392 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 284f6113fa4b443a869bce6d0c15f273 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 284f6113fa4b443a869bce6d0c15f273 already in progress: creating tablet
I20260927 13:50:11.333791 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 197) took 4696 ms. Trace:
W20260927 13:50:11.334161 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 370553521753488ab81e40144f2536ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 370553521753488ab81e40144f2536ae already in progress: creating tablet
I20260927 13:50:11.334067 7111 rpcz_store.cc:276] 0927 13:50:06.637315 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.637358 (+ 43us) service_pool.cc:224] Handling call
0927 13:50:11.333650 (+4696292us) ts_tablet_manager.cc:1151] Deleting tablet 9cb1d6091729498698924e6857ebfd6c
0927 13:50:11.333657 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.333741 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4689428}
I20260927 13:50:11.334463 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 198) took 4696 ms. Trace:
I20260927 13:50:11.334699 7111 rpcz_store.cc:276] 0927 13:50:06.637567 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.637610 (+ 43us) service_pool.cc:224] Handling call
0927 13:50:11.334324 (+4696714us) ts_tablet_manager.cc:1151] Deleting tablet d0a737bef14b4874b61a109305ebb993
0927 13:50:11.334334 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.334414 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4690024}
I20260927 13:50:11.335096 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 199) took 4697 ms. Trace:
I20260927 13:50:11.335388 7111 rpcz_store.cc:276] 0927 13:50:06.637823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.637869 (+ 46us) service_pool.cc:224] Handling call
0927 13:50:11.334972 (+4697103us) ts_tablet_manager.cc:1151] Deleting tablet ecb5cdc007074e0c8f44d963e527a955
0927 13:50:11.334980 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.335050 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4690625}
I20260927 13:50:11.336349 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 194) took 4699 ms. Trace:
I20260927 13:50:11.336669 7111 rpcz_store.cc:276] 0927 13:50:06.636475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.636519 (+ 44us) service_pool.cc:224] Handling call
0927 13:50:11.335782 (+4699263us) ts_tablet_manager.cc:1151] Deleting tablet b9a1193719e140beb9b492927adeb78c
0927 13:50:11.335790 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.336306 (+ 516us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4691396}
W20260927 13:50:11.338398 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 9cb1d6091729498698924e6857ebfd6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb1d6091729498698924e6857ebfd6c already in progress: creating tablet
W20260927 13:50:11.338636 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet d0a737bef14b4874b61a109305ebb993 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0a737bef14b4874b61a109305ebb993 already in progress: creating tablet
W20260927 13:50:11.338873 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet ecb5cdc007074e0c8f44d963e527a955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecb5cdc007074e0c8f44d963e527a955 already in progress: creating tablet
I20260927 13:50:11.340075 5296 heartbeater.cc:499] Master 127.4.163.125:42239 was elected leader, sending a full tablet report...
I20260927 13:50:11.341074 7111 tablet_replica.cc:333] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
W20260927 13:50:11.341378 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet b9a1193719e140beb9b492927adeb78c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a1193719e140beb9b492927adeb78c already in progress: creating tablet
I20260927 13:50:11.341490 7111 raft_consensus.cc:2243] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:11.341887 7551 raft_consensus.cc:493] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.342062 7551 raft_consensus.cc:515] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.342836 7551 leader_election.cc:290] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.343113 7111 raft_consensus.cc:2272] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.344147 7111 ts_tablet_manager.cc:1916] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.346503 5619 raft_consensus.cc:359] T d897f986d26a44f4894e147a74a90949 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.346782 5619 raft_consensus.cc:385] T d897f986d26a44f4894e147a74a90949 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.346992 5619 raft_consensus.cc:740] T d897f986d26a44f4894e147a74a90949 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.347496 5619 consensus_queue.cc:260] T d897f986d26a44f4894e147a74a90949 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.348632 5619 ts_tablet_manager.cc:1434] T d897f986d26a44f4894e147a74a90949 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260927 13:50:11.349181 5619 tablet_bootstrap.cc:492] T cf1a58c67bf54493a3c62fb175acabb8 P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:11.352129 5619 tablet_bootstrap.cc:654] T cf1a58c67bf54493a3c62fb175acabb8 P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.356173 7481 raft_consensus.cc:493] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.356325 7481 raft_consensus.cc:515] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.356949 7481 leader_election.cc:290] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:11.356979 7111 ts_tablet_manager.cc:1929] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:11.362254 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d64750141d74d988612304ce050688d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.364816 7111 log.cc:1199] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/496cffc2a8774185a0e0f63208bed8a5
W20260927 13:50:11.363940 5319 leader_election.cc:343] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 71268fb7aa9646639ea41dc8ccebfc5c
I20260927 13:50:11.365270 7111 ts_tablet_manager.cc:1950] T 496cffc2a8774185a0e0f63208bed8a5 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:11.357858 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d64750141d74d988612304ce050688d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:11.366694 5044 leader_election.cc:343] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.366955 7190 ts_tablet_manager.cc:1929] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:11.366983 7265 consensus_queue.cc:1048] T 44d29459405b4cdd921fb43bf5a2ae81 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260927 13:50:11.367077 7190 log.cc:1199] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/76a397300cdd44eb899f2ef5b9fe8c09
W20260927 13:50:11.367049 5045 leader_election.cc:343] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.367139 5045 leader_election.cc:304] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:11.367786 7190 ts_tablet_manager.cc:1950] T 76a397300cdd44eb899f2ef5b9fe8c09 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:11.367990 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71268fb7aa9646639ea41dc8ccebfc5c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
I20260927 13:50:11.368072 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 251) took 1968 ms. Trace:
I20260927 13:50:11.368141 7190 rpcz_store.cc:276] 0927 13:50:09.399985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.400102 (+ 117us) service_pool.cc:224] Handling call
0927 13:50:11.272885 (+1872783us) ts_tablet_manager.cc:1151] Deleting tablet 76a397300cdd44eb899f2ef5b9fe8c09
0927 13:50:11.284620 (+ 11735us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.332154 (+ 47534us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.366631 (+ 34477us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.368057 (+ 1426us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1872649}
I20260927 13:50:11.368537 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 252) took 1956 ms. Trace:
I20260927 13:50:11.368362 7370 consensus_queue.cc:1048] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260927 13:50:11.368798 7481 raft_consensus.cc:2749] T 2d64750141d74d988612304ce050688d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:11.369077 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 76a397300cdd44eb899f2ef5b9fe8c09 (table default.Table_aaa8c970b9124f9abcdb193f7539d309 [id=5308278b9daf4308a52aede42b353b64]) successfully deleted
I20260927 13:50:11.368620 7190 rpcz_store.cc:276] 0927 13:50:09.411926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.412153 (+ 227us) service_pool.cc:224] Handling call
0927 13:50:11.368428 (+1956275us) ts_tablet_manager.cc:1151] Deleting tablet d51c3fa3624340059f6508ced1a2220e
0927 13:50:11.368436 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.368524 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1956061}
I20260927 13:50:11.369570 7190 tablet_replica.cc:333] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
W20260927 13:50:11.369916 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet d51c3fa3624340059f6508ced1a2220e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d51c3fa3624340059f6508ced1a2220e already in progress: creating tablet
I20260927 13:50:11.374055 7481 raft_consensus.cc:493] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.374155 7190 raft_consensus.cc:2243] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:11.374210 7481 raft_consensus.cc:515] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.374557 7190 raft_consensus.cc:2272] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.374768 7481 leader_election.cc:290] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:11.375211 7190 ts_tablet_manager.cc:1916] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.375468 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fa23553c554826ad811ebe2e978ef9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:11.375876 5044 leader_election.cc:343] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.376814 5628 tablet_bootstrap.cc:492] T ab12ebc5fdcb44948ec5f53f26c18f20 P 34fc5fe0a32d42ab83f4aa6d07341409: No bootstrap required, opened a new log
I20260927 13:50:11.376929 5628 ts_tablet_manager.cc:1403] T ab12ebc5fdcb44948ec5f53f26c18f20 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent bootstrapping tablet: real 0.108s user 0.001s sys 0.001s
I20260927 13:50:11.377048 5234 raft_consensus.cc:2468] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:11.378759 5628 raft_consensus.cc:359] T ab12ebc5fdcb44948ec5f53f26c18f20 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.379669 5626 ts_tablet_manager.cc:1434] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.107s user 0.016s sys 0.000s
I20260927 13:50:11.380509 5383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fa23553c554826ad811ebe2e978ef9" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.382133 7190 ts_tablet_manager.cc:1929] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:11.382282 7190 log.cc:1199] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/8e8bf79954c2429f886ac7afc9a8455f
I20260927 13:50:11.382740 7190 ts_tablet_manager.cc:1950] T 8e8bf79954c2429f886ac7afc9a8455f P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:11.382727 5628 raft_consensus.cc:385] T ab12ebc5fdcb44948ec5f53f26c18f20 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.382800 5628 raft_consensus.cc:740] T ab12ebc5fdcb44948ec5f53f26c18f20 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fc5fe0a32d42ab83f4aa6d07341409, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.383217 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 253) took 1971 ms. Trace:
I20260927 13:50:11.383319 7190 rpcz_store.cc:276] 0927 13:50:09.412197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.412418 (+ 221us) service_pool.cc:224] Handling call
0927 13:50:11.369528 (+1957110us) ts_tablet_manager.cc:1151] Deleting tablet 8e8bf79954c2429f886ac7afc9a8455f
0927 13:50:11.369537 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.378962 (+ 9425us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.382072 (+ 3110us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.383198 (+ 1126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4317,"tablet-delete.queue_time_us":1956963}
I20260927 13:50:11.382300 5626 tablet_bootstrap.cc:492] T d897f986d26a44f4894e147a74a90949 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:11.384908 5626 tablet_bootstrap.cc:654] T d897f986d26a44f4894e147a74a90949 P 79c1646c9659434b9a659382d2eb1d8a: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.385813 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 254) took 1972 ms. Trace:
I20260927 13:50:11.385978 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 8e8bf79954c2429f886ac7afc9a8455f (table default.Table_13ce227af9d24669b442822fd4067b7c [id=8ac45fbdc31b499b9f246f5a1167281a]) successfully deleted
I20260927 13:50:11.385942 7190 rpcz_store.cc:276] 0927 13:50:09.412967 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.413015 (+ 48us) service_pool.cc:224] Handling call
0927 13:50:11.385676 (+1972661us) ts_tablet_manager.cc:1151] Deleting tablet 8ed33e78ee5448bcae633cc874c3e171
0927 13:50:11.385690 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.385797 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1972519}
I20260927 13:50:11.386369 7190 tablet_replica.cc:333] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
W20260927 13:50:11.386482 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 8ed33e78ee5448bcae633cc874c3e171 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ed33e78ee5448bcae633cc874c3e171 already in progress: creating tablet
I20260927 13:50:11.386919 5628 consensus_queue.cc:260] T ab12ebc5fdcb44948ec5f53f26c18f20 P 34fc5fe0a32d42ab83f4aa6d07341409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.386662 5319 leader_election.cc:304] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:11.387734 7190 raft_consensus.cc:2243] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:11.387948 7190 raft_consensus.cc:2272] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.388499 7551 raft_consensus.cc:2804] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:11.388581 7190 ts_tablet_manager.cc:1916] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.388628 7551 raft_consensus.cc:493] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:11.388682 5628 ts_tablet_manager.cc:1434] T ab12ebc5fdcb44948ec5f53f26c18f20 P 34fc5fe0a32d42ab83f4aa6d07341409: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 13:50:11.388818 7551 raft_consensus.cc:3060] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.389070 5628 tablet_bootstrap.cc:492] T d51c3fa3624340059f6508ced1a2220e P 34fc5fe0a32d42ab83f4aa6d07341409: Bootstrap starting.
W20260927 13:50:11.390002 5045 leader_election.cc:343] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.390117 5045 leader_election.cc:304] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:11.390566 7481 raft_consensus.cc:2749] T 39fa23553c554826ad811ebe2e978ef9 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:11.392982 7551 raft_consensus.cc:515] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.393769 7551 leader_election.cc:290] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.395125 7190 ts_tablet_manager.cc:1929] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:11.395310 7190 log.cc:1199] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/6ff7d501f7704e69b696053cb1b1ffe5
I20260927 13:50:11.395744 7190 ts_tablet_manager.cc:1950] T 6ff7d501f7704e69b696053cb1b1ffe5 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:11.396102 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 255) took 1982 ms. Trace:
I20260927 13:50:11.396225 7190 rpcz_store.cc:276] 0927 13:50:09.413483 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.413535 (+ 52us) service_pool.cc:224] Handling call
0927 13:50:11.386320 (+1972785us) ts_tablet_manager.cc:1151] Deleting tablet 6ff7d501f7704e69b696053cb1b1ffe5
0927 13:50:11.386331 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.391925 (+ 5594us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.395079 (+ 3154us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.396085 (+ 1006us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1972609}
I20260927 13:50:11.396901 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet 6ff7d501f7704e69b696053cb1b1ffe5 (table default.Table_eff6033580e94f2bac135304b3786335 [id=8d27d076ff4b448c8c752d8ac6146b67]) successfully deleted
I20260927 13:50:11.397372 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 256) took 1982 ms. Trace:
I20260927 13:50:11.397528 7190 rpcz_store.cc:276] 0927 13:50:09.414941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.415008 (+ 67us) service_pool.cc:224] Handling call
0927 13:50:11.397226 (+1982218us) ts_tablet_manager.cc:1151] Deleting tablet 9855fd321e4b4d0aa37f7b31d7a5efca
0927 13:50:11.397236 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.397353 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1982039}
W20260927 13:50:11.398078 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 9855fd321e4b4d0aa37f7b31d7a5efca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9855fd321e4b4d0aa37f7b31d7a5efca already in progress: creating tablet
I20260927 13:50:11.398461 7190 tablet_replica.cc:333] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:11.398696 7190 raft_consensus.cc:2243] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Raft consensus shutting down.
I20260927 13:50:11.398908 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71268fb7aa9646639ea41dc8ccebfc5c" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:50:11.398907 5319 leader_election.cc:343] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 71268fb7aa9646639ea41dc8ccebfc5c
I20260927 13:50:11.399127 5234 raft_consensus.cc:3060] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.399053 7190 raft_consensus.cc:2272] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.401782 5234 raft_consensus.cc:2468] T 71268fb7aa9646639ea41dc8ccebfc5c P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:11.402148 7190 ts_tablet_manager.cc:1916] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.402251 5319 leader_election.cc:304] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:11.402565 7551 raft_consensus.cc:2804] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:11.402747 7551 raft_consensus.cc:697] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:11.403074 7551 consensus_queue.cc:237] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
W20260927 13:50:11.414834 5184 consensus_peers.cc:597] T 5aed7fe630f64213846ad37d904f6516 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5aed7fe630f64213846ad37d904f6516. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:11.420166 7190 ts_tablet_manager.cc:1929] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:11.420399 5619 tablet_bootstrap.cc:492] T cf1a58c67bf54493a3c62fb175acabb8 P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:11.420614 7190 log.cc:1199] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/bb7b3a35b2e94bbea6be4b4a8f158593
I20260927 13:50:11.420686 5619 ts_tablet_manager.cc:1403] T cf1a58c67bf54493a3c62fb175acabb8 P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.000s
I20260927 13:50:11.421466 5619 raft_consensus.cc:359] T cf1a58c67bf54493a3c62fb175acabb8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.421707 5619 raft_consensus.cc:385] T cf1a58c67bf54493a3c62fb175acabb8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.421823 5619 raft_consensus.cc:740] T cf1a58c67bf54493a3c62fb175acabb8 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
W20260927 13:50:11.422240 5184 consensus_peers.cc:597] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a -> Peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Couldn't send request to peer 34fc5fe0a32d42ab83f4aa6d07341409. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e3b98290dc74d88856e13f003a1e4c7. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:11.422178 5619 consensus_queue.cc:260] T cf1a58c67bf54493a3c62fb175acabb8 P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.423249 7190 ts_tablet_manager.cc:1950] T bb7b3a35b2e94bbea6be4b4a8f158593 P 79c1646c9659434b9a659382d2eb1d8a: Deleting consensus metadata
I20260927 13:50:11.424017 5619 ts_tablet_manager.cc:1434] T cf1a58c67bf54493a3c62fb175acabb8 P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 13:50:11.424427 7370 raft_consensus.cc:493] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.424544 7370 raft_consensus.cc:515] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.425143 5619 tablet_bootstrap.cc:492] T 352e564866a747798ad44218133844ba P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:11.425122 7370 leader_election.cc:290] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.425812 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bba86a18504fc1ae2a3aef7f7c5a39" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:11.426012 5100 raft_consensus.cc:2468] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 0.
I20260927 13:50:11.426896 5619 tablet_bootstrap.cc:654] T 352e564866a747798ad44218133844ba P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.426964 5184 leader_election.cc:304] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:11.427171 7265 raft_consensus.cc:493] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.427296 7265 raft_consensus.cc:515] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.427846 7265 leader_election.cc:290] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.427975 7265 raft_consensus.cc:2804] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:11.428025 7265 raft_consensus.cc:493] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:11.428072 7265 raft_consensus.cc:3060] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.429164 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 257) took 2014 ms. Trace:
I20260927 13:50:11.429579 7190 rpcz_store.cc:276] 0927 13:50:09.415063 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.415221 (+ 158us) service_pool.cc:224] Handling call
0927 13:50:11.398412 (+1983191us) ts_tablet_manager.cc:1151] Deleting tablet bb7b3a35b2e94bbea6be4b4a8f158593
0927 13:50:11.398423 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.409961 (+ 11538us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.420076 (+ 10115us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.429102 (+ 9026us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":943,"tablet-delete.queue_time_us":1983025}
I20260927 13:50:11.424242 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 200) took 4786 ms. Trace:
I20260927 13:50:11.431071 6428 catalog_manager.cc:5063] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): tablet bb7b3a35b2e94bbea6be4b4a8f158593 (table default.Table_2e56407bf2244b24860c913e16e71016 [id=9c366b9f762a47eb9a449b565111014a]) successfully deleted
I20260927 13:50:11.431185 7111 rpcz_store.cc:276] 0927 13:50:06.638087 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.638166 (+ 79us) service_pool.cc:224] Handling call
0927 13:50:11.340995 (+4702829us) ts_tablet_manager.cc:1151] Deleting tablet 496cffc2a8774185a0e0f63208bed8a5
0927 13:50:11.341004 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.353497 (+ 12493us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.356876 (+ 3379us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.424189 (+ 67313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2052,"tablet-delete.queue_time_us":4696496}
I20260927 13:50:11.431432 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6a4cf5ee2b43158d8db4c7cdd4a42e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" is_pre_election: true
I20260927 13:50:11.431605 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 202) took 4793 ms. Trace:
I20260927 13:50:11.431643 5100 raft_consensus.cc:2393] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c1646c9659434b9a659382d2eb1d8a in current term 1: Already voted for candidate bb28c54312c94d7dafb1c2abf7870735 in this term.
I20260927 13:50:11.431708 7111 rpcz_store.cc:276] 0927 13:50:06.638510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.638556 (+ 46us) service_pool.cc:224] Handling call
0927 13:50:11.431465 (+4792909us) ts_tablet_manager.cc:1151] Deleting tablet 4bb8dc5aadf243e6838a48f6219b9ae2
0927 13:50:11.431473 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.431571 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4786908}
I20260927 13:50:11.432049 7265 raft_consensus.cc:515] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.432111 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 203) took 4793 ms. Trace:
I20260927 13:50:11.428364 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bba86a18504fc1ae2a3aef7f7c5a39" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.430516 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6a4cf5ee2b43158d8db4c7cdd4a42e" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.432237 7111 rpcz_store.cc:276] 0927 13:50:06.638762 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.638820 (+ 58us) service_pool.cc:224] Handling call
0927 13:50:11.431990 (+4793170us) ts_tablet_manager.cc:1151] Deleting tablet dd0126a6df14457ca5c62c129f3275f8
0927 13:50:11.431998 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.432081 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4787387}
I20260927 13:50:11.432493 7111 tablet_replica.cc:333] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:11.432750 7111 raft_consensus.cc:2243] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:11.432811 5185 leader_election.cc:304] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a; no voters: 34fc5fe0a32d42ab83f4aa6d07341409, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:11.432927 7111 raft_consensus.cc:2272] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.432932 5100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bba86a18504fc1ae2a3aef7f7c5a39" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fc5fe0a32d42ab83f4aa6d07341409"
I20260927 13:50:11.433070 5100 raft_consensus.cc:3060] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.433152 7370 raft_consensus.cc:3060] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.433482 7111 ts_tablet_manager.cc:1916] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.434898 5628 tablet_bootstrap.cc:654] T d51c3fa3624340059f6508ced1a2220e P 34fc5fe0a32d42ab83f4aa6d07341409: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.435711 5100 raft_consensus.cc:2468] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 34fc5fe0a32d42ab83f4aa6d07341409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:11.435845 7370 raft_consensus.cc:2749] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:11.436153 5184 leader_election.cc:304] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409, 79c1646c9659434b9a659382d2eb1d8a; no voters:
I20260927 13:50:11.436370 7265 leader_election.cc:290] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [CANDIDATE]: Term 1 election: Requested vote from peers bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.436491 7265 raft_consensus.cc:2804] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:11.436654 7265 raft_consensus.cc:697] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [term 1 LEADER]: Becoming Leader. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Running, Role: LEADER
I20260927 13:50:11.436836 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bba86a18504fc1ae2a3aef7f7c5a39" candidate_uuid: "79c1646c9659434b9a659382d2eb1d8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735"
I20260927 13:50:11.436867 7265 consensus_queue.cc:237] T 87bba86a18504fc1ae2a3aef7f7c5a39 P 79c1646c9659434b9a659382d2eb1d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.437006 5385 raft_consensus.cc:3060] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.440152 5385 raft_consensus.cc:2468] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1.
I20260927 13:50:11.441005 7111 ts_tablet_manager.cc:1929] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:11.441143 7111 log.cc:1199] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-2/wal/wals/7e3b98290dc74d88856e13f003a1e4c7
I20260927 13:50:11.441375 5380 raft_consensus.cc:2376] T 87bba86a18504fc1ae2a3aef7f7c5a39 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 79c1646c9659434b9a659382d2eb1d8a in term 1. Re-sending same reply.
I20260927 13:50:11.441498 7111 ts_tablet_manager.cc:1950] T 7e3b98290dc74d88856e13f003a1e4c7 P bb28c54312c94d7dafb1c2abf7870735: Deleting consensus metadata
I20260927 13:50:11.442488 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 201) took 4804 ms. Trace:
I20260927 13:50:11.442577 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 496cffc2a8774185a0e0f63208bed8a5 (table default.Table_e5f8007fdae74bbe92a5c011cf80f361 [id=d6bdeaa183ee42c3ba0895927bda5096]) successfully deleted
I20260927 13:50:11.442620 7111 rpcz_store.cc:276] 0927 13:50:06.638238 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.638287 (+ 49us) service_pool.cc:224] Handling call
0927 13:50:11.432427 (+4794140us) ts_tablet_manager.cc:1151] Deleting tablet 7e3b98290dc74d88856e13f003a1e4c7
0927 13:50:11.432435 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.437608 (+ 5173us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.440934 (+ 3326us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.442434 (+ 1500us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117,"tablet-delete.queue_time_us":4787926}
W20260927 13:50:11.442920 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 4bb8dc5aadf243e6838a48f6219b9ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bb8dc5aadf243e6838a48f6219b9ae2 already in progress: creating tablet
W20260927 13:50:11.443162 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet dd0126a6df14457ca5c62c129f3275f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd0126a6df14457ca5c62c129f3275f8 already in progress: creating tablet
I20260927 13:50:11.443216 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 258) took 2027 ms. Trace:
I20260927 13:50:11.443324 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 204) took 4804 ms. Trace:
I20260927 13:50:11.443363 6429 catalog_manager.cc:5063] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): tablet 7e3b98290dc74d88856e13f003a1e4c7 (table default.Table_be356ba34c0348f9bf24f85cddfd1e0d [id=24a51641d02d4f49b1a7b093da801017]) successfully deleted
I20260927 13:50:11.443410 7111 rpcz_store.cc:276] 0927 13:50:06.639036 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.643559 (+ 4523us) service_pool.cc:224] Handling call
0927 13:50:11.443108 (+4799549us) ts_tablet_manager.cc:1151] Deleting tablet 2e768c83fae54619ac849dfedd5ec654
0927 13:50:11.443116 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.443222 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4798448}
I20260927 13:50:11.443601 5430 heartbeater.cc:344] Connected to a master server at 127.4.163.124:37095
I20260927 13:50:11.443847 7111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35946 (request call id 205) took 4799 ms. Trace:
W20260927 13:50:11.443960 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet 2e768c83fae54619ac849dfedd5ec654 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e768c83fae54619ac849dfedd5ec654 already in progress: creating tablet
I20260927 13:50:11.443949 7111 rpcz_store.cc:276] 0927 13:50:06.643930 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.647999 (+ 4069us) service_pool.cc:224] Handling call
0927 13:50:11.443662 (+4795663us) ts_tablet_manager.cc:1151] Deleting tablet a4f4bc5cefef448d85ff31b7fafaca74
0927 13:50:11.443672 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.443767 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4795501}
W20260927 13:50:11.444397 6429 catalog_manager.cc:5043] TS bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): delete failed for tablet a4f4bc5cefef448d85ff31b7fafaca74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4f4bc5cefef448d85ff31b7fafaca74 already in progress: creating tablet
I20260927 13:50:11.443512 7190 rpcz_store.cc:276] 0927 13:50:09.415187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.415409 (+ 222us) service_pool.cc:224] Handling call
0927 13:50:11.430583 (+2015174us) ts_tablet_manager.cc:1151] Deleting tablet a0e14fd01a9141cdb2df030ee0dd05db
0927 13:50:11.430632 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.442963 (+ 12331us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2015036}
I20260927 13:50:11.445165 7111 tablet_replica.cc:333] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735: stopping tablet replica
I20260927 13:50:11.445447 7111 raft_consensus.cc:2243] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Raft consensus shutting down.
W20260927 13:50:11.445612 6428 catalog_manager.cc:5030] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet a0e14fd01a9141cdb2df030ee0dd05db because the tablet was not found. No further retry: Not found: Tablet not found: a0e14fd01a9141cdb2df030ee0dd05db
I20260927 13:50:11.445803 7111 pending_rounds.cc:70] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735: Trying to abort 1 pending ops.
I20260927 13:50:11.445880 7111 pending_rounds.cc:77] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333957678709395456 op_type: NO_OP noop_request { }
I20260927 13:50:11.446023 7111 raft_consensus.cc:2889] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 13:50:11.446156 7111 raft_consensus.cc:2272] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.446684 7190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44390 (request call id 259) took 2030 ms. Trace:
I20260927 13:50:11.446980 7190 rpcz_store.cc:276] 0927 13:50:09.415896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:09.415952 (+ 56us) service_pool.cc:224] Handling call
0927 13:50:11.446343 (+2030391us) ts_tablet_manager.cc:1151] Deleting tablet 2d64750141d74d988612304ce050688d
0927 13:50:11.446396 (+ 53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.446659 (+ 263us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2030210}
W20260927 13:50:11.447953 6428 catalog_manager.cc:5043] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): delete failed for tablet 2d64750141d74d988612304ce050688d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d64750141d74d988612304ce050688d already in progress: creating tablet
I20260927 13:50:11.448534 7190 tablet_replica.cc:333] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a: stopping tablet replica
I20260927 13:50:11.449163 7190 raft_consensus.cc:2243] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 13:50:11.450963 5626 tablet_bootstrap.cc:492] T d897f986d26a44f4894e147a74a90949 P 79c1646c9659434b9a659382d2eb1d8a: No bootstrap required, opened a new log
I20260927 13:50:11.451146 5626 ts_tablet_manager.cc:1403] T d897f986d26a44f4894e147a74a90949 P 79c1646c9659434b9a659382d2eb1d8a: Time spent bootstrapping tablet: real 0.070s user 0.004s sys 0.004s
W20260927 13:50:11.451303 5185 consensus_peers.cc:597] T 7e3b98290dc74d88856e13f003a1e4c7 P 79c1646c9659434b9a659382d2eb1d8a -> Peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Couldn't send request to peer bb28c54312c94d7dafb1c2abf7870735. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e3b98290dc74d88856e13f003a1e4c7. This is attempt 1: this message will repeat every 5th retry.
I20260927 13:50:11.451675 7111 ts_tablet_manager.cc:1916] T 71268fb7aa9646639ea41dc8ccebfc5c P bb28c54312c94d7dafb1c2abf7870735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.451884 5626 raft_consensus.cc:359] T d897f986d26a44f4894e147a74a90949 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.452138 5626 raft_consensus.cc:385] T d897f986d26a44f4894e147a74a90949 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.452241 5626 raft_consensus.cc:740] T d897f986d26a44f4894e147a74a90949 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c1646c9659434b9a659382d2eb1d8a, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.452491 5626 consensus_queue.cc:260] T d897f986d26a44f4894e147a74a90949 P 79c1646c9659434b9a659382d2eb1d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.453166 5626 ts_tablet_manager.cc:1434] T d897f986d26a44f4894e147a74a90949 P 79c1646c9659434b9a659382d2eb1d8a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 13:50:11.453725 7190 raft_consensus.cc:2272] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 13:50:11.453756 5626 tablet_bootstrap.cc:492] T cf1a58c67bf54493a3c62fb175acabb8 P 79c1646c9659434b9a659382d2eb1d8a: Bootstrap starting.
I20260927 13:50:11.460669 7190 ts_tablet_manager.cc:1916] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 13:50:11.463358 5619 tablet_bootstrap.cc:492] T 352e564866a747798ad44218133844ba P bb28c54312c94d7dafb1c2abf7870735: No bootstrap required, opened a new log
I20260927 13:50:11.463563 5619 ts_tablet_manager.cc:1403] T 352e564866a747798ad44218133844ba P bb28c54312c94d7dafb1c2abf7870735: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20260927 13:50:11.464380 5619 raft_consensus.cc:359] T 352e564866a747798ad44218133844ba P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.464619 5619 raft_consensus.cc:385] T 352e564866a747798ad44218133844ba P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 13:50:11.464753 5619 raft_consensus.cc:740] T 352e564866a747798ad44218133844ba P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Initialized, Role: FOLLOWER
I20260927 13:50:11.465057 5619 consensus_queue.cc:260] T 352e564866a747798ad44218133844ba P bb28c54312c94d7dafb1c2abf7870735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.465749 5619 ts_tablet_manager.cc:1434] T 352e564866a747798ad44218133844ba P bb28c54312c94d7dafb1c2abf7870735: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 13:50:11.466041 7481 raft_consensus.cc:493] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.466204 7481 raft_consensus.cc:515] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.466780 7481 leader_election.cc:290] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:11.467907 5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9198ace6a264737a990d6fb573faf2d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:11.468803 5044 leader_election.cc:343] T d9198ace6a264737a990d6fb573faf2d P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.471532 5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9198ace6a264737a990d6fb573faf2d" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
I20260927 13:50:11.471669 5619 tablet_bootstrap.cc:492] T 14f5479761f94ee0b339e125d06a808c P bb28c54312c94d7dafb1c2abf7870735: Bootstrap starting.
I20260927 13:50:11.471980 7551 consensus_queue.cc:1048] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:11.472084 7481 raft_consensus.cc:493] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.472189 7481 raft_consensus.cc:515] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } } peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } }
I20260927 13:50:11.472757 7481 leader_election.cc:290] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291)
I20260927 13:50:11.472852 7551 consensus_queue.cc:1048] T e54a83664397460399960a0f73966fef P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:11.473265 5619 tablet_bootstrap.cc:654] T 14f5479761f94ee0b339e125d06a808c P bb28c54312c94d7dafb1c2abf7870735: Neither blocks nor log segments found. Creating new log.
I20260927 13:50:11.473377 5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5978cb78bd974d669817def05007d0ea" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:11.473855 5044 leader_election.cc:343] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.474442 5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5978cb78bd974d669817def05007d0ea" candidate_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb28c54312c94d7dafb1c2abf7870735" is_pre_election: true
W20260927 13:50:11.475203 5045 leader_election.cc:343] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb28c54312c94d7dafb1c2abf7870735 (127.4.163.67:40291): Illegal state: must be running to vote when last-logged opid is not known
I20260927 13:50:11.475296 5045 leader_election.cc:304] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34fc5fe0a32d42ab83f4aa6d07341409; no voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735
I20260927 13:50:11.475826 7481 raft_consensus.cc:2749] T 5978cb78bd974d669817def05007d0ea P 34fc5fe0a32d42ab83f4aa6d07341409 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 13:50:11.481621 7551 raft_consensus.cc:493] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 13:50:11.481803 7551 raft_consensus.cc:515] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.482599 7551 leader_election.cc:290] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.484341 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "467aa7fb4edf4b1b8dad6514d1d017b1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a" is_pre_election: true
W20260927 13:50:11.484395 5319 leader_election.cc:343] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 467aa7fb4edf4b1b8dad6514d1d017b1
I20260927 13:50:11.484553 5239 raft_consensus.cc:2468] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 0.
I20260927 13:50:11.485034 5319 leader_election.cc:304] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:11.485606 7551 raft_consensus.cc:2804] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 13:50:11.485693 7551 raft_consensus.cc:493] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 13:50:11.485769 7551 raft_consensus.cc:3060] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.493067 7551 raft_consensus.cc:515] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.493911 7551 leader_election.cc:290] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Requested vote from peers 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007), 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061)
I20260927 13:50:11.495278 5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "467aa7fb4edf4b1b8dad6514d1d017b1" candidate_uuid: "bb28c54312c94d7dafb1c2abf7870735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c1646c9659434b9a659382d2eb1d8a"
W20260927 13:50:11.495312 5319 leader_election.cc:343] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34fc5fe0a32d42ab83f4aa6d07341409 (127.4.163.65:41061): Not found: Tablet not found: 467aa7fb4edf4b1b8dad6514d1d017b1
I20260927 13:50:11.495465 5239 raft_consensus.cc:3060] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a [term 0 FOLLOWER]: Advancing to term 1
I20260927 13:50:11.498296 5239 raft_consensus.cc:2468] T 467aa7fb4edf4b1b8dad6514d1d017b1 P 79c1646c9659434b9a659382d2eb1d8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb28c54312c94d7dafb1c2abf7870735 in term 1.
I20260927 13:50:11.499387 5319 leader_election.cc:304] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c1646c9659434b9a659382d2eb1d8a, bb28c54312c94d7dafb1c2abf7870735; no voters: 34fc5fe0a32d42ab83f4aa6d07341409
I20260927 13:50:11.500296 7796 raft_consensus.cc:2804] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 13:50:11.500453 7796 raft_consensus.cc:697] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [term 1 LEADER]: Becoming Leader. State: Replica: bb28c54312c94d7dafb1c2abf7870735, State: Running, Role: LEADER
I20260927 13:50:11.500676 7796 consensus_queue.cc:237] T 467aa7fb4edf4b1b8dad6514d1d017b1 P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c1646c9659434b9a659382d2eb1d8a" member_type: VOTER last_known_addr { host: "127.4.163.66" port: 39007 } } peers { permanent_uuid: "bb28c54312c94d7dafb1c2abf7870735" member_type: VOTER last_known_addr { host: "127.4.163.67" port: 40291 } } peers { permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 } }
I20260927 13:50:11.506089 7359 consensus_queue.cc:1048] T fe6a4cf5ee2b43158d8db4c7cdd4a42e P bb28c54312c94d7dafb1c2abf7870735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fc5fe0a32d42ab83f4aa6d07341409" member_type: VOTER last_known_addr { host: "127.4.163.65" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 13:50:11.508034 7190 ts_tablet_manager.cc:1929] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 13:50:11.508608 7190 log.cc:1199] T 46537e1b33f24d50b705d53f6978da3c P 79c1646c9659434b9a659382d2eb1d8a: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-1/wal/wals/46537e1b33f24d50b705d53f6978da3c
I20260927 13:50:11.512735 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 44d29459405b4cdd921fb43bf5a2ae81 (table default.Table_81772b30c8204e60935c74293cea103f [id=7924f9989b95438bb8af0b55868bf59e]). Expected version 1 got 0
I20260927 13:50:11.513687 7098 ts_tablet_manager.cc:1929] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 13:50:11.514380 7098 log.cc:1199] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting WAL directory at /tmp/dist-test-task8U_Rfw/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790516977549536-4749-0/minicluster-data/ts-0/wal/wals/76a397300cdd44eb899f2ef5b9fe8c09
I20260927 13:50:11.515277 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 1aaffd54534442e1aa6db158d313fab3 (table default.Table_71f2aad652cc472996693761abcb7dde [id=75c2b51538334d469e8c2cea9aacd050]). Expected version 1 got 0
I20260927 13:50:11.516156 7098 ts_tablet_manager.cc:1950] T 76a397300cdd44eb899f2ef5b9fe8c09 P 34fc5fe0a32d42ab83f4aa6d07341409: Deleting consensus metadata
I20260927 13:50:11.516657 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet fb8c993214094940968aba3fcc38855c (table default.Table_afbef315ef9c437c9391fe5b16eabe40 [id=254b66d489074ce98c78c6e7dad7a382]). Expected version 1 got 0
I20260927 13:50:11.517184 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 34cd6225aaf34bdbbec06df453d57301 (table default.Table_1aa6327eb83449ce98d3c403af7ba028 [id=f78659fb9203483aa74b05e453e1fa63]). Expected version 3 got 0
I20260927 13:50:11.517446 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet 880ce1300eac40b28aac8cba3e11077e (table default.Table_d4e365ba6dad4ed594b173f874e884d4 [id=9e720c8c230f4fc28ea64071767c6ebc]). Expected version 1 got 0
I20260927 13:50:11.517980 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet fcf4c143d5824458be4a42945c338dc9 (table default.Table_e785f86cd0ec4345a80293a7f680d655 [id=ba243c4b6c524b69ae2ab5e7c8720ba2]). Expected version 4 got 0
I20260927 13:50:11.520352 7098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39028 (request call id 210) took 4919 ms. Trace:
I20260927 13:50:11.521723 6441 catalog_manager.cc:5938] TS 79c1646c9659434b9a659382d2eb1d8a (127.4.163.66:39007) does not have the latest schema for tablet e917382b6f3d4e009fa159ed38c342d8 (table default.Table_41087e1344494cfb90a27ac4b8478899 [id=df932e674be6487993e23fe38f4f8e20]). Expected version 2 got 0
I20260927 13:50:11.520798 7098 rpcz_store.cc:276] 0927 13:50:06.600518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0927 13:50:06.606425 (+ 5907us) service_pool.cc:224] Handling call
0927 13:50:11.304762 (+4698337us) ts_tablet_manager.cc:1151] Deleting tablet 76a397300cdd44eb899f2ef5b9fe8c09
0927 13:50:11.304770 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0927 13:50:11.431938 (+127168us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.513434 (+ 81496us) tablet_metadata.cc:665] Metadata flushed
0927 13:50:11.520230 (+ 6796us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us"